Programmable smart-sensing shelf liner apparatus for autonomous retail

公开(公告)号:
US20240138597A1
公开(公告)日:
2024-05-02
申请号:
US18/487059
申请日:
2023-10-14
授权日:
-
受理局:
美国
专利类型:
发明申请
简单法律状态:
审中
法律状态/事件:
实质审查
IPC分类号:
A47F5/00 | A47F10/02
战略新兴产业分类:
人工智能
国民经济行业分类号:
C2190 | C3311 | O8193 | C2110 | C2120 | C2130 | C2140
当前申请(专利权)人:
THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
原始申请(专利权)人:
THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
当前申请(专利权)人地址:
Oakland, CA, US
工商统一社会信用代码:
-
工商登记状态:
-
工商注册地址:
-
工商成立日期:
1868-01-01
工商企业类型:
-
发明人:
PAN, SHIJIA | ROHAL, SHUBHAM | ZHANG, YUE | RUIZ, CARLOS
代理机构:
-
代理人:
-
摘要:
A smart retail product shelf liner called ‘MOOCA’ to detect product loads on its surface. The liner preferably has an origami like structure whose properties (e.g., angles, unit size, material) are adjusted to make the liner configurable for different sizes, load ranges, and product packaging. The smart liner is well suited for autonomous checkout systems. MOOCA is an origami-inspired low-cost configurable surface structure having conductive threads and copper wires integrated into the origami structure to detect and recognize product loads and thus to detect when products are either picked-up, or put-down, upon the smart MOOCA liner of the shelf.
技术问题语段:
The current reliance on overhead cameras for tracking customer-product interactions in autonomous retail stores is inefficient and error-prone due to occlusion.
技术功效语段:
The patent describes a low-cost configurable surface structure as a smart shelf liner. It can detect and recognize products placed on or removed from the liner.
权利要求:
1. A store shelf lining apparatus for sensing events of product placement, and product removal, comprising: (a) a base material having a pattern of conductive strips, as a lower conductor grid, oriented in a first direction; (b) a flexible product retention structure coupled to said base material, and extending away from said base material to provide a contoured surface configured for retaining a plurality of products; (c) wherein said flexible product retention structure has a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by any, or all, of the plurality of products exceeds the compression threshold, and said flexible product retention structure has a negative Poisson's ratio which determines its reversible deformation when the load is removed; (d) a pattern of conductive wiring paths coupled along non-linear paths, as an upper conductor grid directed in a second orientation, upon portions of the flexible product retention structure, with conductive wiring on the underside of portions of the flexible product retention structure which are configured to make contact with the pattern of conductive strips under deformation in which the compression threshold is reached; (e) wherein said first orientation of said lower conductive strips is orthogonal to that of said second orientation; (f) a signal source for generating electrical current pulses; (g) a first multiplexer circuit configured for directing a pulse either: (i) along any one of the pattern of conductive strips on the lower conductor grid, or (ii) along any one of the conductive wiring paths of the upper conductor grid; (h) an analog multiplexer circuit having analog inputs connecting to either: (i) any one of the conductive wiring paths of the upper conductor grid, if the first multiplexer circuit is connected along any one of the pattern of conductive strips on the lower conductor grid; or (ii) any one of the pattern of conductive strips on the lower conductor grid, if the first multiplexer is connected along any one of the conductive wiring paths of the upper conductor grid; (j) a resistor coupled to the output of said analog multiplexer circuit, for creating a sufficient current draw to allow determining the extent of electrical conduction when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make electrical contact with said pattern of conductive strips in the lower conductor grid; (k) an analog-to-digital converter (ADC) configured for measuring the voltage received through the path from the upper conductor grid to the lower conductor grid; (l) a processor coupled to said first multiplexer, said analog multiplexer and to said ADC; (m) a non-transitory memory storing instructions executable by the processor for determining structure compression measurements of said flexible product retention structure; and (n) wherein said instructions, when executed by the processor, perform one or more steps comprising: (i) initializing a measurement pass; (ii) incrementing the selection of a signal path through said first multiplexer; (iii) generating a voltage pulse along said signal path; (iv) iterating through selecting different signal paths from said analog multiplexer and collecting voltage measurements from the ADC; (v) returning back to step (n)(ii) and looping until all signal paths through said first multiplexer have been measured; (vi) converting voltage measurements to applied force for each region in which said upper and lower conductor grids can enter into electrical contact in response to deformation of the flexible product retention structure; (vii) generating signals indicating applied force levels to external systems which are tracking product placement changes on the apparatus; and (viii) repeating the measurements passes in a periodic manner. 2. The apparatus of claim 1, wherein when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make an initial electrical contact with said pattern of conductive strips in the lower conductor grid, then as the structure under load increases, there is an increasing contact surface between the upper and lower conductors, which can be detected by measuring voltage at the ADC. 3. The apparatus of claim 1, wherein after converting voltage measurements to applied force, a determination is performed which identifies products retained on the flexible product retention structure based on size and weight and force distribution according to the shape of the package bottom. 4. The apparatus of claim 1, wherein said base material and its coupled flexible product retention structure are configured in shapes and sizes suitable for attachment over existing shelving, without the need of replacing the structure of existing shelving. 5. The apparatus of claim 1, wherein said flexible product retention structure comprises a 3D truss meta-structure of interconnected linear elements which form cells, that are interconnected to form a geometric structure configured for compressing to reach the pattern of conductive strips in response to sufficient force being applied by a product placed on said apparatus. 6. The apparatus of claim 5, wherein said interconnected linear elements comprise elastic material. 7. The apparatus of claim 6, wherein said elastic material comprises elastic resin. 8. The apparatus of claim 1, wherein said flexible product retention structure comprises a 3D truss model that is modified from a Miura Ori origami fold form a geometric structure configured for compressing to reach the pattern of conductive strips in response to sufficient force being applied by a product placed on said apparatus. 9. The apparatus of claim 1, wherein tuning parameters comprising element diameter, lengths and angles are adjusting in creating flexible product retention structures which are suitable for products of different sizes, shapes and weights. 10. The apparatus of claim 1, wherein said apparatus is configured to interface with the electronic equipment controlling Artificial Intelligence (AI) powered autonomous retail stores. 11. A store shelf lining apparatus for sensing events of product placement, and product removal, comprising: (a) a base material having a pattern of conductive strips, as a lower conductor grid, oriented in a first direction; (b) a flexible product retention structure coupled to said base material, and extending away from said base material to provide a contoured surface configured for retaining a plurality of products; (c) wherein said flexible product retention structure has a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by any, or all, of the plurality of products exceeds the compression threshold, and said flexible product retention structure has a negative Poisson's ratio which determines its reversible deformation when the load is removed; (d) a pattern of conductive wiring paths coupled along non-linear paths, as an upper conductor grid directed in a second orientation, upon portions of the flexible product retention structure, with conductive wiring on the underside of portions of the flexible product retention structure which are configured to make contact with the pattern of conductive strips under deformation in which the compression threshold is reached; (e) wherein said first orientation of said lower conductive strips is orthogonal to that of said second orientation; (f) a signal source for generating electrical current pulses; (g) a first multiplexer circuit configured for directing a pulse either: (i) along any one of the pattern of conductive strips on the lower conductor grid, or (ii) along any one of the conductive wiring paths of the upper conductor grid; (h) an analog multiplexer circuit having analog inputs connecting to either: (i) any one of the conductive wiring paths of the upper conductor grid, if the first multiplexer circuit is connected along any one of the pattern of conductive strips on the lower conductor grid; or (ii) any one of the pattern of conductive strips on the lower conductor grid, if the first multiplexer is connected along any one of the conductive wiring paths of the upper conductor grid; (j) a resistor coupled to the output of said analog multiplexer circuit, for creating a sufficient current draw to allow determining the extent of electrical conduction when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make electrical contact with said pattern of conductive strips in the lower conductor grid; (k) an analog-to-digital converter (ADC) configured for measuring the voltage received through the path from the upper conductor grid to the lower conductor grid; (l) a processor coupled to said first multiplexer, said analog multiplexer and to said ADC; (m) a non-transitory memory storing instructions executable by the processor for determining structure compression measurements of said flexible product retention structure; and (n) wherein said instructions, when executed by the processor, perform one or more steps comprising: (i) initializing a measurement pass; (ii) incrementing the selection of a signal path through said first multiplexer; (iii) generating a voltage pulse along said signal path; (iv) iterating through selecting different signal paths from said analog multiplexer and collecting voltage measurements from the ADC; (v) returning back to step (n)(ii) and looping until all signal paths through said first multiplexer have been measured; (vi) converting voltage measurements to applied force for each region in which said upper and lower conductor grids can enter into electrical contact in response to deformation of the flexible product retention structure; (vii) generating signals indicating applied force levels to external systems which are tracking product placement changes on the apparatus; (viii) repeating the measurement passes in a periodic manner; (o) wherein when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make an initial electrical contact with said pattern of conductive strips in the lower conductor grid, then as the structure under load increases, there is an increasing contact surface between the upper and lower conductors, which can be detected by measuring voltage at the ADC. 12. The apparatus of claim 11, wherein after converting voltage measurements to applied force, a determination is performed which identifies products retained on the flexible product retention structure based on size and weight and force distribution according to the shape of the package bottom. 13. The apparatus of claim 11, wherein said base material and its coupled flexible product retention structure are configured in shapes and sizes suitable for attachment over existing shelving, without the need of replacing the structure of existing shelving. 14. The apparatus of claim 11, wherein said flexible product retention structure comprises a 3D truss meta-structure of interconnected linear elements which form cells, that are interconnected to form a geometric structure configured for compressing to reach the pattern of conductive strips in response to sufficient force being applied by a product placed on said apparatus. 15. The apparatus of claim 14, wherein said interconnected linear elements comprise elastic material. 16. The apparatus of claim 15, wherein said elastic material comprises elastic resin. 17. The apparatus of claim 11, wherein said flexible product retention structure comprises a 3D truss model that is modified from a Miura Ori origami fold form a geometric structure configured for compressing to reach the pattern of conductive strips in response to sufficient force being applied by a product placed on said apparatus. 18. The apparatus of claim 11, wherein tuning parameters comprising element diameter, lengths and angles are adjusting in creating flexible product retention structures which are suitable for products of different sizes, shapes and weights. 19. The apparatus of claim 11, wherein said apparatus is configured to interface with the electronic equipment controlling Artificial Intelligence (AI) powered autonomous retail stores. 20. A method for sensing product placement and removal events with a store shelf lining, comprising: (a) configuring a lower section of a flexible shelf liner with conductive strips, as a lower conductor grid, oriented in a first direction; (b) configuring a flexible product retention structure, having structural peaks and valleys, coupled over said lower section of the flexible shelf liner, thereby providing a contoured surface for retaining a plurality of products; (c) configuring the flexible product retention structure to have a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by any, or all, of the plurality of products exceeds the compression threshold, and said flexible product retention structure has a negative Poisson's ratio which determines its reversible deformation when the load is removed; (d) configuring the flexible product retention structure with a pattern of conductive wiring paths coupled along non-linear paths, as an upper conductor grid directed in a second orientation, configured to make contact with the pattern of conductive strips under deformation in which the compression threshold is reached; (e) wherein said first orientation of said lower conductive strips is orthogonal to that of said second orientation; (f) generating an electrical signal source on any one of the conductive strips on the lower or upper conductor grid, and measuring voltage at each opposing grid (upper or lower); (g) converting voltage measurements to applied force for each region in which said upper and lower conductor grids can enter into electrical contact in response to deformation of the flexible product retention structure; (h) repeating generation of the electrical signal source on a subsequent conductive strip, and measuring voltage at each opposing grid, and repeating the process through all combinations of upper and lower conductor grids can make contact; (i) generating signals indicating applied force levels to external systems which are tracking product placement changes on the apparatus; and (j) periodically repeating the signal generation, measurement process and generating signals indicating applied force levels to update the collected information.
技术领域:
-
背景技术:
1. Technical Field [0004]The technology of this disclosure pertains generally to retail store shelf liners, and more particularly to a smart shelf liner which senses products placed on, or removed from the liner. 2. Background Discussion [0005]Artificial Intelligence (AI) powered autonomous retail stores generally rely on capturing and processing video from multiple overhead cameras to track the interaction of customers with the products. However, any such camera-based application is susceptible to occlusion. The video processing portion of the system must often rely on inferences, and thus is unable to provide reliable determinations of whether products were obtained from the shelves. This becomes a more intractable problem for cameras in a retail store setting; in view of the need to rely on a small number of cameras to provide coverage spanning both customers and products on the shelf. Therefore, the reliance on overhead cameras is both inefficient and error-prone for tracking items on the shelf for customer-product interaction detection and recognition. [0006]Other modalities, such as load sensors, have been explored to acquire this customer-product interaction information when there is occlusion. However, they often require expensive retrofit for the current store setup; for example, in replacing existing shelves with customized shelves equipped with the necessary sensors. So, the load sensor approach generally limits scalability of the system due to the cost in both manufacturing and labor. [0007]Accordingly, a need exists for a low cost smart shelving liner. The present disclosure fulfills that need and provides additional benefits over existing systems.
发明内容:
[0008]This disclosure describes an origami-inspired low-cost configurable surface structure as a smart shelf liner, which is referred to herein as “MOOCA”. The MOOCA system employs conductive threads and wires (e.g., copper wires) integrated into an ‘origami’-type structure to detect and recognize products which are placed on, and/or removed from, the smart shelf liner. [0009]According to an aspect of the technology, a prototype is described which was fabricated with a 3D printed structure using elastic resin. According to another aspect of the technology, MOOCA functionality is demonstrated for detecting the item that is picked up, or that is put back, upon the MOOCA liner. The system can also often detect the type of product, which is being held on the shelf, in response to detecting its size, weight and footprint as it sits on the shelf liner. [0010]Further aspects of the technology described herein will be brought out in the following portions of the specification, wherein the detailed description is for the purpose of fully disclosing preferred embodiments of the technology without placing limitations thereon.
具体实施方式:
1. Introduction [0019]A configurable smart shelf liner apparatus, referred to herein as “MOOCA”, is described. The MOOCA apparatus is capable of event detection, product identification, and inventory monitoring. The MOOCA apparatus is an easy to deploy shelf liner that can turn a conventional (normal, non-sensing) retail store shelf into a smart shelf capable of sensing when a product is placed on, and/or removed from, the shelf. Additionally, the apparatus can identify different products based on registering the bottom shape and size and load, and thus register a force distribution pattern for the product to discern it from other known products. [0020]The upper portion of the MOOCA structure which retains the product can be implemented as having a closed or open structure. A closed structure being described below in FIG. 1 comprising planar sections of material between folds in the material. An open structure, as described in regard to FIG. 2 through FIG. 5, is an open lattice of structural elements. In addition, this product retention structure of the MOOCA can also be implemented as a combination open-closed, or closed-open structure, without departing from the teachings of the present disclosure. [0021]In one embodiment, the MOOCA comprises a Muira-Ori origami (a form of origami widely used to fold to pack flat sheets into a smaller space) inspired auxetic structure (consisting of interoperating unit cells). The structure has a negative Poisson's ratio (amount of transversal elongation divided by the amount of axial compression). Due to this property, a MOOCA structure will always undergo reversible deformation and thus require less maintenance. 2. MOOCA Design [0022]FIG. 1 illustrates an example embodiment 10 of a MOOCA structure. In this example a base structure was exemplified, which enables configurable design over different target loads. The presented structure has two layers with a first conductive material 16 and a second conductive material 18, which enables load sensing when structure 14 deforms resulting in contact of first and second conductive materials 16 and 18. The structure 14 is a 3D model that is modified from a Miura Ori origami fold. The changes in the 3D fold angles determines the load bearing ability of the structure, hence making it configurable for sensing different ranges of pressures. [0023]A flexible product retention structure 14 is shown attached and/or coupled to a base layer 12, which may be flexible, semi-rigid, or rigid. One of the upper conductive paths 16 is shown ascribing (along) a non-linear path (e.g., zig-zag) on retention structure 14, while one of the lower conductive paths 18 is shown under the flexible product retention structure 14. The non-linearity (e.g., zig-zagging) of the upper conductive paths allow the conductor to flex down toward meeting the lower conductive paths; as a conductor (wire) constrained in a straight line (linear) would not be sufficiently compliant. The overall paths of conductors 16 and 18 are orthogonal to one another, so that each of the multiple upper conductors (one of which is exemplified with conductor 16) passes above each of the lower conductors (one of which is exemplified with conductor 18). [0024]The Miura-Ori origami type structure 14 adopted in this example has the properties of: (1) a quasi-static compression behavior which determines its load bearing ability and leads to deformation when the load exceeds the threshold, and (2) has a negative Poisson's ratio which determines its reversible deformation when the load is removed. [0025]FIG. 2 and FIG. 3 illustrate example embodiments 30, 34 of Three-Dimensional (3D) open frame truss meta-structures which provide different tuning parameters. These structures are shown here as interconnected linear elements 36, exemplified with diameters d 44, stated by way of example and not limitation as these elements need not have a circular cross section, nor are all the elements required to utilize the same-shaped cross section or diameter (width). In the example, these elements are connected to form a series of triangular open areas, although the invention is not limited to using triangular trussed sections. One such of these triangular sections of elements is shown in FIG. 2 with first and second sides a 38 and b 40 between which is subscribed a twist angle ϕ42. In FIG. 3 is shown a structure which also provides a dihedral angle θ46. [0026]It should be appreciated that tuning parameters such as element diameter d, twist angle ϕ, dihedral angle θ, and lengths a and b in FIG. 2 can alter the load sensitivity of the structure. [0027]FIG. 4 illustrates an example MOOCA structure 50 formed by interconnecting 3D truss structure unit cells, such as seen in FIG. 2 and FIG. 3. In at least one embodiment, the 3D truss structure of unit cells was printed on a 3D printer in a repeating pattern with an elastic resin material. It should be appreciated that by adjusting the tuning parameters, which include element diameter, lengths and connection angles, flexible product retention structures can be created which are suitable for a wide range of products, that may differ for example in size, shape and weight. [0028]In the prototype, the upper conductor was applied as conductive threads woven onto the elastic structure. Alternatively, a wire can be bonded to the structure with heat and/or the use of adhesives. This wire may even comprise a premade wire with knots, or other conductive extensions along its length. In addition, it should be appreciated that the conductor may be embedded onto the flexible structure in various other ways without departing from the teachings of the present disclosure; including use of printing or painting a conductive material to create conductive paths on structure 50. [0029]FIG. 5 illustrates an example embodiment 70 showing the structure of FIG. 4, here shown as structure 75, which has been attached over an insulating base section 72 that has conductive paths 73a, 73b, 73c, 73d, 73e, 73f, 73g and 73h. The upper conductors 74a, 74b, 74c, 74d, and 74e, are shown connected along the elements of structure 75 with a direction perpendicular to the copper tapes in the bottom layer, whereby a switch grid is formed having electrical connections 76, 78. It should be appreciated that the smart shelf liners according to the present disclosure may be fabricated to any desired size or shape, and the flexible product retention structure can be fabricated having a configuration of peaks and valleys to accommodate the retention of a wide range of product packaging. [0030]When the load is applied to a meta-structure unit and deforms it, the conductive material (e.g., thread) (74a-74e) on structure 75 will come into contact with one or more of the lower conductive paths (73a-73h), and thus result in a switch connection being made. When the load is removed, the elasticity of the structure provides a restorative force which enables the restoration of the original no-load form, whereby the connection opens up to a non-conductive state. This elasticity of the structure also enables a finer-grained (non-binary) conductivity measurement that is at least somewhat proportional to the weight applied. It will be appreciated that as distortion of the structure under load increases, there is an increasing contact surface between the upper and lower conductors in that area. This is important as it allows product force to be estimated at that particular point on the shelf liner. [0031]The configurable variables in the present example include meta-structure size (rod a and b) length, rod diameter d, twist angle ϕ, and dihedral angle θ. In one embodiment, the MOOCA's dynamic sensing range is configured by changing the parameters of the meta-structure unit shown in FIG. 2 and/or FIG. 3. For example, by tuning the parameters, such as d and θ, the nodal force response of the truss structure can be changed, and hence structural sensitivity to different load ranges can be selected for the application. [0032]For a force F applied on the meta-structure unit, a shear stress component is generated as F*cos(θ/2) along the pole of the structure. When this shear stress exceeds a threshold Thshear, the deformation occurs. As the angle θ increases, a smaller F is required to satisfy F*cos(θ/2)>Thshear. This Thshear is also determined by the pole diameter d, where a reduction in the radius will lead to a lower Thshear. [0033]In one test, meta structures with two different parameter sets were tested under load. A first meta-structure having a dihedral angle θ of 140° and an element diameter d of 1.5 mm, was subjected to a 71 gram load, and it provided a stable support. A second meta-structure having a dihedral angle θ of 150° and an element diameter d of 1.25 mm, was subjected to the same 71 gram load and had substantial deformation. This demonstrates the use of two structures having different configurations and exhibiting different deformations under the same load. 3. Example Embodiment [0034]A working example was fabricated to demonstrate the feasibility of MOOCA. A 3D model based on the meta-structure of FIG. 2 and FIG. 3 having parameters settings of a=10 mm, b=14.14 mm, d=1.25 mm, θ=140° degree, ϕ=45° degree. The model was created with Shapr3D® software to generate the 3D model (FIG. 4) for printing. The Elegoo Saturn S 3D printer was used with Resione® F80 resin to print the model. A conductive thread (Kookye® thread with resistance of 2Ω per foot) was woven onto the 3D printing structure and a knot tied at each movement node on each unit of the meta-structure. The movement node is considered to be one or more places along the unit cell structure, whereby under sufficient displacement force a portion of the conductive material (e.g., the knot) will contact the lower conductor. In the example given, a copper foil tape was used as the conductive material at the lower base layer. The attachment of the wiring (jump wires) to the copper foil tape and to the conductive thread was accomplished using a conductive paint (Bare conductive electric paint). [0035]It should be appreciated that various forms of material for the upper and lower conductors, as well as different forms on connection to those conductors may be utilized without departing from the teachings of the present disclosure. [0036]FIG. 6 illustrates an example circuit embodiment 110 for processing the signals from the MOOCA smart shelf liner structure 112. The figure depicts the MOOCA structure 112 having a first and second set of connections 114, 116 as part of a form of cross-point matrix. Each of these sets of wires is connected to its own multiplexer (mux) 120, 122. In the prototype each multiplexer comprised an analog/digital multiplexer/demultiplexer (e.g., Sparkfun® BOB-09056, containing a CD74HC4067 integrated circuit). [0037]For performing the multiplexing, other circuitry may be utilized; for example, a simpler digital circuit for mux 120, or even driving separate outputs from the MCU itself and eliminating mux 120, insofar as the MCU has a sufficient number of available GPIO pins. In order to characterize the level of contact between grid elements, mux 122 needs to be an analog mux, so that a range of contact levels can be determined based on the current flow through the specific contact nodes. It should be noted that an MCU, or ASIC, may be utilized which contains on board multiplexers, or a sufficient number of ADCs, whereby an external mux and/or ADC circuit would not be necessary. It should be appreciated that although the examples described indicate working with a given number of upper and lower conductors, the present disclosure can be implemented to handle any desired number of cross-point connection locations without departing from the teachings of the present disclosure. [0038]A microcontroller unit (MCU) 118 is shown for controlling measurements from the cross-point matrix of the MOOCA. The MCU is shown connected 119 to control output selection on mux 120, and input selection on mux 122. In addition, the MCU is interfaced 127 to control an Analog-to-Digital converter 126 which takes measurements from the output of mux 122. [0039]It should also be appreciated that the system need not utilize a microcontroller(s), as it may be fabricated with other circuits, such as gate arrays, custom logic and analog circuits, application specific integrated circuit (ASICs), and so forth, and/or combinations thereof without departing from the teachings of the present disclosure. [0040]The following describes a single measurement pass which checks each of the crossing point locations between the upper and lower conductors. [0041]By way of example MCU 118 can set (control) mux 120 to select one line of the lower conductive grid (e.g., 73a of FIG. 5), and mux 122 to select one of the upper grid lines (e.g., 74a of FIG. 5). Then the MCU sends a signal pulse through mux 120, which will be directed along that one line. The MCU monitors for output from mux 122 as registered by Analog-to-Digital (ADC) converter 126. It will be noted that in some cases this ADC would be internal to the MCU, although an external ADC may be used and is shown here for the sake of clarity. The ADC will read a value near ground potential because of pull down resistor 124 (e.g., R=680Ω) on the output of the mux, unless the MOOCA is sufficiently physically displaced at that location by product weight to create some level of electrical contact between lines 73a and 74a. It should be noted that the value of pull down resistance 124 was chosen to provide a tradeoff between higher contact currents, which provide increased sensitivity of measurement, and keeping power consumption beneficially reasonable. [0042]If a given threshold of voltage is reached, then the MCU registers the voltage as a pressure contact and discerns from the measured voltage the relative pressure applied at that point on the smart shelf liner. The correlation between voltage levels and pressure applied is determined for each specific MOOCA design, whereby predetermined threshold values may be programmed onto the MCU. Otherwise, the MCU can perform a calibration procedure with different weights applied to the liner, so to properly discern different product contact pressure levels. [0043]It should be noted that in at least one embodiment/mode/option the MCU after converting voltage measurements to applied force, can identify product types on the shelf based on size and weight and force distribution from the shape of the package bottom pressing against the shelf structure. This is based on predetermined information about product weight and shape, or calibrations performed for the system and loaded into the MCU to capture these product characteristics. Alternatively, or additionally, the characteristics of force distribution may be communicated to the retail store system for it to process, or to further process. [0044]Then the MCU changes mux 122 to select another line of the upper grid (e.g., 74b of FIG. 5), wherein it checks again to determine from the measured voltage from the ADC if there is any level of contact between the upper and lower conductors at that grid node. Then the MCU proceeds to do this same operation for each of the upper lines (e.g., 74c-74e) checking the voltages to determine the level of contact at each of these grid nodes. [0045]The MCU then directs mux 120 to select the next lower conductive line (e.g., 73b of FIG. 5), and iterates through checking each upper grid line (e.g., 74a through to 74e) to determine the level of conductivity. Once this process is completed for each lower conductive line (e.g., 73a-73h of FIG. 5), then a single pass of conduction checking has been concluded wherein each cross-point possibility has been checked. It should be appreciated that the operations described above may be reversed between the upper and lower conductive paths without departing from the teachings of the present disclosure. [0046]The MCU maintains this information about the state at each cross-point, such as by storing and maintaining each measurement in an array of variables. The MCU may also store values for previous measurements, to more readily assess if there are changes. It may also, or alternatively, maintain a rolling average of any desired depth; whereby a current measurement is averaged into a new measurement, as this provides a means for reducing variations between measurements, such as arising from ambient electrical noise. [0047]The information is then conveyed by the MCU through one or more outputs 128 to one or more external systems. In at least one embodiment/mode/option information is not sent to the external system unless there is a change of status (e.g., product placed/removed); however periodic general system status information would be preferably sent so that it can be recognized that the system is operating normally. The form of output communication used depends on the specific application. For example, straightforward digital output can be conveyed from simple SPI, 12C, CAN or similar digital busses, or higher level data collection may be utilized, whether the information is conveyed utilizing a wired bus or a wireless communication. [0048]The higher level data collection would be used for collecting, analyzing, and annunciating/displaying information collected from a number of MOOCA shelves, and may even correlate this data with image processing performed by camera systems. These aspects are application specific and beyond the scope of this discussion. [0049]After completing a pass, the MCU continues performing these tests on a periodic basis, such as completing a pass one or more times per second. Although toward reducing power consumption the sampling rates may be reduced. [0050]FIG. 7 illustrates an example embodiment 150 of the MCU integrated with MOOCA for product pressure information as output by MOOCA. In the figure, a bottle ‘put-down event’ is shown in which a bottle 154 is placed on the MOOCA smart liner 152. [0051]FIG. 8 illustrates example results 170 of a heatmap of ADC values generated by MOOCA at different cross-point node locations in response to placing product 154 onto the MOOCA. This heatmap is the type of information which can be collected for identifying products, based on size, weight and force distribution. [0052]FIG. 9 illustrates an example output 190 comparing outputs from two different configurations of unit cells in response to differing loads. The common variables are a=10 mm, b=14.14 mm, d=1.5 mm, ϕ=45 degree. The solid line (upper plot) shows the average ADC values over the weights between 10 to 110 grams with θ=150 degree, and the dashed line (lower plot) shows these with θ=140 degree. The two curves demonstrate different weight response properties between two different parameter configurations. 4. General Scope of Embodiments [0053]Embodiments of the present technology may be described herein with reference to flowchart illustrations of methods and systems according to embodiments of the technology, and/or procedures, algorithms, steps, operations, formulae, or other computational depictions, which may also be implemented as computer program products. In this regard, each block or step of a flowchart, and combinations of blocks (and/or steps) in a flowchart, as well as any procedure, algorithm, step, operation, formula, or computational depiction can be implemented by various means, such as hardware, firmware, and/or software including one or more computer program instructions embodied in computer-readable program code. As will be appreciated, any such computer program instructions may be executed by one or more computer processors, including without limitation a general purpose computer or special purpose computer, or other programmable processing apparatus to produce a machine, such that the computer program instructions which execute on the computer processor(s) or other programmable processing apparatus create means for implementing the function(s) specified. [0054]Accordingly, blocks of the flowcharts, and procedures, algorithms, steps, operations, formulae, or computational depictions described herein support combinations of means for performing the specified function(s), combinations of steps for performing the specified function(s), and computer program instructions, such as embodied in computer-readable program code logic means, for performing the specified function(s). It will also be understood that each block of the flowchart illustrations, as well as any procedures, algorithms, steps, operations, formulae, or computational depictions and combinations thereof described herein, can be implemented by special purpose hardware-based computer systems which perform the specified function(s) or step(s), or combinations of special purpose hardware and computer-readable program code. [0055]Furthermore, these computer program instructions, such as embodied in computer-readable program code, may also be stored in one or more computer-readable memory or memory devices that can direct a computer processor or other programmable processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory or memory devices produce an article of manufacture including instruction means which implement the function specified in the block(s) of the flowchart(s). The computer program instructions may also be executed by a computer processor or other programmable processing apparatus to cause a series of operational steps to be performed on the computer processor or other programmable processing apparatus to produce a computer-implemented process such that the instructions which execute on the computer processor or other programmable processing apparatus provide steps for implementing the functions specified in the block(s) of the flowchart(s), procedure (s) algorithm(s), step(s), operation(s), formula(e), or computational depiction(s). [0056]It will further be appreciated that the terms “programming” or “program executable” as used herein refer to one or more instructions that can be executed by one or more computer processors to perform one or more functions as described herein. The instructions can be embodied in software, in firmware, or in a combination of software and firmware. The instructions can be stored local to the device in non-transitory media, or can be stored remotely such as on a server, or all or a portion of the instructions can be stored locally and remotely. Instructions stored remotely can be downloaded (pushed) to the device by user initiation, or automatically based on one or more factors. [0057]It will further be appreciated that as used herein, the terms processor, hardware processor, computer processor, central processing unit (CPU), and computer are used synonymously to denote a device capable of executing the instructions and communicating with input/output interfaces and/or peripheral devices, and that the terms processor, hardware processor, computer processor, CPU, and computer are intended to encompass single or multiple devices, single core and multicore devices, and variations thereof. [0058]From the description herein, it will be appreciated that the present disclosure encompasses multiple implementations of the technology which include, but are not limited to, the following: [0059]A store shelf lining apparatus for sensing events of product placement, and product removal, comprising: (a) a base material having a pattern of conductive strips, as a lower conductor grid, oriented in a first direction; (b) a flexible product retention structure coupled to said base material, and extending away from said base material to provide a contoured surface configured for retaining a plurality of products; (c) wherein said flexible product retention structure has a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by any, or all, of the plurality of products exceeds the compression threshold, and said flexible product retention structure has a negative Poisson's ratio which determines its reversible deformation when the load is removed; (d) a pattern of conductive wiring paths coupled along non-linear paths, as an upper conductor grid directed in a second orientation, upon portions of the flexible product retention structure, with conductive wiring on the underside of portions of the flexible product retention structure which are configured to make contact with the pattern of conductive strips under deformation in which the compression threshold is reached; (e) wherein said first orientation of said lower conductive strips is orthogonal to that of said second orientation; (f) a signal source for generating electrical current pulses; (g) a first multiplexer circuit configured for directing a pulse either: (g)(i) along any one of the pattern of conductive strips on the lower conductor grid, or (g)(ii) along any one of the conductive wiring paths of the upper conductor grid; (h) an analog multiplexer circuit having analog inputs connecting to either: (h)(i) any one of the conductive wiring paths of the upper conductor grid, if the first multiplexer circuit is connected along any one of the pattern of conductive strips on the lower conductor grid; or (h)(ii) any one of the pattern of conductive strips on the lower conductor grid, if the first multiplexer is connected along any one of the conductive wiring paths of the upper conductor grid; (j) a resistor coupled to the output of said analog multiplexer circuit, for creating a sufficient current draw to allow determining the extent of electrical conduction when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make electrical contact with said pattern of conductive strips in the lower conductor grid; (k) an analog-to-digital converter (ADC) configured for measuring the voltage received through the path from the upper conductor grid to the lower conductor grid; (l) a processor coupled to said first multiplexer, said analog multiplexer and to said ADC; (m) a non-transitory memory storing instructions executable by the processor for determining structure compression measurements of said flexible product retention structure; and (n) wherein said instructions, when executed by the processor, perform one or more steps comprising: (n)(i) initializing a measurement pass; (n)(ii) incrementing the selection of a signal path through said first multiplexer; (n)(iii) generating a voltage pulse along said signal path; (n)(iv) iterating through selecting different signal paths from said analog multiplexer and collecting voltage measurements from the ADC; (n)(v) returning back to step (n)(ii) and looping until all signal paths through said first multiplexer have been measured; (n)(vi) converting voltage measurements to applied force for each region in which said upper and lower conductor grids can enter into electrical contact in response to deformation of the flexible product retention structure; (n)(vii) generating signals indicating applied force levels to external systems which are tracking product placement changes on the apparatus; and (n)(viii) repeating the measurements passes in a periodic manner. [0060]A store shelf lining apparatus for sensing events of product placement, and product removal, comprising: (a) a base material having a pattern of conductive strips, as a lower conductor grid, oriented in a first direction; (b) a flexible product retention structure coupled to said base material, and extending away from said base material to provide a contoured surface configured for retaining a plurality of products; (c) wherein said flexible product retention structure has a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by any, or all, of the plurality of products exceeds the compression threshold, and said flexible product retention structure has a negative Poisson's ratio which determines its reversible deformation when the load is removed; (d) a pattern of conductive wiring paths coupled along non-linear paths, as an upper conductor grid directed in a second orientation, upon portions of the flexible product retention structure, with conductive wiring on the underside of portions of the flexible product retention structure which are configured to make contact with the pattern of conductive strips under deformation in which the compression threshold is reached; (e) wherein said first orientation of said lower conductive strips is orthogonal to that of said second orientation; (f) a signal source for generating electrical current pulses; (g) a first multiplexer circuit configured for directing a pulse either: (g)(i) along any one of the pattern of conductive strips on the lower conductor grid, or (g)(ii) along any one of the conductive wiring paths of the upper conductor grid; (h) an analog multiplexer circuit having analog inputs connecting to either: (h)(i) any one of the conductive wiring paths of the upper conductor grid, if the first multiplexer circuit is connected along any one of the pattern of conductive strips on the lower conductor grid; or (h)(ii) any one of the pattern of conductive strips on the lower conductor grid, if the first multiplexer is connected along any one of the conductive wiring paths of the upper conductor grid; (j) a resistor coupled to the output of said analog multiplexer circuit, for creating a sufficient current draw to allow determining the extent of electrical conduction when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make electrical contact with said pattern of conductive strips in the lower conductor grid; (k) an analog-to-digital converter (ADC) configured for measuring the voltage received through the path from the upper conductor grid to the lower conductor grid; (l) a processor coupled to said first multiplexer, said analog multiplexer and to said ADC; (m) a non-transitory memory storing instructions executable by the processor for determining structure compression measurements of said flexible product retention structure; and (n) wherein said instructions, when executed by the processor, perform one or more steps comprising: (n)(i) initializing a measurement pass; (n)(ii) incrementing the selection of a signal path through said first multiplexer; (n)(iii) generating a voltage pulse along said signal path; (n)(iv) iterating through selecting different signal paths from said analog multiplexer and collecting voltage measurements from the ADC; (n)(v) returning back to step (n)(ii) and looping until all signal paths through said first multiplexer have been measured; (n)(vi) converting voltage measurements to applied force for each region in which said upper and lower conductor grids can enter into electrical contact in response to deformation of the flexible product retention structure; (n)(vii) generating signals indicating applied force levels to external systems which are tracking product placement changes on the apparatus; (n)(viii) repeating the measurement passes in a periodic manner; (o) wherein when said compression threshold of said flexible product retention structure is reached causing the wiring of said upper conductor grid to make an initial electrical contact with said pattern of conductive strips in the lower conductor grid, then as the structure under load increases, there is an increasing contact surface between the upper and lower conductors, which can be detected by measuring voltage at the ADC. [0061]A method for sensing product placement and removal events with a store shelf lining, comprising: (a) configuring a lower section of a flexible shelf liner with conductive strips, as a lower conductor grid, oriented in a first direction; (b) configuring a flexible product retention structure, having structural peaks and valleys, coupled over said lower section of the flexible shelf liner, thereby providing a contoured surface for retaining a plurality of products; (c) configuring the flexible product retention structure to have a quasi-static compression behavior which determines its load bearing ability and leads to deformation of parts of the structure toward the lower conductive grid when the load applied by
返回