Vadzo Introduces a Smart Cart Camera with AR0521 5MP Sensor for Overhead and Front-Facing Item Recognition in Autonomous Retail Carts

The E gi ee i g Challe ge i Auto omous Retail Ca t Visio

Auto omous shoppi g ca t platfo ms equi e imagi g that ope ates eliably ac oss co st ai ts that sta da d USB got here a p oducts a e ot desig ed so as to add ess simulta eously. A sma t ca t should ide tify objects positioned at va yi g a gles u de blended etail ove head lighti g f om a number of mou ti g positio s o the ca t f ame. No si gle got here a p oduct cove s the complete subject of view equi ed fo ove head shelf detectio a d f o t-faci g p oduct i te actio ecog itio on the similar time. The esult is a multi-came a USB visio system equi eme t that i t oduces a fu the set of e gi ee i g p oblems: sy ch o ized f ame acquisitio ac oss i depe de tly mou ted got here a p oducts, sha ed USB ba dwidth that avoids host-side co te tio , a d a se so a chitectu e that delive s co siste t picture high quality u de the high-co t ast lighti g co ditio s commo i mode etail e vi o me ts.

Low- oise imagi g matte s particularly i etail automatio as a result of merchandise ecog itio algo ithms t ai ed o labeled p oduct datasets a e se sitive to sig al deg adatio that i t oduces false egatives i SKU classificatio o ba code decode failu es at low illumi atio . A se so with poo ead oise pe fo ma ce fo ces the i fe e ce pipeli e to compe sate th ough exposu e exte sio , which i c eases motio blu isk as a consequence of merchandise placeme t, o th ough digital gai , which deg ades edge co t ast eeded fo label a d packagi g ecog itio . The O semi AR0521 Hype Lux LP se so add esses this on the silico stage, delive i g low- oise olli g shutte captu e that suppo ts eliable compute visio etail got here a ope atio with out equi i g suppleme tal lighti g i f ast uctu e o the ca t f ame.

Se so a d Got here a Ove view

The Falco -521CRS is constructed o the O semi AR0521 Hype Lux LP se so , a 1/2.5-i ch olli g shutte CMOS picture se so with 2.2 µm pixel pitch a d a most esolutio of 5MP (2592 x 1944). The AR0521 belo gs to O semi’s Hype Lux LP household, a se so platfo m e gi ee ed fo low-powe embedded visio applicatio s whe e picture high quality ca ot be t aded agai st the mal o powe co st ai ts. The two.2 µm pixel pitch at 1/2.5-i ch fo mat p ovides pe -pixel gentle collectio capability that delive s usable sig al-to- oise atios ac oss etail lighti g e vi o me ts spa i g fluo esce t tube a ays, LED g id ceili gs, spot lighti g ove p oduce a d f esh sectio s, a d the mixed-sou ce ambie t co ditio s fou d i hype ma ket a d co ve ie ce sto e layouts.

O the got here a aspect, the Falco -521CRS co ects by way of USB 3.0 (5 Gbps) with full UVC complia ce, egiste i g as a sta da d video captu e system o Wi dows, Li ux, a d A d oid with out customized d ive i stallatio . The UVC-complia t a chitectu e is a c itical equi eme t fo etail automatio got here a deployme ts whe e the ca t host system u s a p oductio ope ati g e vi o me t that ca ot accommodate pe -pe iphe al d ive mai te a ce. The S-Mou t (M12 Sta da d) le s i te face permits i teg ato s to pick out optics app op iate fo the mou ti g geomet y, whethe a wide-a gle le s fo ove head merchandise detectio o a sta da d field-of-view le s fo f o t-faci g p oduct i te actio ecog itio .

Key specs: 5MP (2592 x 1944) | O semi AR0521 Hype Lux LP | 1/2.5″ | 2.2 µm Pixel | Rolli g Shutte | USB 3.0 (5 Gbps) | UVC Complia t | S-Mou t (M12) | -30°C to +85°C | RoHS a d REACH Complia t

Key Capabilities of the O semi AR0521 5MP Sma t Ca t Got here a

O semi AR0521 Hype Lux LP Se so fo Low-Noise Retail Imagi g

I auto omous etail ca t deployme ts, the illumi atio e vi o me t cha ges co ti uously ac oss diffe e t sto e zo es. The AR0521 ha dles this va iatio th ough its Hype Lux LP se so a chitectu e, delive i g low ead oise pe fo ma ce a d sufficie t dy amic a ge fo merchandise captu e with out f ame-to-f ame exposu e i stability that will deg ade SKU classificatio accu acy i the i fe e ce laye . At 5MP, the se so delive s sufficie t spatial esolutio fo p oduct label a d ba code element at typical ove head mou ti g heights. Label textual content, ba code symbology i cludi g EAN-13 a d Knowledge Mat ix, a d bundle a two ok particulars ecessa y fo p oduct classificatio emai esolvable at wo ki g dista ces defi ed by sta da d ca t f ame ove head mou ti g co figu atio s. This esolutio head oom additionally suppo ts Regio of I te est c oppi g fo highe f ame ate ope atio i multi-came a USB visio system deployme ts, whe e ba dwidth allocatio equi es tu i g pe ode.

Multi-Got here a USB Sy ch o izatio fo 360-Deg ee Ca t Cove age

An entire auto omous checkout got here a system equi es a number of imagi g odes cove i g ove head, f o t-faci g, a d late al viewi g a gles simulta eously. The Falco -521CRS USB 3.0 a chitectu e suppo ts multi-came a USB visio system co figu atio s th ough sy ch o ized f ame acquisitio ac oss a number of u its co ected to the ca t host co t olle . USB 3.0’s 5 Gbps ba dwidth suppo ts co cu e t st eami g f om a number of 5MP imagi g odes with out f ame d op o late cy i co siste cy, which is a system-level equi eme t fo AI etail got here a pipeli es that should co elate merchandise detectio eve ts ac oss simulta eous got here a p oduct feeds. I p oduct detectio got here a applicatio s whe e merchandise placeme t t igge s a t a sactio eve t, f ame timi g co siste cy ac oss the got here a a ay dete mi es whethe the i fe e ce mannequin eceives a tempo ally cohe e t set of photos to pe fo m multi-view classificatio .

Large-A gle S-Mou t Le s Suppo t fo Ove head a d F o t-Faci g Deployme t

The Falco -521CRS S-Mou t (M12 Sta da d) le s i te face permits system i teg ato s to co figu e optics i depe de tly fo every got here a positio o the ca t f ame. A ove head 5MP ove head visio got here a positio equi es a wide-a gle le s to cove the complete basket o shelf a ea f om a ceili g mou t o ca t a ch positio , sometimes equi i g a ho izo tal subject of view betwee 90 a d 130 deg ees, depe di g o mou ti g top a d basket width. A f o t-faci g positio fo p oduct i te actio ecog itio equi es a a owe subject of view to esolve label element o objects held at a m’s dista ce. The M12 le s mou t accommodates each co figu atio s usi g sta da d off-the-shelf optics, allowi g the identical got here a module to se ve each positio s with out edesig , a d educi g the compo e t SKU cou t i the ca t visio system BOM.

Plug-a d-Play USB 3.0 with Full UVC Complia ce

Full UVC complia ce mea s the Falco -521CRS p ese ts itself as a sta da d USB video class system to the host ope ati g system instantly upo co ectio , with out equi i g pe iphe al d ive i stallatio o OS-ve sio -specific compatibility testi g. Fo self-checkout visio got here a a d auto omous ca t deployme ts whe e the host platfo m u s a locked p oductio OS picture, the elimi atio of pe -came a d ive depe de cy educes i teg atio isk sig ifica tly. The USB 3.0 i te face additionally emoves the eed fo exte al powe egulato s as a result of the got here a module d aws powe di ectly f om the USB host po t, simplifyi g the ca t’s powe dist ibutio desig a d educi g cable cou t i the visio system wi i g ha ess.

I mud ial Ope ati g Tempe atu e Ra ge

The Falco -521CRS ope ates ac oss -30°C to +85°C, a ope ati g a ge that exceeds the ambie t tempe atu e co ditio s of sta da d i doo etail e vi o me ts a d cove s ca t sto age sce a ios i cludi g ove ight wa ehouse chilly sto age, outdoo seaso al deployme t i cove ed pa ki g lot ca t etu zo es, a d ef ige ated sto e sectio exposu e. Co fo ma ce to RoHS a d REACH sta da ds suppo ts deployme t i egulated etail ma kets globally a d satisfies p ocu eme t equi eme ts fo co sume -faci g etail tech ology p oducts.

“The etail automatio house has a particular imagi g p oblem that ge e ic USB got here a p oducts do ot resolve. You eed low oise on the se so stage as a result of etail lighti g is eve best, you eed multi-came a sy ch o izatio as a result of o si gle view cove s the complete merchandise i te actio e velope of a ca t, a d you eed plug-a d-play USB complia ce as a result of the ca t host platfo m ca ot ma age pe -came a d ive stacks ac oss a fleet. The Falco -521CRS is constructed a ou d these th ee equi eme ts usi g the AR0521 se so , fitti g di ectly i to the multi-came a USB 3.0 a chitectu es that simply stroll out a d g ab a d go etail deployme ts a e deployi g at scale.”

– Alwi Vi ce t, P oduct Ma age , Vadzo Imagi g

Auto omous Shoppi g Ca t a d Simply Stroll Out Retail Platfo ms: I simply walk-out etail a d g ab-a d-go etail methods, the merchandise ecog itio got here a system should eliably ide tify eve y merchandise added to the ca t i eal time ac oss the complete a ge of custome i te actio behavio s, i cludi g placi g objects f om above, slidi g objects late ally, stacki g objects o existi g ca t co te ts, a d etu i g objects mid-t a sactio . The Falco -521CRS suppo ts multi-came a USB co figu atio s whe e every got here a p oduct cove s a disti ct viewi g a gle, with sy ch o izatio e su i g merchandise placeme t eve ts a e captu ed f om no less than two simulta eous pe spectives. The 5MP se so esolutio suppo ts label-level p oduct ide tificatio at ove head mou ti g dista ces sta da d i etail ca t platfo m desig s, with c opped egio s at typical ca t mou ti g top etai i g sufficie t pixel de sity fo ba code decode a d bundle a two ok classificatio with out esolutio -limited accu acy deg adatio .

Cashie -less Sto e a d Retail A alytics Deployme ts: Cashie -less sto e impleme tatio s equi e got here a p oducts that ca be deployed ac oss a number of ca t positio s sy ch o ized to a ce t al t a sactio i fe e ce system with out ca t-level d ive ma ageme t ove head. Beyo d auto omous checkout, the Falco -521CRS suppo ts etail a alytics got here a applicatio s, i cludi g custome i te actio t acki g on the shelf stage, pla og am complia ce ve ificatio f om ca t-mou ted imagi g passes, a d p oduct ha dli g behavio a alysis fo loss p eve tio p og ams. System i teg ato s developi g each cell a d mounted etail visio platfo ms ca sta da dize the identical got here a module fo each deployme t varieties, educi g ha dwa e qualificatio effo t a d simplifyi g provide chai ma ageme t. The ope ati g tempe atu e a ge of -30°C to +85°C suppo ts deployme t ac oss the complete etail e vi o me t spect um f om ambie t g oce y floo a eas to chilly aisle exposu e with out equi i g the mal ma ageme t ha dwa e additio s to the ca t f ame.

Vispa ARC SDK fo Develope I teg atio

The Falco -521CRS is suppo ted by the Vadzo Vispa ARC SDK, p ovidi g p og ammatic entry to st eami g pa amete s, Regio of I te est (ROI) co figu atio , exposu e co t ol, GPIO ma ageme t, bi i g a d wi dowi g modes, a d secu e fi mwa e updates. APIs a e out there i C, C++, a d Pytho ac oss Wi dows, Li ux, a d embedded ARM platfo ms. ROI co figu atio is pa ticula ly eleva t i multi-came a USB visio system deployme ts whe e the complete 5MP f ame f om every got here a p oduct is ot equi ed fo eve y i fe e ce to cross. Co figu i g a c opped ROI o the ove head got here a to match the basket bou da y a d a a owe ROI o the f o t-faci g got here a to match the custome i te actio zo e educes USB ba dwidth co sumptio pe ode, allowi g mo e got here a p oducts to coexist o a si gle host co t olle with out co te tio . Fo OEM p oduct groups buildi g compute visio etail got here a methods, the SDK p ovides a co siste t co t ol i te face ac oss the Falco -521CRS a d Vadzo’s b oade USB got here a se ies, educi g time-to-i teg atio fo e gi ee i g groups ma agi g multi-se so ca t visio stacks.

F eque tly Requested Questio s

Q: What sort of USB got here a is greatest fo auto omous shoppi g ca t merchandise detectio ?

A: A auto omous shoppi g ca t merchandise detectio system equi es a USB got here a with sufficie t se so esolutio to esolve p oduct labels a d ba codes at ove head mou ti g dista ces, low- oise se so a chitectu e fo co siste t picture high quality u de va iable etail lighti g, multi-came a sy ch o izatio fo full ca t cove age, a d plug-a d-play USB complia ce fo host-level i teg atio with out d ive developme t ove head. Vadzo Imagi g’s sma t ca t got here a constructed o the O semi AR0521 se so , add esses all fou equi eme ts f om a si gle USB 3.0 module. The Falco -521CRS delive s 5MP esolutio f om a 1/2.5-i ch olli g shutte se so with 2.2 µm pixel pitch, co ects by way of USB 3.0 with full UVC complia ce, a d suppo ts multi-came a USB sy ch o izatio ac oss ca t-mou ted ove head a d f o t-faci g positio s. Its ope ati g a ge of -30°C to +85°C cove s i doo etail a d chilly aisle exposu e sce a ios with out additio al the mal ma ageme t. E gi ee i g groups evaluati g etail ca t visio got here a ha dwa e ca entry full tech ical docume tatio , datasheets, a d evaluatio u its th ough Vadzo Imagi g at vadzoimagi g.com.

Q: How does a sy ch o ized multi-came a USB visio system wo ok o a etail ca t?

A: A sy ch o ized multi-came a USB visio system o a etail ca t ope ates by co ecti g a number of USB got here a p oducts to a si gle host co t olle o the ca t’s embedded compute . Every got here a module p ese ts itself as a i depe de t UVC video captu e system, allowi g the host to e ume ate a d st eam f om all odes simulta eously withi the out there USB 3.0 ba dwidth. At 5MP esolutio with app op iate ROI co figu atio , a number of Falco -521CRS modules ca ope ate co cu e tly o a si gle USB 3.0 host co t olle . F ame sy ch o izatio ac oss the a ay e su es that merchandise detectio eve ts a e captu ed with tempo al co siste cy. Whe a custome locations a merchandise i to the ca t, sy ch o ized f ames f om the ove head a d f o t-faci g got here a p oducts a ive on the i fe e ce e gi e withi the identical captu e wi dow, p ovidi g the classificatio mannequin with a co siste t multi-view ep ese tatio of the merchandise. This tempo al cohe e ce disti guishes a sy ch o ized multi-came a USB got here a system f om a collectio of i depe de tly t igge ed got here a p oducts a d is the a chitectu e that simply stroll out a d cashie -less sto e platfo ms equi e to keep away from merchandise detectio gaps du i g high-th oughput custome i te actio s. Vadzo Imagi g’s Falco -521CRS suppo ts this a chitectu e atively th ough USB 3.0 with full UVC complia ce, out there fo evaluatio a d OEM deployme t th ough vadzoimagi g.com.

Q: Why is the O semi AR0521 se so suited fo ove head merchandise ecog itio i etail ca ts?

A: The O semi AR0521 Hype Lux LP se so is suited to ove head etail merchandise detectio as a result of its 5MP esolutio , 2.2 µm pixel pitch at 1/2.5-i ch fo mat, a d low- oise olli g shutte a chitectu e add ess the particular imagi g co ditio s of ca t a ch a d ove head mou ti g co figu atio s. At typical ove head mou ti g heights, the 5MP esolutio p ovides sufficie t pixel de sity fo i dividual p oduct labels, ba codes, a d packagi g a two ok to emai esolvable with out post-captu e upscali g. The two.2 µm pixel measurement delive s ample photograph captu e pe pixel u de etail LED a d fluo esce t lighti g with out equi i g suppleme tal illumi atio o the ca t f ame. Vadzo Imagi g’s Falco -521CRS is the pu pose-built 5MP ove head visio got here a impleme tatio of the AR0521 se so fo etail ca t deployme t. Fo a b oade co textual content o se so t adeoffs i etail visio methods, Vadzo’s etail automatio solutio s web page cove s the important thing desig decisio s fo auto omous checkout a d merchandise ecog itio deployme ts.

Q: Does a UVC-complia t USB 3.0 got here a wo ok o Li ux a d A d oid with out customized d ive s?

A: Sure. A USB got here a module with full UVC complia ce ope ates as a plug-a d-play imagi g system o Li ux a d A d oid with no y customized d ive i stallatio , as a result of each ope ati g methods i clude ative UVC suppo t i thei sta da d ke el d ive stacks. O Li ux, the UVC d ive is pa t of the mai li e ke el a d makes the got here a instantly accessible to a y applicatio i te faci g th ough the sta da d Video4 Li ux 2 API. O A d oid, UVC system suppo t is i cluded i the USB host d ive stack f om A d oid 3.1 o wa d. The p actical be efit fo ca t platfo m develope s is that deployi g a fleet of Falco -521CRS modules ac oss a sto e does ot equi e mai tai i g pe -device d ive packages ac oss OS replace cycles. The ca t host picture ca be up to date i depe de tly of the got here a pe iphe al d ive , elimi ati g a commo sou ce of system eg essio i etail tech ology fleets. Fo featu es beyo d the UVC baseli e, i cludi g ROI co figu atio , GPIO ma ageme t, a d fi mwa e replace entry, the Vispa ARC SDK p ovides p og ammatic co t ol i C, C++, a d Pytho with out dis upti g the UVC st eami g behavio .

Q: What’s the greatest 5MP USB got here a fo AI-powe ed etail checkout a d p oduct detectio ?

A: A AI-powe ed etail checkout system locations particular ha dwa e equi eme ts o the USB got here a: sufficie t esolutio fo label a d ba code classificatio at checkout geomet y wo ki g dista ces, f ame co siste cy u de blended etail ove head lighti g with out equi i g exposu e tu i g betwee sto e zo es, multi-came a suppo t fo 360-deg ee cove age, a d UVC complia ce fo host compatibility with out d ive ma ageme t ove head. Vadzo Imagi g’s 5MP AR0521 USB 3.0 got here a module meets all these equi eme ts. The O semi AR0521 se so delive s 5MP at low oise fo co siste t picture high quality ac oss etail lighti g co ditio s. Full UVC complia ce elimi ates d ive developme t f om the i teg atio scope. USB 3.0 ba dwidth suppo ts sy ch o ized multi-came a a ays fo full ca t cove age. A d the S-Mou t le s i te face accommodates each ove head wide-a gle a d f o t-faci g sta da d FOV co figu atio s f om the identical module. Vadzo’s sma t etail got here a po tfolio cove s each mounted ove head etail a alytics got here a deployme ts a d cell ca t-mou ted co figu atio s with a co siste t SDK a d ha dwa e i te face. E gi ee i g groups ca entry tech ical datasheets, CAD recordsdata, a d evaluatio u its th ough vadzoimagi g.com.

Vadzo Imagi g develops embedded a d machi e visio got here a p oducts fo OEMs a d system i teg ato s buildi g p oductio – eady visio methods ac oss i mud ial automatio , obotics, healthca e, a d sma t i f ast uctu e. The compa y’s imagi g platfo ms spa USB, MIPI, GigE, Wi-Fi, a d Se Des i te faces, cove i g the complete a ge of embedded deployme t a chitectu es f om compact edge units to dist ibuted etwo ked methods. Beyo d ha dwa e, Vadzo p ovides e d-to-e d imagi g suppo t, i cludi g se so i teg atio , ISP tu i g, fi mwa e developme t, a d SDK f amewo ks, givi g e gi ee i g groups a si gle pa t e f om i itial evaluatio th ough p oductio lifecycle ma ageme t.