You can collect product prices and availability responsibly only after checking the particular retailer’s current terms and the crawler instructions that apply to your collection. Then record each observation with its date, product identity, displayed offer, and a distinct availability or error state. Use a GTIN only when the exact identifier is published and verifiable; never infer one from a similar product.
Check the retailer’s rules before collecting data
Review the specific retailer’s current terms and its robots.txt before building a collector or starting a run. The UNECE price-index working group recommends checking both to assess whether a website is eligible and what information may be collected. Record when you checked, the relevant terms language, the applicable crawler directives, the site section and fields you plan to access, and any conditions such as login or region. UNECE price-index working group guidance
Terms can differ substantially between stores. For example, Target’s published Terms & Conditions restrict certain automated extraction and commercial use of product listings and prices. That example describes Target’s terms, not a rule for every retailer. Check the actual source you intend to use, and revisit the terms if your collection scope or use changes.
This source-by-source check does not establish a universal legal answer. Whether a particular collection is permitted can depend on the retailer’s terms, the collection details, geography, and intended use. The sources cited here provide operational guidance, not a determination of the law for every situation.
#1 Best Overall
- Larger battery enables longer continuous usage and twice the stand-by time. With the unique battery indicator light showing the remaining battery level, no more Low Battery Anxiety.
- The curved handle is extended and widened. With specially designed smooth and flat trigger for a better grip.
- The orange anti shock silicone protective cover can prevent scratches and friction even when dropped from up to 6.56 feet. IP54 technology protects the wireless barcode scanner from dust.
- Plug and play with the USB receiver or the USB cable, no driver installation needed. Easy and quick to set up. Wireless transmission distance reaches up to 328 ft. in barrier free environment.
- Supports almost all 1D Barcodes: Febraban Bank Code, Codabar, Code 11, Code93, MSI, Code 128, EAN-128, Code 39, EAN-8, EAN-13, UPC-A, ISBN, Industrial 25, Interleaved 25, Standard 25, Matrix. Reads damaged, fuzzy, reflective and smudged barcodes.
Use robots.txt as a crawler signal, not as permission
robots.txt communicates crawling instructions; it is not a complete legal permission check and does not keep a blocked URL out of search results. Google explains both points in its robots.txt guide. Read the directives relevant to your identified user agent, but do not treat an allowed path as authorization to collect or reuse its contents.
Crawler behavior is specific to the crawler. Amazon’s documentation, for example, says AmazonProductDiscoverybot respects user-agent and disallow directives but does not support crawl-delay, nofollow, or noindex. Those details concern that Amazon crawler and may change; they do not define how another crawler should behave. Amazon Product Bot documentation
Rank #2
- Plug and play, This laser handheld barcode scanner has simple installation with any USB port and Ideal for businesses, shops and warehouse operations. Its function is unbeatable and easy to use, design is stylish
- Compatible with Windows, Mac, and Linux; works with Word, Excel, Novell, and all common software
- Scanning Speed: 200 scans per second. Scanning angle: Inclination angle 55°, Elevation angle 65°. Operational Light Source:Visible Laser 650-670nm.
- Decode Capability: Code11, Code39, Code93, Code32, Code128, Coda Bar, UPC-A, UPC-E, EAN-8, EAN-13, ISBN/ISSN, JAN.EAN/UPC Add-on2/5 MSI/Plessey, Telepen and China Postal Code,Interleaved 2 of 5, Industrial 2 of 5, Matrix 2 of 5, etc ; 300 configurable options for prefix, suffix and termination strings, support turn on/off the beep.
- Color: Black. Dimensions: 3.6 x 2.6 x 6.1 inches. Type of Cable: 2M or 6ft straight cable. Shock: 1.5m drop on concrete surface. Regulatory Approvals: FCC CE.
Record each observation so it can be interpreted later
A price is only useful for comparison when an analyst can tell what was observed, where, and when. UNECE describes fields such as date, retailer, website category, item name, price, and item count. Eurostat’s HICP guidance also identifies a unique item URL or code, product type, name, description, and offer price as useful parameters. Eurostat practical guidelines on web scraping for the HICP
| Record field | What to store |
|---|---|
| Observation time | Timestamp and timezone for the page observation, plus a run or collection identifier that helps trace updates and errors. |
| Source and item reference | Retailer, page URL or retailer item code, and the website category or product type. |
| Product description | Name, description, brand, and available variant attributes, such as size, color, or package quantity. |
| Offer | Displayed offer price and currency as shown on the page. Keep this as an observation, not a promise of the eventual checkout price. |
| Availability and collection outcome | Availability state as observed, with separate values for unknown or request failure. Do not encode an unavailable item or interrupted request as a zero price. |
| GTIN, if present | The exact published value and where it appeared. Leave it unfilled when no assigned value is available or the value cannot be verified. |
Eurostat specifically calls for treating non-availability and server problems. Keeping timestamped availability separate from technical failure is a practical way to avoid confusing an unavailable item with a failed request. An observed offer can change after collection, so retain the observation time rather than presenting it as a guaranteed current or checkout price.
What’s actually slowing this PC down?
Pick the symptom - the matching free tool is one click away.
Rank #3
- Continuous Usage All Day: The EY-H2 USB barcode scanner is designed to always be ready for the next scan, which significantly reduces downtime and repair costs; it shortens checkout lines, improves customer service, and boosts business productivity
- Plug and Play: Eyoyo wired barcode scanner is connected via a USB cable, with no need to install any driver or software; It offers effortless connection and is compatible with Windows, Mac, Android, and Linux; Seamlessly works with Quickbook, Word, Excel, Novell, and all common software
- Supports Multiple 1D/2D Barcodes: Eyoyo QR code scanner scan with most 1D 2D barcodes with ease; 1D Barcodes: EAN, UPC, Code 39, Code 93, Code 128, UCC/EAN 128, Codabar, Interleaved 2 of 5, ITF-6, ITF-14, ISBN, ISSN, MSI-Plessey, GS1 Databar, Code 11, Industrial 25, Matrix 2 of 5, etc. 2D Barcodes: QR, DataMatrix, PDF417, and so on
- Supports Screen Scanning: The Eyoyo 2D scanner is capable of reading barcodes from smartphone screens, such as mobile coupons, digital wallets, and digital loyalty cards; Before scanning, simply turn your screen brightness to the maximum
- Sturdy Anti-Shock and Durable Design: The Eyoyo 2D barcode scanner features an ergonomic design made of high-quality ABS, enabling it to withstand repeated drops from 5 ft/1.5 m high onto the concrete ground; The durable plastic material ensures a long service life
Resolve the exact product and variant before comparing prices
Product titles can be abbreviated, changed, or shared by more than one item. Match the exact product and variant before joining observations into a price history. Prefer a GTIN when the page provides an exact, verifiable value; otherwise use the retailer’s stable item code and preserve the attributes that distinguish the variant. Eurostat recommends a unique, stable identifier over time and notes that a GTIN or another shop item code can serve that purpose.
Google describes GTIN, manufacturer part number (MPN), and brand as common product identifiers. It says identifiers are assigned by manufacturers; UPC is GTIN-12, while EAN is typically GTIN-13. Google’s guidance is specific to its product data requirements, but the key data-integrity principle applies here: do not substitute an internal store code or a similar product’s identifier for a verified GTIN. As Google Merchant Center Help puts it, “Don’t make up, guess, or include values from similar products.” About unique product identifiers
Rank #4
- Widely Compatible: Bluetooth Barcode Scanner for iPhone iPad Android Tablet PC, Support HID / SPP / BLE mode via bluetooth, Work with Windows XP/7/8/10, Mac OS, Windows Mobile, Android OS, iOS, Linux.
- Strong Recognition Ability: With the 2500 pixels high-resolution CCD sensor Engine, Rapidly decodes all 1D and stacked barcodes (including ISBN book), even worn, damaged or tightly spaced codes. Scan 1D codes directly from paper or screen, such as a computer monitor, smartphone, or tablet, or scan through glass surfaces, plastic shrink wrap, a CCD scanner is likely the best way to go.
- Automatic Scanning: NT-1228bc barcode scanner have three scanning modes: manual trigger mode, continuous scanning mode and auto-sensing scanning mode. In addition, there is a storage mode. Storage mode can be used when you are out of range of Bluetooth and wireless connectivity. Supports storage of up to 100,000 barcodes. Note: Before use, you need to scan the corresponding setting barcode on the manual.
- 2600mAh Battery Upgraded: Continuous scanning up to 200,000 times on a full charge. After a full charge the scanner can be used for one month at least, even in warehouses and at pos checkout counters where scanners are frequently used. In libraries and hospitals it can be used even longer.
- Programmable Configuration: Add custom prefixes/ suffixes, delete characters, Add keyboard keys/ combinations (terminator TAB, CR&LF, Home etc.), Enable or disable the barcode type as you want. Buzzer can be set to mute to allow for a quiet operation.(Note: It does not work with square POS / Divalto / DoorDash / Lightspeed POS system)
Google Search Central also discusses providing accurate product information and identifiers for shoppers. Google’s product information guidance If a product has no assigned GTIN, or you cannot verify the value shown, preserve that limitation instead of filling the field with a guess.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Validate each collection run
Check the collected records before using them in a comparison or analysis. Eurostat recommends monitoring validity and usefulness, preparing for non-availability and server problems, and checking for duplicates, suspicious values, and outliers.
Crashes, No Sound, or Screen Glitches?
Random freezes, missing sound and display glitches usually trace back to one bad driver. Find and replace yours safely.Free scan · under a minutePC Slower Than It Used to Be?
A free scan shows the junk files, broken settings and background clutter dragging Windows down - then fixes them in one click.Free scan · Windows 10 & 11Best Value
- CCD Image Scanning Technology - NetumScan 1D barcode reader is equiped with advanced CCD sensor, which can quick capture 1D codes from paper and screen, including CODE128, UPC/EAN Add on 2 or 5, that can read even deformed barcodes, i.e. smudged, damaged, fuzzy, reflective barcodes, etc. Reading faster and more accurate than laser scanner.
- Sturdy Anti-shock and Durable Design - Ergonomic design with high-quality ABS making it can support withstand repeated drops from 2m high to the concrete ground, durable to use. Durable plastic material guarantees long service life.
- Three scanning mode - Key trigger mode + Auto-induction mode + Continuous Mode. There is no need to pull the trigger in auto-sensing mode and continuous scanning. Sometimes the self-sensing scanning function is in the inactive stage, please contact us and be at your service at any time.
- Supported 1D Bar Code - 1D Decode Capability: UPC-A, UPC-E, EAN-8, EAN-13, ISSN, ISBN, Code 128, GS1-128, Code39, Code93,Code32, Code11, UCC/EAN128, Interleaved 2 of 5, Industrial 2 of 5, Codabar(NW-7), MSI, Plessey, RSS, China Post, etc.
- Widely Use Range - This NetumScan Handheld USB barcode scanner can be used in supermarkets, convenience stores, warehouse, library, bookstore, drugstore, retail shop for file management, inventory tracking and POS(point of sale), etc.
- Look for missing or newly appearing products and sudden changes in the number of records.
- Check whether one identifier is attached to different products or variants, and whether the same item appears under duplicate identifiers.
- Review zero, unusually low, or otherwise suspicious prices and investigate outliers rather than silently deleting or accepting them.
- Separate request interruptions and unknown states from confirmed availability observations.
- Watch for changes to the site that could alter item pages, fields, or collection behavior.
When comparing sources or collection approaches, use the same criteria for each: permitted scope under the source’s terms, product and field coverage, observation freshness, identity accuracy, handling of availability and errors, and validation or change detection. A source with frequent observations is not necessarily more useful if its product matches or failure states are unreliable.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
