Do these 3 things before closing this tab:
1Repair Windows errors before they cause bigger problems2Scan for outdated or missing drivers - takes under a minute3Clear out junk files and repair common Windows errorsTo route a scraper through Tor, run a Tor client, configure your HTTP library or browser to use its SOCKS interface, and make sure hostnames are resolved through the proxy. Then verify the apparent exit address from the same application, keep request rates low, and continue using HTTPS to the destination. Tor only protects traffic from applications configured to use it; it does not make a scraper anonymous or suitable for high-volume crawling.
How Tor proxying works for a scraper
Your scraper connects to a local SOCKS listener provided by Tor. Tor carries the connection through its network toward the destination. For an ordinary website (a clearnet target), traffic then reaches the site from a public Tor exit relay. The site can see that exit address, and may block it or treat it as high risk.
Tor does not automatically capture traffic from your computer just because Tor is running. Tor Project guidance is explicit: “Tor only protects applications that are properly configured to send their Internet traffic through Tor.” Configure the scraper itself, and prevent it from silently falling back to a direct connection. Tor Browser security guidance
Use SOCKS, not an assumed HTTP proxy
Tor’s ordinary client interface supports SOCKS4, SOCKS4A and SOCKS5. SOCKS is not interchangeable with an HTTP proxy: setting an HTTP-proxy option to a Tor SOCKS address can fail or send traffic incorrectly. Use a client that explicitly supports SOCKS. The Tor SOCKS specification calls out this common mistake and documents hostname addressing. Tor’s extensions to the SOCKS protocol
Quick wins for a faster PC:
Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Clear out junk files and repair common Windows errorsFree Scan →Scan for outdated or missing drivers - takes under a minuteDriver Scan →#1 Best Overall
- Read Before You Buy — No Video Output: These adapters support charging and USB 2.0 data transfer, but cannot transmit video signals. Except for standard USB webcams (which use USB data only), they are not compatible with HDMI/DisplayPort cables, video-capable USB-C hubs, or docking stations with video output.
- Convert USB-A Ports to USB-C: Designed to connect USB-C earphones, cables, flash drives, card readers, and other USB-C accessories to standard USB-A ports. Plug-and-play with no drivers or software required.
- Aluminum Alloy Housing: Built with a sturdy aluminum alloy shell that aids in heat dissipation and protects against daily wear and scratches. Designed to maintain a stable and secure connection.
- Compact & Travel-Friendly: The ultra-compact design allows the adapter to stay plugged into your device without blocking adjacent ports or adding bulk, reducing wear and tear on your original USB ports.
- 12-Month Warranty: Backed by a 12-month manufacturer warranty for peace of mind. Designed to meet strict quality control standards for reliable everyday performance.
Keep DNS resolution inside the proxy path
A proxy configuration can still leak the target hostname if the application resolves it locally before connecting. Choose a SOCKS mode that sends the hostname for resolution through the proxy—often exposed by clients as socks5h—rather than a mode that resolves it locally. SOCKS5 supports hostnames, as does SOCKS4A. Confirm your library’s behavior instead of assuming that every SOCKS option handles DNS the same way.
HTTPS still matters
Tor’s protection within its network does not replace encryption between the exit relay and the website. Request HTTPS, verify the certificate normally, and do not disable TLS checks to make a scrape work. Tor Browser guidance also warns that perfect anonymity is impossible: logging in, submitting identifying information, or using software that bypasses the proxy can identify or expose you. Tor Browser security guidance
Set up a bounded, compliant scraping workflow
- Define a narrow scope. Use public pages only; do not bypass authentication or collect personal data without a legitimate basis. Check the site’s terms and robots directives, set a written request-rate and concurrency budget, and stop if the site asks you to stop automated access.
- Start Tor and identify its SOCKS listener. Confirm the local endpoint is reachable from the same machine or isolated environment where the scraper runs. Do not assume that starting Tor routes other applications through it.
- Configure the client for SOCKS with remote hostname resolution. Do not fill only an HTTP-proxy setting. Disable direct-network fallback so a broken proxy cannot quietly expose the connection.
- Test from the scraper process. Fetch an HTTPS endpoint you control or otherwise trust that reports the apparent IP. Check DNS behavior separately, and compare results before and after configuration. Repeat the check after changing the HTTP library, Tor setup, container, or deployment.
- Limit load and cache results. Use realistic timeouts, bounded retries with exponential backoff, a cache, and low parallelism. Tor is volunteer-operated; high concurrency can burden the network and the target. Tor’s onion-service DoS guidance recommends rate limiting and caching to reduce service load, controls that are also sensible for clearnet scraping through Tor. Tor Project onion service DoS guidelines
- Handle blocks as stop signals. On 403, 429, CAPTCHA, or an explicit opt-out, slow down or stop. Do not rotate circuits to evade access controls.
- Minimize and protect stored data. Keep only what the stated purpose needs. Protect logs from exposing full URLs, credentials, or personal information; Tor relay-operator expectations recommend SafeLogging remain enabled by default. Expectations for relay operators
Configure Python Requests to use Tor SOCKS5
Install Requests with SOCKS support in the same Python environment as your scraper:
Rank #2
- 5-in-1 USB-C Hub: Experience comprehensive connectivity featuring a Power Delivery input, two USB-A 2.0 ports, a USB-A 3.0 port, and an HDMI port. (Note: The USB-C power delivery input port is only for connecting an external wall charger to power your laptop and cannot power peripheral devices.)
- 90W Pass-Through Charging: Achieve optimal charging with 90W pass-through power to your laptop, supported by a total input of 100W, with the hub reserving 10W for operational efficiency. (Note: Wall charger not included.)
- Quick Data Transfers: Accelerate your productivity with rapid data transfers using a high-speed 5Gbps USB 3.0 port and two 480Mbps USB 2.0 ports.
- 4K HDMI Display: Enhance your visual experience with a hub capable of delivering 4K resolution at 30Hz in both mirror and extend modes. Please note that this hub is compatible with MacBook (macOS 12 and newer), Windows 10 and 11, ChromeOS, and laptops equipped with DP Alt Mode and Power Delivery. Note: This device is not compatible with Linux.
- What You Get: Anker USB-C Hub (5-in-1, 4K HDMI), welcome guide, 18-month warranty, and our friendly customer service.
python -m pip install "requests[socks]"Set TOR_SOCKS_URL to the SOCKS endpoint actually configured for your Tor client. The value below is an example local endpoint; change it to match your setup. The socks5h scheme requests hostname resolution through the proxy. Set TARGET_URL to a page you are authorized to fetch.
Free tools Windows power users keep installed
One-click scans. No signup required.
import os
import requests
proxy = os.environ["TOR_SOCKS_URL"] # e.g. socks5h://127.0.0.1:9050
target_url = os.environ["TARGET_URL"]
proxies = {"http": proxy, "https": proxy}
with requests.get(
target_url,
proxies=proxies,
timeout=(10, 45),
headers={"User-Agent": "ResearchScraper/1.0 (contact: you@example.org)"},
) as response:
response.raise_for_status()
print(response.status_code, response.url)
print(response.text[:1000])The connection and read timeouts bound how long this request can wait; they are not a license to retry indefinitely. Add a small retry budget with exponential backoff for transient failures, and honor Retry-After when present. Do not retry a CAPTCHA, explicit denial, or opt-out as though it were a transient network error. The user agent should identify your crawler and provide a real contact route rather than impersonating a browser.
Use curl with SOCKS hostname resolution
For a one-off test, curl’s --socks5-hostname option sends the hostname through the SOCKS proxy for resolution. Supply your actual SOCKS endpoint and an authorized HTTPS target:
Rank #3
- Sleek 7-in-1 USB-C Hub: Features an HDMI port, two USB-A 3.0 ports, and a USB-C data port, each providing 5Gbps transfer speeds. It also includes a USB-C PD input port for charging up to 100W and dual SD and TF card slots, all in a compact design.
- Flawless 4K@60Hz Video with HDMI: Delivers exceptional clarity and smoothness with its 4K@60Hz HDMI port, making it ideal for high-definition presentations and entertainment. (Note: Only the HDMI port supports video projection; the USB-C port is for data transfer only.)
- Double Up on Efficiency: The two USB-A 3.0 ports and a USB-C port support a fast 5Gbps data rate, significantly boosting your transfer speeds and improving productivity.
- Fast and Reliable 85W Charging: Offers high-capacity, speedy charging for laptops up to 85W, so you spend less time tethered to an outlet and more time being productive.
- What You Get: Anker USB-C Hub (7-in-1), welcome guide, 18-month warranty, and our friendly customer service.
curl --fail --show-error --max-time 45
--socks5-hostname 127.0.0.1:9050
-A "ResearchScraper/1.0 (contact: you@example.org)"
"$TARGET_URL"Replace the sample endpoint if your Tor client listens elsewhere, and set TARGET_URL in your shell before running the command. Do not remove hostname-proxying behavior merely to make local DNS resolution work: that can expose the hostname you meant to route through Tor.
Browser automation, HTTP clients, and isolation
Prefer a minimal HTTP client when it is enough
A plain HTTP client is lighter and usually easier to audit for proxy configuration and direct fallbacks. Browser automation may be necessary for pages that depend on JavaScript, but it introduces more components that can make network requests. Configure the browser’s proxy explicitly, test from within that browser process, and avoid unneeded extensions or plugins.
Recommended Free Tools
Be particularly careful with downloaded documents. Tor Project guidance warns that DOC and PDF files opened in external applications may fetch resources outside Tor and reveal the non-Tor IP. Prefer an in-browser viewer, a disconnected analysis machine, or a document-sanitization workflow such as Dangerzone. Tor Browser security guidance
Rank #4
- Dual Converters, Infinite Potential：Includes 2× USB C male to USB A female adapters and 2× USB A male to USB C female adapters. Perfect for a wide range of uses—tablets with Bluetooth keyboards, expand USB ports on macbook, and more. Two different converters for all your daily needs
- Next-Level 10Gbps & 3A Charging: No more slow 480Mbps, this usb to usb c adapter has a transfer speed of up to 10Gbps, allowing you to do more transferring in less time. This usb adapter fits both USB A and USB C charger, supporting up to 3A fast charging
- Upgraded Exquisite Craftsmanship: With an aluminum alloy housing and metal connector, the usbc to usb adapter is extremely durable and sturdy. Rigorously tested to withstand more than 10,000 times of plugging and unplugging, ensuring long-lasting performance
- Broad Compatible: The usb c to usb adapter widely supports all USB C/ USB A devices like laptops, tablets, cellphones, car chargers, and phone chargers. Such as compatible with MacBook Pro/Air 2023/2022, Thunderbolt 4/3 Devices,Apple MagSafe Watch 9/8/7/SE/Ultra, iPad Pro 2022/2021, Samsung Galaxy S23/S20/S10, and iPhone 17/16/15 Pro. Plug and play
- Please Note: To reach 10Gbps speed, keep the cable under 3.3 ft. For USB A Male to USB C adapters, try flipping the USB C connector. USB C Male to USB A adapters support bidirectional 10Gbps transfer within 3.3 ft
Single circuit versus stream isolation
A single circuit is simpler to configure. Stream isolation can reduce linkability between targets, but it adds complexity and must use documented Tor controls. Tor’s HTTP CONNECT specification also describes stream-isolation authentication tuples and host-header checks; do not build an ad-hoc forwarder around assumptions about those rules. Tor’s support for HTTP CONNECT
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.When Tor is—and is not—a fit
Tor is an open, privacy-oriented option for low-volume work when routing through Tor is appropriate and the target permits the activity. It is slower and less predictable than infrastructure designed for consistent capacity, and public exit addresses are recognizable and commonly blocked. There is no responsible universal speed or success-rate figure to promise: results depend on the route, target, and current network conditions.
For high-volume or aggressive crawling, Tor is a poor fit. If evaluating a commercial proxy instead, consider its capacity and support alongside the trust required in the provider and the payment relationship. Neither proxy choice authorizes bypassing a site’s access controls.
The Tool Desk
Outbyte PC Repair FREERepair Windows errors before they cause bigger problemsFix Now →Outbyte Driver Updater FREEScan for outdated or missing drivers - takes under a minuteDriver Scan →Best Value
- 5-in-1 Connectivity: Equipped with a 4K HDMI port, a 5 Gbps USB-C data port, two 5 Gbps USB-A ports, and a USB C 100W PD-IN port. Note: The USB C 100W PD-IN port supports only charging and does not support data transfer devices such as headphones or speakers.
- Powerful Pass-Through Charging: Supports up to 85W pass-through charging so you can power up your laptop while you use the hub. Note: Pass-through charging requires a charger (not included). Note: To achieve full power for iPad, we recommend using a 45W wall charger.
- Transfer Files in Seconds: Move files to and from your laptop at speeds of up to 5 Gbps via the USB-C and USB-A data ports. Note: The USB C 5Gbps Data port does not support video output.
- HD Display: Connect to the HDMI port to stream or mirror content to an external monitor in resolutions of up to 4K@30Hz. Note: The USB-C ports do not support video output.
- What You Get: Anker 332 USB-C Hub (5-in-1), welcome guide, our worry-free 18-month warranty, and friendly customer service.
An onion service is reachable only through Tor and avoids a clearnet exit relay for that onion connection, but it is available only if the publisher provides an onion address. Onion operators still need to consider operational security: server software, uptime patterns, and identifying configuration details can reveal information about the operator. Tor Project Support · Tor Project operational security guidance
Troubleshoot common failures
| Symptom | Likely cause | What to check or do |
|---|---|---|
| Connection refused at the proxy | Tor is not running, the listener is unreachable, or the configured endpoint is wrong. | Confirm the Tor process is running and that the scraper’s environment can reach the configured local SOCKS endpoint. |
| Proxy protocol or handshake error | The client is speaking HTTP proxy protocol to a SOCKS listener, or SOCKS support is missing. | Use a SOCKS-specific setting and install the library’s SOCKS extra where required. Do not treat the endpoint as an ordinary HTTP proxy. |
| DNS leak or unexpected name-resolution error | The client resolves locally, or local DNS behavior differs from the proxy mode expected. | Use a hostname-through-proxy mode such as socks5h where supported, and test DNS from the same application. |
| The target reports a Tor exit address, blocks the request, or presents a CAPTCHA | The request reached the site through Tor, but the site restricts or challenges Tor traffic. | Respect the response. Reduce load or stop; do not rotate circuits to evade the block. |
| Some browser traffic still exposes a direct connection | A browser component, plugin, external app, or fallback path did not use the configured proxy. | Remove unnecessary extensions, disable direct fallback, isolate the environment, and test every component that makes requests. |
| PDF or DOC activity appears outside the proxied browser | An external document viewer may fetch linked resources outside Tor. | Use an in-browser viewer, disconnected analysis machine, or sanitization workflow before opening downloaded documents. |
Relay-operator expectations identify version 2.2 and were updated 2026-08-25; they advise operators not to inspect or modify traffic or reveal destination information. Scraper operators should likewise avoid logging sensitive request details unnecessarily. Expectations for relay operators
Or skip the browser setup
If your goal is a screenshot rather than routing your own scraper through Tor, ScreenshotNeo is a separate website screenshot API and MCP server—not a Tor proxy and not a substitute for a scraper that needs Tor routing. One GET request returns an image or PDF. For example, save a screenshot of Stripe as WebP:
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webpSee the ScreenshotNeo API documentation for setup and options. Before capture, it accepts cookie or consent banners like a visitor and removes more than 60 known consent platforms, newsletter popups, and chat widgets; each step can be turned off. Bot checks, blank pages, timeouts, failed loads, and cache hits are not billed, with response headers indicating the page verdict and billing status. Its MCP server offers take_screenshot, get_page_info, and capture_pdf for Claude, Cursor, and other MCP clients. The Free plan includes 1,000 screenshots a month with no card; paid plans start at $5 for 3,000.
Sign up for ScreenshotNeo’s free plan to try 1,000 screenshots a month with no card.
Frequently Asked Questions
Does Tor guarantee a new exit IP for every request?
No such per-request guarantee is established here. Exit addresses can change, but do not build a scraper around guaranteed rotation or use circuit changes to evade a site’s controls.
Does this guide establish whether Tor scraping is legal where I live?
No. Rules depend on jurisdiction and the activity involved; check applicable law and the target site’s terms before collecting data.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
