Short answer: you cannot export a guaranteed, working copy of an entire site with one Wayback Machine button. For a useful local collection, enumerate the site’s archived URLs with the Internet Archive’s CDX index, select the dates and records you need, download those archived URLs with a repeatable script or bulk downloader, and keep a manifest that preserves each original URL and capture timestamp. The result contains what the archive captured and still serves—not necessarily every page, image, script, database record, or interactive feature the original site had.
What “download an entire website” means in the Wayback Machine
Define the deliverable before downloading. “Entire website” can mean three different things:
| Goal | What to collect | Trade-off |
|---|---|---|
| One historical snapshot | One selected capture per URL, close to a chosen date | Smaller and easier to browse, but it may mix dates when individual URLs were not captured together. |
| All indexed pages | One selected capture for every archived URL under a domain or path | Broad URL coverage, with missing resources and inconsistent capture dates possible. |
| Historical corpus | Multiple timestamps for each URL | Preserves changes over time, but creates many more files and requires more storage and deduplication. |
A CDX record is an index entry for an archived capture. It is not proof that the capture is complete, that every dependency was stored, or that a server-side application can be reconstructed locally. Dynamic behavior, databases, authentication, and other backend services generally cannot be recovered merely by downloading archived responses.
Why Save Page Now is not a whole-site download
Save Page Now is intended for submitting an individual page. It can save that page and included resources such as images and CSS, but it does not follow the page’s outlinks to initiate a complete site crawl. Use it when you need to preserve a page that is not yet archived, not when you need to collect a domain’s existing capture history.
Free tools Windows power users keep installed
One-click scans. No signup required.
#1 Best Overall
- Read Before You Buy — No Video Output: These adapters support charging and USB 2.0 data transfer, but cannot transmit video signals. Except for standard USB webcams (which use USB data only), they are not compatible with HDMI/DisplayPort cables, video-capable USB-C hubs, or docking stations with video output.
- Convert USB-A Ports to USB-C: Designed to connect USB-C earphones, cables, flash drives, card readers, and other USB-C accessories to standard USB-A ports. Plug-and-play with no drivers or software required.
- Aluminum Alloy Housing: Built with a sturdy aluminum alloy shell that aids in heat dissipation and protects against daily wear and scratches. Designed to maintain a stable and secure connection.
- Compact & Travel-Friendly: The ultra-compact design allows the adapter to stay plugged into your device without blocking adjacent ports or adding bulk, reducing wear and tear on your original USB ports.
- 12-Month Warranty: Backed by a 12-month manufacturer warranty for peace of mind. Designed to meet strict quality control standards for reliable everyday performance.
Plan the capture set
Choose the URL boundary
Decide whether the scope is an exact host, all subdomains, a directory, or a URL pattern. A request for example.com/* is materially different from a request for one path such as example.com/docs/*. Decide whether query-string variants, downloadable documents, and non-HTML assets belong in the set.
Choose the date policy
For a readable snapshot, select a date window and choose one capture per URL, preferably near the target date. For research or legal preservation, retain every timestamp you need and record why each one was selected. Do not silently collapse multiple captures when the point is to study change.
Estimate storage from the index
The CDX response includes a length field for records. Sum lengths for the records you plan to retrieve, then allow additional room for filenames, manifests, retries, and duplicate resources. There is no universal site-size estimate. Save to a location with enough capacity; an external drive is optional, not an Internet Archive requirement.
Enumerate archived URLs with CDX
The CDX index exposes fields including timestamp, original, mimetype, statuscode, digest, and length. A typical query asks for a URL pattern and requests a machine-readable output containing those fields. Encode the URL parameter whenever the target itself contains a query string.
PC Slower Than It Used to Be?
A free scan shows the junk files, broken settings and background clutter dragging Windows down - then fixes them in one click.Free scan · Windows 10 & 11Crashes, No Sound, or Screen Glitches?
Random freezes, missing sound and display glitches usually trace back to one bad driver. Find and replace yours safely.Free scan · under a minuteStart with a small, bounded query so you can inspect the result before launching a large download. Keep the original URL and timestamp exactly as returned. For large result sets, use CDX pagination rather than requesting an unbounded response; the Archive’s documentation specifically recommends pagination for bulk queries.
Rank #2
- 5-in-1 USB-C Hub: Experience comprehensive connectivity featuring a Power Delivery input, two USB-A 2.0 ports, a USB-A 3.0 port, and an HDMI port. (Note: The USB-C power delivery input port is only for connecting an external wall charger to power your laptop and cannot power peripheral devices.)
- 90W Pass-Through Charging: Achieve optimal charging with 90W pass-through power to your laptop, supported by a total input of 100W, with the hub reserving 10W for operational efficiency. (Note: Wall charger not included.)
- Quick Data Transfers: Accelerate your productivity with rapid data transfers using a high-speed 5Gbps USB 3.0 port and two 480Mbps USB 2.0 ports.
- 4K HDMI Display: Enhance your visual experience with a hub capable of delivering 4K resolution at 30Hz in both mirror and extend modes. Please note that this hub is compatible with MacBook (macOS 12 and newer), Windows 10 and 11, ChromeOS, and laptops equipped with DP Alt Mode and Power Delivery. Note: This device is not compatible with Linux.
- What You Get: Anker USB-C Hub (5-in-1, 4K HDMI), welcome guide, 18-month warranty, and our friendly customer service.
Deduplicate deliberately
Two records can represent identical content at different times. The digest field can help identify repeated payloads, but do not discard timestamps if historical change matters. Conversely, downloading only one record for each original URL is appropriate when the goal is a compact snapshot.
Build a repeatable download workflow
- Export the index. Save the CDX response as a manifest instead of copying URLs by hand.
- Validate records. Filter by your date range, status code, MIME type, URL scope, and capture policy. Keep records that are useful even when they are not HTML: stylesheets, scripts, images, PDFs, and other documents may be required for a readable snapshot.
- Construct replay URLs. Each selected record needs its timestamp and original URL in the Wayback replay format. Preserve both values in your local manifest.
- Download with a bulk-capable tool. The Internet Archive’s general download guidance points to wget guidance and its command-line tool for bulk-download functions. Tool flags differ by version, so check the current documentation for the exact release you install.
- Throttle and retry. Use a modest request rate, retry transient HTTP failures, and write progress to a log. A restartable queue is safer than one long command that loses all progress after a network interruption.
- Store metadata beside files. Record original URL, capture timestamp, replay URL, response status, MIME type, digest, local path, and download result.
A practical manifest shape
Use one line per selected capture in CSV or JSON Lines. For example:
{"timestamp":"20200115123000","original":"https://example.com/guide","mimetype":"text/html","statuscode":"200","digest":"…","length":"48321","local_path":"20200115123000/https/example.com/guide"}Do not use the ellipsis as a value in a real manifest; retain the complete digest returned by CDX. A deterministic local path prevents two timestamps for the same URL from overwriting each other.
Retrieval choices: one version or every version
One selected capture per URL
This is the sensible default for a browsable archive. Choose a date rule—nearest capture before a cutoff, nearest capture inside a window, or the first capture in a period—and apply it consistently. The resulting collection is easier to search and uses less storage, but it may combine pages captured on different days.
Multiple captures per URL
Keep the timestamp in the directory or filename when preserving revisions. This supports change analysis and rollback comparisons. Expect substantially more files, repeated assets, and more failed or partial captures to review.
Rank #3
- Sleek 7-in-1 USB-C Hub: Features an HDMI port, two USB-A 3.0 ports, and a USB-C data port, each providing 5Gbps transfer speeds. It also includes a USB-C PD input port for charging up to 100W and dual SD and TF card slots, all in a compact design.
- Flawless 4K@60Hz Video with HDMI: Delivers exceptional clarity and smoothness with its 4K@60Hz HDMI port, making it ideal for high-definition presentations and entertainment. (Note: Only the HDMI port supports video projection; the USB-C port is for data transfer only.)
- Double Up on Efficiency: The two USB-A 3.0 ports and a USB-C port support a fast 5Gbps data rate, significantly boosting your transfer speeds and improving productivity.
- Fast and Reliable 85W Charging: Offers high-capacity, speedy charging for laptops up to 85W, so you spend less time tethered to an outlet and more time being productive.
- What You Get: Anker USB-C Hub (7-in-1), welcome guide, 18-month warranty, and our friendly customer service.
Make the local copy usable
Check completeness against the manifest
Compare every selected record with a download result. Mark missing, failed, and empty responses separately; an absent local file should not be confused with an archived 404 page.
Inspect representative resources
- Open several HTML pages from different dates.
- Check that referenced stylesheets, images, fonts, and scripts were actually retrieved.
- Open representative PDFs and other binary files.
- Look for replay links or absolute URLs that still point to the live site.
- Verify that local filenames and encodings survive unusual characters and long query strings.
Understand replay limitations
An archived page can render as a document while its search, login, checkout, personalization, API calls, or other dynamic functions fail. Those behaviors depend on services that were not necessarily captured. Treat the result as a preserved collection of archived responses, not as a guaranteed deployable clone.
Quick wins for a faster PC:
Repair Windows errors before they cause bigger problemsFix Now →Scan for outdated or missing drivers - takes under a minuteDriver Scan →Clear out junk files and repair common Windows errorsFree Scan →Troubleshooting
The CDX query returns too many rows or times out
Narrow the host or path, add a date range, request only the fields you need, and paginate the response. Process pages incrementally and checkpoint the manifest instead of holding the entire result in memory.
A URL appears in CDX but the replay download fails
The index records a capture, but the response may be temporarily unavailable, blocked, incomplete, or associated with a replay URL your downloader mishandles. Retry later, inspect the replay response manually, and record the failure rather than inventing a replacement file.
Images or CSS are missing
Dependencies may never have been captured, may have a different timestamp, or may be referenced through URLs outside your scope. Add the relevant asset patterns to the enumeration, retain non-HTML MIME types, and inspect the page source for the exact referenced URLs.
Rank #4
- Dual Converters, Infinite Potential：Includes 2× USB C male to USB A female adapters and 2× USB A male to USB C female adapters. Perfect for a wide range of uses—tablets with Bluetooth keyboards, expand USB ports on macbook, and more. Two different converters for all your daily needs
- Next-Level 10Gbps & 3A Charging: No more slow 480Mbps, this usb to usb c adapter has a transfer speed of up to 10Gbps, allowing you to do more transferring in less time. This usb adapter fits both USB A and USB C charger, supporting up to 3A fast charging
- Upgraded Exquisite Craftsmanship: With an aluminum alloy housing and metal connector, the usbc to usb adapter is extremely durable and sturdy. Rigorously tested to withstand more than 10,000 times of plugging and unplugging, ensuring long-lasting performance
- Broad Compatible: The usb c to usb adapter widely supports all USB C/ USB A devices like laptops, tablets, cellphones, car chargers, and phone chargers. Such as compatible with MacBook Pro/Air 2023/2022, Thunderbolt 4/3 Devices,Apple MagSafe Watch 9/8/7/SE/Ultra, iPad Pro 2022/2021, Samsung Galaxy S23/S20/S10, and iPhone 17/16/15 Pro. Plug and play
- Please Note: To reach 10Gbps speed, keep the cable under 3.3 ft. For USB A Male to USB C adapters, try flipping the USB C connector. USB C Male to USB A adapters support bidirectional 10Gbps transfer within 3.3 ft
The local pages redirect to the live site
Archived HTML often contains absolute links. Keep the original replay structure for browsing, or rewrite links as a separate, documented post-processing step. Do not overwrite the untouched download if evidentiary fidelity matters.
Files overwrite one another
Include the capture timestamp and a normalized representation of the original URL in every path. Query strings, fragments, Unicode characters, and trailing slashes need a deterministic escaping rule.
The download stops halfway through
Use a queue that records completed items, rerun only unfinished records, and keep separate logs for HTTP errors, timeouts, and filesystem errors. Large jobs are operational projects: test the workflow on a small subset before scaling it.
Performance, reliability, and cost considerations
- Network: concurrency can improve throughput but increases pressure on the archive and your own connection. Conservative concurrency with retries is usually easier to resume and audit.
- Storage: estimate from selected CDX
lengthvalues, then budget for duplicates and metadata. Multiple timestamps multiply file counts. - Reliability: manifests, checkpoints, deterministic paths, and logs matter more than a single clever command.
- Integrity: retain CDX metadata and response details so another person can identify exactly which capture produced each local file.
- Legal and ethical use: preserve material you are entitled to access and follow applicable copyright, privacy, and terms-of-use requirements.
Or skip the browser setup
If your immediate need is a clean visual capture of a page—not a historical Wayback export—ScreenshotNeo provides a one-request screenshot API. It accepts consent banners like a visitor and removes more than 60 known consent platforms, newsletter popups, and chat widgets before capture. Bot checks, CAPTCHAs, blank pages, timeouts, failed loads, and cache hits are not billed, and response headers identify the page verdict and billing status. Its MCP server lets Claude, Cursor, and other MCP clients call take_screenshot, get_page_info, and capture_pdf.
It does not replace CDX enumeration or recover missing historical captures; it is for capturing a page that is currently available. The API supports PNG, JPEG, WebP, and PDF output, with options such as full-page capture, CSS-selector elements, device presets, retina scale, custom CSS and JavaScript, waits, request blocking, headers, cookies, user agents, geolocation, transparent backgrounds, resizing, caching, signed links, asynchronous webhooks, bulk capture of up to 100 URLs per call, and a usage API.
The Tool Desk
Outbyte Driver Updater FREEFix the driver behind crashes, sound loss and screen glitchesFind Drivers →Outbyte PC Repair FREERepair Windows errors before they cause bigger problemsFix Now →See the ScreenshotNeo documentation for parameters. cURL:
Best Value
- 5-in-1 Connectivity: Equipped with a 4K HDMI port, a 5 Gbps USB-C data port, two 5 Gbps USB-A ports, and a USB C 100W PD-IN port. Note: The USB C 100W PD-IN port supports only charging and does not support data transfer devices such as headphones or speakers.
- Powerful Pass-Through Charging: Supports up to 85W pass-through charging so you can power up your laptop while you use the hub. Note: Pass-through charging requires a charger (not included). Note: To achieve full power for iPad, we recommend using a 45W wall charger.
- Transfer Files in Seconds: Move files to and from your laptop at speeds of up to 5 Gbps via the USB-C and USB-A data ports. Note: The USB C 5Gbps Data port does not support video output.
- HD Display: Connect to the HDMI port to stream or mirror content to an external monitor in resolutions of up to 4K@30Hz. Note: The USB-C ports do not support video output.
- What You Get: Anker 332 USB-C Hub (5-in-1), welcome guide, our worry-free 18-month warranty, and friendly customer service.
curl -G "https://api.screenshotneo.com/v1/shot" -d access_key=YOUR_API_KEY --data-urlencode url=https://stripe.com -o shot.webpPython:
import requests
r = requests.get("https://api.screenshotneo.com/v1/shot", params={"access_key": "YOUR_API_KEY", "url": "https://stripe.com"}, timeout=90)
open("shot.webp", "wb").write(r.content)Node.js:
const q = new URLSearchParams({ access_key: 'YOUR_API_KEY', url: 'https://stripe.com' });
const res = await fetch(`https://api.screenshotneo.com/v1/shot?${q}`);The Free plan includes 1,000 screenshots per month with no card; paid plans start at $5 for 3,000 shots. Sign up free for ScreenshotNeo.
Frequently asked questions
Can I download a site that was never crawled?
No. CDX can enumerate only captures that exist in the archive. You can submit a current page with Save Page Now, but that does not create a crawl of all outlinks.
Should I save the WARC files instead?
Use the format your preservation or analysis tool requires. Whatever format you choose, retain the original URL, timestamp, and CDX metadata so the collection remains traceable.
Do these 3 things before closing this tab:
1Repair Windows errors before they cause bigger problems2Scan for outdated or missing drivers - takes under a minute3Clear out junk files and repair common Windows errorsWhy are there several records with the same URL?
They are captures at different times, and sometimes different payloads. Select one according to your date policy or retain multiple timestamps when change over time matters.
Frequently Asked Questions
Can I download a site that was never crawled?
No. CDX can enumerate only captures that exist in the archive. You can submit a current page with Save Page Now, but that does not create a crawl of all outlinks.
Should I save the WARC files instead?
Use the format your preservation or analysis tool requires. Whatever format you choose, retain the original URL, timestamp, and CDX metadata so the collection remains traceable.
Why are there several records with the same URL?
They are captures at different times, and sometimes different payloads. Select one according to your date policy or retain multiple timestamps when change over time matters.
Quick Recap
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
