What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

For most production AI training, use both: keep durable, shared, raw and versioned datasets in object storage, then cache or stage the data a job needs on local NVMe SSDs close to the GPUs. Choose NVMe alone only when the active dataset fits the machine and you have a separate backup; choose object storage alone when durability and shared access matter more than the lowest possible data-access latency.

The choice is not simply “fast versus slow.” It is about which tier should be authoritative, where the training job reads from, how data is shared and recovered, and whether the workload is constrained by storage I/O at all.

What is the difference between NVMe SSDs and object storage?

NVMe SSDs are local, block-addressable storage devices that can serve data with low latency. Object storage keeps data as objects in a service or system designed for scalable access and durability, rather than presenting each object as a locally attached disk. They solve different parts of an AI data pipeline.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Consideration Local NVMe SSD Object storage
Typical role Hot data, cache, scratch space, staging and temporary job data Durable source of truth for raw, retained, shared and versioned datasets
Access pattern Direct-attached block storage; useful when low latency or high performance is a priority Objects are accessed through an object-storage interface; suited to scalable repositories
Sharing Usually local to the worker or workstation unless separately shared or synchronized Can make a repository available to multiple workers, subject to the service and access configuration
Survival of machine replacement Do not assume local or instance storage will survive replacement; keep an independent copy Designed for durable storage, with service-specific availability, durability and recovery properties
Capacity and growth Bounded by the drive or worker configuration Can scale to very large repositories; AWS describes object storage as capable of virtually unlimited scale
Cost comparison Depends on drive, machine, capacity and operational costs Depends on storage class, requests, data movement and provider pricing

Microsoft recommends a file system for active AI data and specifically points to local NVMe or SSD file systems when performance is the priority. It describes these as temporary, high-performance systems for deep-learning training and real-time inferencing. For inactive job data, Microsoft recommends transfer to Azure Blob Storage for long-term, cost-effective storage with scalable access tiers.

#1 Best Overall
Elebase USB to USB C Adapter for iPhone 18 Pro Max,USBC Car Charger Adapter | 4Pack Type C Female to A Male Cable Converter for Apple Duo 17 16 15 14 Plus,iWatch Watch 12 11 10,iPad 9 8 Air,Airpods 5 4
  • Read Before You Buy — No Video Output: These adapters support charging and USB 2.0 data transfer, but cannot transmit video signals. Except for standard USB webcams (which use USB data only), they are not compatible with HDMI/DisplayPort cables, video-capable USB-C hubs, or docking stations with video output.
  • Convert USB-A Ports to USB-C: Designed to connect USB-C earphones, cables, flash drives, card readers, and other USB-C accessories to standard USB-A ports. Plug-and-play with no drivers or software required.
  • Aluminum Alloy Housing: Built with a sturdy aluminum alloy shell that aids in heat dissipation and protects against daily wear and scratches. Designed to maintain a stable and secure connection.
  • Compact & Travel-Friendly: The ultra-compact design allows the adapter to stay plugged into your device without blocking adjacent ports or adding bulk, reducing wear and tear on your original USB ports.
  • 12-Month Warranty: Backed by a 12-month manufacturer warranty for peace of mind. Designed to meet strict quality control standards for reliable everyday performance.

AWS similarly describes block storage as direct-attached, high-performance, low-latency storage and identifies EC2 instance store as appropriate for ephemeral, pod-local storage. “Ephemeral” is the important qualification: treat it as expendable workspace, not the only copy of a dataset.

Should I store my training dataset on NVMe or S3?

If “store” means the authoritative copy that must remain available across worker replacement, store it in durable object storage. If it means the copy the current training process reads repeatedly for performance, stage or cache the active data on NVMe when tests show that local reads help. S3 is an object-storage service; the same architectural distinction applies to other object stores.

Use NVMe first when the active working set is bounded

NVMe is a good first choice for the active training copy when the data fits on the worker or workstation, the job is sensitive to data-access latency, and preprocessing is I/O-bound. It can also be useful for temporary transformed data, indexes, shuffle files or intermediate outputs that can be regenerated. The key is to size for the active working set, not just the compressed source archive: decoding, preprocessing and caching can change how much local space a job needs.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Do not make a local drive the only home for data that must survive a machine failure, replacement or cleanup. Maintain an independent durable copy and a recovery process. This is especially important for instance-local or pod-local storage, whose lifecycle may be tied to the compute resource.

Use object storage first when the repository must outlive a worker

Object storage is the natural starting point when datasets need to be shared across workers, grow unpredictably, follow retention or versioning policies, or remain available after a training machine is removed. It avoids treating each worker’s attached capacity as the canonical archive. Its scalability and durability make it useful for raw source data and retained dataset versions.

Rank #2
Sale
Anker USB-C Hub, 5-in-1 USB Hub for Laptops, 4K HDMI Multiport Adapter | USB C Dongle with 90W Max Power Delivery, 3×5Gbps USB A Data Ports, for MacBook, Dell, and More (Charger Not Included)
  • 5-in-1 USB-C Hub: Experience comprehensive connectivity featuring a Power Delivery input, two USB-A 2.0 ports, a USB-A 3.0 port, and an HDMI port. (Note: The USB-C power delivery input port is only for connecting an external wall charger to power your laptop and cannot power peripheral devices.)
  • 90W Pass-Through Charging: Achieve optimal charging with 90W pass-through power to your laptop, supported by a total input of 100W, with the hub reserving 10W for operational efficiency. (Note: Wall charger not included.)
  • Quick Data Transfers: Accelerate your productivity with rapid data transfers using a high-speed 5Gbps USB 3.0 port and two 480Mbps USB 2.0 ports.
  • 4K HDMI Display: Enhance your visual experience with a hub capable of delivering 4K resolution at 30Hz in both mirror and extend modes. Please note that this hub is compatible with MacBook (macOS 12 and newer), Windows 10 and 11, ChromeOS, and laptops equipped with DP Alt Mode and Power Delivery. Note: This device is not compatible with Linux.
  • What You Get: Anker USB-C Hub (5-in-1, 4K HDMI), welcome guide, 18-month warranty, and our friendly customer service.

That does not mean every training loop should read directly from the object store. Depending on the access pattern and system, repeated reads or latency-sensitive workloads may benefit from staging data locally. Measure the complete input pipeline rather than assuming that remote access will either bottleneck training or be fast enough.

Use both when you need durable data and fast active reads

For many production pipelines, object storage is the authoritative tier and NVMe is a disposable performance tier. Keep original, immutable or versioned data in the durable repository; copy or cache the subset a job needs to local NVMe; train against that staged data; and retain only outputs that need to persist. A lost cache should be recoverable by fetching or rebuilding it from the authoritative copy.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Is object storage too slow for model training?

Not always. Object storage can be adequate when the workload’s access pattern and throughput needs are a good fit, but it can add latency to tight training loops. The answer depends on the framework, file format, request pattern, concurrency, network and compute configuration—not on the storage label alone.

AWS Well-Architected says the optimal storage solution varies with access method (block, file or object), random versus sequential access, required throughput, frequency of access, frequency of updates, and availability and durability constraints. Applied to AI data, that means checking how the loader actually reads: whether it streams large sequential files, opens many small items, revisits examples, or feeds multiple workers at once.

Signs storage may be limiting training

  • GPUs or CPUs are idle while input batches are being prepared or loaded.
  • Epoch time changes materially when data is staged locally, while compute and batch settings remain the same.
  • Data-loader workers cannot supply batches at the rate the training process consumes them.
  • Small-file or random-access patterns create many individual reads rather than efficient large transfers.
  • Preprocessing repeatedly rereads or decodes the same source data instead of using cached or transformed batches.

These are diagnostic clues, not proof that NVMe will fix the problem. Bottlenecks can also be in preprocessing, network transfer, CPU capacity, concurrency or the training code. Compare measurements from the same job with the same data and compute, changing only the data access or staging strategy.

Rank #3
Sale
Anker USB C Hub, 7in1 Multi-Port USB Adapter, 4K@60Hz USBC to HDMI Splitter | 85W Max PD, 2 USB 3.0 & 1 USBC Data Ports, SD/TF Card Reader, for Laptops/Mac and Other Type C Devices (Charger Not Included)
  • Sleek 7-in-1 USB-C Hub: Features an HDMI port, two USB-A 3.0 ports, and a USB-C data port, each providing 5Gbps transfer speeds. It also includes a USB-C PD input port for charging up to 100W and dual SD and TF card slots, all in a compact design.
  • Flawless 4K@60Hz Video with HDMI: Delivers exceptional clarity and smoothness with its 4K@60Hz HDMI port, making it ideal for high-definition presentations and entertainment. (Note: Only the HDMI port supports video projection; the USB-C port is for data transfer only.)
  • Double Up on Efficiency: The two USB-A 3.0 ports and a USB-C port support a fast 5Gbps data rate, significantly boosting your transfer speeds and improving productivity.
  • Fast and Reliable 85W Charging: Offers high-capacity, speedy charging for laptops up to 85W, so you spend less time tethered to an outlet and more time being productive.
  • What You Get: Anker USB-C Hub (7-in-1), welcome guide, 18-month warranty, and our friendly customer service.

When direct object-store reads may be reasonable

Direct reads are worth evaluating when datasets are too large or change too often to stage in full, when the job reads data sequentially in large units, or when local capacity is limited. A job that reads each shard once may behave differently from one that repeatedly performs small random reads. If staging is used, determine whether the transfer time is amortized over the job or simply delays every run.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Do I need local SSD scratch space for AI training?

You need local scratch space when the job benefits from staging, caching, temporary transformation or intermediate storage—and the performance gain justifies the local capacity and management effort. You do not need NVMe merely because the workload is AI: if storage is not the limiting part of the pipeline, a faster drive may not improve end-to-end training time.

Keep the scratch tier clearly separate from retained data. Name or configure temporary paths so outputs are not mistaken for durable artifacts, and make cleanup safe to repeat. For cloud workers, confirm the lifecycle of the specific local disk or instance store; do not infer persistence from the fact that a path remains mounted during a run.

What belongs on scratch?

  • Shards or subsets copied from object storage for an active run.
  • Decoded, resized or otherwise transformed examples that can be regenerated.
  • Indexes, temporary manifests, shuffle buffers written to disk and intermediate files.
  • Temporary checkpoints only if a separate process copies required checkpoints to durable storage.

Keep the original dataset, important labels, irreplaceable annotations and required checkpoints in a durable location. If a scratch artifact would be costly or impossible to reproduce, treat it as retained data and copy it to the durable tier.

How should I design a two-tier AI dataset workflow?

Make object storage the canonical repository and use local NVMe only for the data and artifacts that benefit from being close to compute. The workflow should make it obvious which copy is authoritative and what can safely be deleted.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
Sale
UGREEN USB to USB C Adapter Combo 4-Pack, 10Gbps USB C Converter Space Gray | Data transfer & Fast charging for MacBook, iPhone 17/16/15, iPad, Samsung Galaxy, Apple Watch
  • Dual Converters, Infinite Potential:Includes 2× USB C male to USB A female adapters and 2× USB A male to USB C female adapters. Perfect for a wide range of uses—tablets with Bluetooth keyboards, expand USB ports on macbook, and more. Two different converters for all your daily needs
  • Next-Level 10Gbps & 3A Charging: No more slow 480Mbps, this usb to usb c adapter has a transfer speed of up to 10Gbps, allowing you to do more transferring in less time. This usb adapter fits both USB A and USB C charger, supporting up to 3A fast charging
  • Upgraded Exquisite Craftsmanship: With an aluminum alloy housing and metal connector, the usbc to usb adapter is extremely durable and sturdy. Rigorously tested to withstand more than 10,000 times of plugging and unplugging, ensuring long-lasting performance
  • Broad Compatible: The usb c to usb adapter widely supports all USB C/ USB A devices like laptops, tablets, cellphones, car chargers, and phone chargers. Such as compatible with MacBook Pro/Air 2023/2022, Thunderbolt 4/3 Devices,Apple MagSafe Watch 9/8/7/SE/Ultra, iPad Pro 2022/2021, Samsung Galaxy S23/S20/S10, and iPhone 17/16/15 Pro. Plug and play
  • Please Note: To reach 10Gbps speed, keep the cable under 3.3 ft. For USB A Male to USB C adapters, try flipping the USB C connector. USB C Male to USB A adapters support bidirectional 10Gbps transfer within 3.3 ft
  1. Put the durable source in object storage. Organize raw and retained dataset versions so workers can identify which dataset they are consuming. Use the service’s available retention, access and version-management features where they match your recovery requirements.
  2. Define the job’s active working set. Identify the shards, files or transformed batches a run will need, including temporary-space requirements. Estimate whether they fit on each worker rather than assuming a single machine’s capacity applies to a distributed job.
  3. Stage or cache close to the worker. Copy the selected data to NVMe when the job’s access pattern or benchmark warrants it. For a cache, define how entries are identified, refreshed and invalidated so a worker does not silently train on stale data.
  4. Train and measure the full input path. Measure startup or staging time as well as steady-state batch delivery and total job duration. A cache that speeds up epochs but adds an excessive transfer delay may not improve the whole workflow.
  5. Persist valuable outputs deliberately. Copy checkpoints, metrics or generated datasets that must outlive the worker to durable storage. Verify the copy completes before terminating compute.
  6. Clean temporary data safely. Remove cache and scratch files only after confirming that retained outputs are elsewhere. Make cleanup and retry behavior explicit in job automation.

This separation reduces ambiguity during failures: the durable repository is the recovery point, while the local tier can be recreated. It also makes it possible to use different local cache sizes for different job types without changing where the organization keeps its dataset of record.

How do I compare storage options for my workload?

Benchmark the actual framework, file format, preprocessing and worker configuration. Headline device specifications are not a substitute for measuring the training input pipeline.

Microsoft notes that NVMe performance depends on VM size and I/O block size. Therefore, a result from one VM configuration or block size does not establish performance on another. Use the intended VM or workstation, the actual data representation, and the concurrency expected in production.

What to test Why it matters How to make the comparison useful
End-to-end training time A storage speedup matters only if it improves the job’s total outcome. Compare a representative run with the same model, data, compute and training settings.
Startup and staging time Local staging may improve repeated reads but add an initial copy delay. Record transfer or cache-fill time separately from steady-state training.
Random and sequential access Storage may behave differently with large sequential reads than with many small reads. Use the real loader and file layout; do not substitute a synthetic test that misses the access pattern.
Throughput and latency Peak throughput alone may not reflect the loader’s response to individual reads. Observe the workload at its real I/O block size and degree of concurrency.
GPU utilization and batch delivery These help reveal whether input preparation keeps pace with compute. Track them alongside epoch time and preprocessing activity.
Worker scaling and sharing A configuration that works for one worker may change when more workers read or stage data. Test the expected number of workers and the intended shared-data arrangement.
Growth, recovery and lifecycle Fast access is not enough if data cannot be restored or retained as required. Check how new versions are handled, what survives worker replacement and how temporary data is removed.

There is no universal NVMe-versus-object-storage training benchmark or total-cost figure that applies across frameworks, formats, compression, concurrency, regions and pricing models. Run a workload-specific test and compare the complete cost of the design, not only the storage line item.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What is the cheapest durable storage for a large AI dataset?

The evidence does not establish one cheapest provider or storage class for every dataset. Object storage is a strong candidate for durable, scalable repositories, but total cost depends on storage class, request charges, data egress, access frequency, region and the compute arrangement.

Best Value
Anker USB C Hub, 5-in-1 USBC to HDMI Splitter with 4K Display | 85W Max PD, 1 Powered USB-C 5Gbps & 2 Powered USB-A 3.0 5Gbps Data Ports, for MacBook Pro, MacBook Air, Dell and More (Black)
  • 5-in-1 Connectivity: Equipped with a 4K HDMI port, a 5 Gbps USB-C data port, two 5 Gbps USB-A ports, and a USB C 100W PD-IN port. Note: The USB C 100W PD-IN port supports only charging and does not support data transfer devices such as headphones or speakers.
  • Powerful Pass-Through Charging: Supports up to 85W pass-through charging so you can power up your laptop while you use the hub. Note: Pass-through charging requires a charger (not included). Note: To achieve full power for iPad, we recommend using a 45W wall charger.
  • Transfer Files in Seconds: Move files to and from your laptop at speeds of up to 5 Gbps via the USB-C and USB-A data ports. Note: The USB C 5Gbps Data port does not support video output.
  • HD Display: Connect to the HDMI port to stream or mirror content to an external monitor in resolutions of up to 4K@30Hz. Note: The USB-C ports do not support video output.
  • What You Get: Anker 332 USB-C Hub (5-in-1), welcome guide, our worry-free 18-month warranty, and friendly customer service.

For an apples-to-apples estimate, include the amount retained, the expected duration, how often data is read or changed, the number and type of requests, data transferred out, and any cost of keeping or provisioning local NVMe. A rarely accessed archive and a dataset read repeatedly by a training fleet have different cost profiles, even if their stored size is identical. Cloud pricing and storage-class terms change, so confirm current provider pricing for the region and usage pattern before committing.

Durability figures also need to be read in context. AWS documentation states 99.999999999% (11 nines) durability for its object-storage offering; that figure is a service-specific statement, not a universal promise for all object storage or a substitute for checking service scope, availability, retention settings and recovery needs. A durable store does not by itself guarantee that the right dataset version is selected or that a deleted object can be recovered under your configuration.

What can go wrong with an NVMe and object-storage setup?

The common failures arise when teams confuse a fast working copy with the authoritative copy, assume local storage persists, or optimize a drive metric instead of the data path that determines training time.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • The only dataset copy is on a worker. Keep a durable copy outside that worker and test how to restore or restage it.
  • The cache contains stale data. Key cache entries to a dataset version or other reliable identifier, and refresh them when the source changes.
  • Staging consumes the expected speedup. Measure initial transfer plus training, and consider reuse across runs only if cache validity and worker lifecycle are well defined.
  • Local capacity fills unexpectedly. Account for temporary transformations, concurrent jobs and retained outputs; monitor free space and define cleanup behavior.
  • The benchmark does not match production. Use the actual VM size, I/O block size, file format, access pattern and worker count. Microsoft specifically notes the influence of VM size and I/O block size on NVMe performance.
  • Object-storage requests or transfers dominate cost. Estimate request and egress charges alongside stored capacity, based on real access frequency and region.
  • Important outputs disappear with the worker. Persist checkpoints and generated artifacts before removing ephemeral compute or local storage.

Which storage should you choose?

Use object storage for the durable, shared dataset repository and local NVMe for the hot working set when low-latency reads or preprocessing performance justify staging. If the full active dataset fits on a worker and you can independently protect it, NVMe-only may be appropriate; if elastic, durable sharing is the priority and the access pattern is acceptable, object storage may be sufficient. For production training, a measured two-tier design is often the most practical balance.

Frequently Asked Questions

Can multiple training workers use the same NVMe drive?

A local NVMe device is typically attached to a particular worker, so other workers should not be assumed to see the same files. If workers need common data, use an appropriate shared or object-storage access pattern and stage local copies where that benefits each worker.

Should I keep model checkpoints on NVMe or in object storage?

Use NVMe for temporary checkpoints only when losing them is acceptable or another process is persisting them. Save checkpoints needed for recovery or future runs to a durable location and verify the save finishes before compute is removed.

Does 11-nines durability mean I do not need backups?

No. A durability figure describes a service-level property, not whether your account settings, version selection, access controls or deletion recovery match your needs. Decide separately how to recover from accidental deletion, unwanted changes and operational mistakes.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Can I use a cheaper hard drive instead of NVMe for training data?

That depends on the workload’s latency and throughput needs, and the supplied evidence does not compare hard-drive performance or prices. Benchmark the intended device with your actual loader before deciding whether a lower-cost tier can keep data flowing at the required rate.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.