Highly Scalable Data Service (HSDS) review
A focused REST service for teams that need parallel access to HDF5 datasets.
Reviewed by iTechGuides Editors · Editorial team · Updated Oct 2026
Highly Scalable Data Service (HSDS) is an open-source REST service for reading, writing, and sharing HDF5 data in object-storage environments, including cloud and POSIX storage. It is aimed at developers and organizations handling scientific or engineering datasets that need API access and parallel workflows. HDF5 and Python h5py-compatible applications can connect through REST VOL, h5pyd, and command-line tools, making HSDS a fit where those formats and workflows are already central.
Its depth is in data access rather than file management. HSDS supports parallel processing across data nodes, multiple readers and writers, compression, hyperslab and point selection, SQL-like dataset queries, and asynchronous processing. Role-based access control and access-control lists address permissions. Storage options include AWS S3, Azure Blob Storage, MinIO, and POSIX storage; deployments can run in the cloud or self-hosted, using service and data-node containers on one server or across a Kubernetes cluster. Docker is also listed among its integrations. The vendor documents a dynamically changing server-node count, while the published scaling model is auto-scaling.
HSDS itself is open-source software with a free plan. The vendor separately offers paid support, consulting, and managed offerings, so teams should distinguish those from the software. Community support is the listed support channel for HSDS. Choose it when REST access to HDF5 data, parallel reads and writes, and dataset queries are core needs; teams looking for a general-purpose cloud file-storage service should choose a broader storage product instead. Deployment and operations also make it a less direct fit for teams seeking a turnkey file-sharing service.
Highly Scalable Data Service (HSDS) pros and cons
- Where it wins
- Reads and writes HDF5 data in object and POSIX storage
- Supports parallel processing and multiple readers and writers
- Offers dataset queries, selection tools, and role-based access controls
- Where it doesn't
- Focused on HDF5 data rather than general-purpose file storage
- Deployment uses service and data-node containers, adding operational work
- Support is community-based for the open-source software
Highly Scalable Data Service (HSDS) fact sheet, pricing and score →
Advertiser disclosure: iTechGuides is reader-supported. Vendors can pay for top positions in our rankings and for a place on other products' pages, and we may earn a commission when you click some links. Bought places stand at the number bought; this page and our disclosure say so. Paying vendors may get a fuller, more detailed review from our editors, and that review can change their score. How we rank.
Last updated · How we research and update