HPC systems are typically hard to manage, but imagine a world where they aren’t. With Quobyte, HPC file systems can be easy to maintain, deliver 24/7 uptime, and scale linearly.
Quobyte is a parallel file system and has been designed to make it easy to operate at scale so you can spend less time on storage, even when it grows.
Quobyte is a true HPC distributed parallel file system with native drivers for Linux, MPI-IO, Windows, Hadoop, TensorFlow, Object/S3, and other platforms. Users can share data from a single namespace between file and object.
Run your storage 24/7 with no maintenance windows - thanks to Quobyte's 100% non-disruptive operations. Perform software updates, repair broken hardware, add/remove servers, run rebalances, and complete data movement all while your storage delivers full performance.
Stop wasting your time and resources managing multiple storage systems and serve scratch space, home and object from one storage system. Quobyte brings the features you need: Hardware isolation, tiering, multi-tenancy, and file and object in the same namespace.
When your users need more performance you simply add hardware. Quobyte's linear performance scaling without bottlenecks makes it easy to deliver what your users need, instantly: 2x hardware = 2x IOPS, throughput, capacity.
Use any x86 server with HDD and/or flash, the cloud, or a combination of your choosing. You can even mix different server types and generations in the same cluster. Start with your existing hardware and add more (non-disruptively, of course) when you need it.
I love the model that allows you to scale with your dollars and your return…That’s why we love Quobyte. And the support is enterprise-class, top notch.
Automatically handles small and large files in the same file system
Small files onto flash, large files erasure-coded onto HDD, and automatic switching as files grow.
Flash and HDD in the same file system
Combine both media types, even inside the same file, for low latency, high performance, and low cost.
MPI-IO support
Quobyte is a true parallel file system with lockless read/write access to one file. Our MPI-IO driver cuts out the kernel for fewer copies and lower latency.
HA and fault-tolerance built-in
Synchronous replication and Erasure Coding across machines and racks to protect your data and deliver the highest availability with automatic failover. No SPOFs, no downtime.
Fast and scalable rebuilds
Fully declustered rebuilds ensure fast rebuild times when your cluster grows, with minimal impact. No RAID groups, no hot spares, and no need to urgently replace hardware.
Policy-based data placement
Optimize the performance and space utilization of your applications. Reconfigure storage on the fly or recode files for archival.
Tiering
Automatic and transparent tiering between media types and clusters. Plus automatic re-coding for archival.
Multi-Tenancy for real storage infrastructure
Isolate groups and departments on a logical level for enhanced security and to give them the illusion of their own storage system. The Policy engines enable hardware isolation between tenants on the drive or server level.
OpenStack and Kubernetes support
Quobyte provides scale-out high-performance storage to OpenStack and Kubernetes infrastructures.
Auto file layouts
HPC admins have to deal with a wide variety of applications and home-grown code that produces various IO patterns. With Auto File Layouts Quobyte writes small files on flash with replication and then seamlessly switches to erasure coding (on HDD or flash) as the file grows. This optimizes performance and space utilization for all types of applications and even mixed file sizes. |
|
All HPC and enterprise workloads
With synchronous replication and erasure coding for data protection, you can run all workloads on Quobyte, including VMs and databases. In addition, Quobyte brings a range of enterprise features to HPC such as encryption, snapshots, file immutability, and multi-tenancy. |
|
Hybrid cloud support
Quobyte runs on-prem or in the cloud. With our tools like volume mirroring and the data mover you can sync clusters in different data centers, including in the cloud. Read more about the Quobyte data mover here. |
|
File striping
Striped files use the aggregated performance of several servers and can deliver 10s of GB/s on a single file. Striping works for replicated files and is always enabled for erasure-coded files. |
|
API first & automation
All aspects of Quobyte can be controlled through the API, making it easy to automate storage operations from provisioning volumes to charge back to users. |
|
X.509 certificates
Protect your storage from unauthorized access without having to trust the network. Admins can restrict certificates to specific users, similar to a root squash. This allows users that have root access on their workstations to access the storage as just that user. |
|
Security
Quobyte comes with a range of enterprise-level security features for demanding HPC applications, e.g. when HIPAA compliance is needed, or when dealing with personal data: End-to-end AES encrypted volumes, NFSv4 ACLs that are enforced across all platforms or TLS protected communication. |
|
Quotas
Quobyte quotas have been designed for scalability and minimal performance impact. Admins can configure quotas per storage tier for capacity, the number of files, and volumes for users, groups, a volume, or tenants. Default quotas can be configured on the same levels, per tenant. |
|
Scalable file locks
Quobyte supports file range locks (fcntl) and Windows file locks. Locks are handled in a decentralized fashion for maximum scalability. |
|
Snapshots and object versions
Snapshots creation and expiration can be configured through policies and by volume (e.g. only for home volumes). Snapshots are user-accessible and are connected to S3/object versions. |
|
Fairness
Quobyte implements fairness between IO streams (files), between large and small writes, and metadata operations from different users. This ensures that a single user can't monopolize the storage system. |
|
Performance analytics
Detailed per-application performance analytics tell you in real-time what's happening on the cluster. This includes information about IOPS, throughput, file creates, deletes, readdirs, and more. |
It only takes a few minutes to get high-performance, reliable HPC storage that's easy to manage.
Download NowFind out how the Science and Facilities Technology Council (STFC) manages 52 PB of data - and growing - on Quobyte for their Jasmine supercomputer.
Quobyte delivers performance to OSU’s research community, simplicity to the administrators, and the cost reduction that they need to remain within their grant funding.
3vGeomatics switched to Quobyte to get rid of their storage bottleneck and unleash the full power of their parallel processing pipeline.
Quobyte software storage accelerates engineering and scientific breakthroughs by simplifying storage management at one of the top supercomputing centers in Germany.
Read our CEO's take on how HPC can learn from the hyperscalers for more efficient operations.