The FlashBlade//S500 offers a unique set of key features and benefits as a HPS solution tailored for NCPs. These include:
-
Ease of Use: For NCPs scaling multitenant AI services, FlashBlade’s simplified scale-out architecture reduces operational overhead and accelerates deployment timelines.
-
Distributed Everything: Metadata, data, and control functions are distributed across the FlashBlade//S500 solution. This massively parallel architecture avoids bottlenecks and allows performance and capacity to scale with the addition of more blades.
-
Erasure Coding: Each FlashBlade//S500 supports wide-stripe erasure coding with +2 & +4 redundancy schemes. This enhances resiliency by fragmenting data and distributing parity information across the FlashBlade//S500 array, ensuring that in the event of failures, the original data remains accessible and can be reconstructed without significant performance impact.
-
Scalability: Designed for managing extensive unstructured data, a single FlashBlade//S500 solution provides highly efficient scalability. Hot-swappable components facilitate vertical capacity increases, while horizontal scaling allows for seamless expansion. This ensures continuous availability and optimal performance for NCP configurations and their associated workloads during growth.
-
Reliability: The FlashBlade architecture is designed to provide reliable unstructured data storage. The disaggregated architecture of a FlashBlade//S500 solution allows compute and storage to scale independently, optimizing infrastructure spend and minimizing footprint in dense GPU clusters. The FlashBlade//S500 is engineered for both exceptional reliability and operational simplicity. Its fully N+2 & N+4 redundant, non-disruptive architecture delivers six nines (99.9999%) of availability.
-
Efficiency, Predictability, and Sustainability: The FlashBlade//S500 architecture is designed to maximize energy efficiency and density, operating at just 1.3 watts per terabyte. This contributes to a reduced data center footprint and lower power consumption, aligning with sustainability goals and supporting future scalability with increasingly capable components.
The scale-out nature of a single FlashBlade//S500 for NCP solutions allows for non-disruptive, granular capacity and performance expansion. This ensures predictable performance scaling concurrent with growing AI workload demands, and provides sustained high throughput and availability for long-term infrastructure planning.
-
High Performance: The FlashBlade//S500 for NCP delivers exceptional performance through a massively distributed transactional database that handles metadata control, large file chunks, and protocol processing with precision. It's optimized for both small and large files, using high-performance metadata handling and variable-block encoding for efficient random access.
All data is intelligently distributed across the system, ensuring speed and scalability for multiple workloads. DirectFlash® technology from Everpure provides direct access to flash media and exposes the full concurrency of flash devices, enabling the architecture to maximize throughput and minimize latency at every layer.
About the FlashBlade//S500 Hardware
FlashBlade//S500 is a scale-out storage appliance engineered for high-throughput, low-latency data services across AI workloads. All components in the FlashBlade//S500 solution work in combination, to handle all data I/O to and from the FlashBlade//S500 array.
For this NCP RA, naming conventions describing the FlashBlade//S500 architecture used in this paper are as follows:
-
DFM: DirectFlash Module. A physical all-flash storage device created by Everpure. In the case of NCPs, the DFM is 37.5 TB in size.
-
Blade: A single physical piece of hardware that is used to house DFMs.
-
Chassis: A single physical piece of hardware used to contain multiple blades.
-
XFM: External fabric module. A switch pair used to connect multiple chassis to the NCP converged network fabric and aggregate all data traffic to blades.
About the FlashBlade//S500 Operating System
Purity for FlashBlade (Purity//FB™ ) is the operating environment that manages the FlashBlade hardware, networking, and storage components. The Purity//FB software is part of the FlashBlade solution. As a single install package, it manages all hardware and software components, enabling the FlashBlade//S500 to function as a highly scalable storage solution for NCP environments.