Intel® SSD Data Center Family-based Lustre* File System
To satisfy the cluster’s storage needs for scratch and interim data space, the Customer Response Team-Data Center (CRT-DC) team employs a commercial Lustre (scale-out storage) implementation based on hard disk drives (HDDs). To address an increasing need for scratch storage, the team built a new Lustre system using current Intel® Xeon® processor-based platforms and Intel® Solid-State Drive Data Center S3500 Series.
The new Lustre system built from off-the-shelf components significantly outperformed the HDD-based Lustre system in our testing. While the HDD-based solution produced up to 10.5 GB/s, the new solution built with the Intel® SSD Data Center Family of products achieved over 44 GB/s in our testing—or 80 percent of the theoretical network maximum—in aggregate throughput across the cluster’s Fourteen Data Rate (FDR) Infiniband* network.
The ability of the SSD-based Lustre implementation to scale with an increase in clients also proved remarkable. The team was able to execute multi-node performance tests using up to 128 clients. By comparison, the HDD-based Lustre system saturates between 16 and 32 clients, and average performance decreases as more clients are added and interleaving of I/O occurs.
Most important, with the new SSD-based Lustre* implementation running on Intel® Xeon® processor-based platforms, the CRT-DC team can both extend and enrich its value to Intel and to Intel’s customers.
Read the full Intel® SSD Data Center Family-based Lustre* File System Case Study.