This article compares the performance of the Intel Customer Response Team-Data Center’s Lustre* systems in a multi-node test using up to 128 clients.
The Intel Customer Response Team Data Center (called CRT-DC), located in Albuquerque, New Mexico, runs a benchmarking data center with more than 500 compute nodes. The cluster, known as Endeavor, is rebuilt on a regular basis with the latest hardware and has been listed in Top 500 SuperComputer Sites since 2006. To satisfy the storage needs, two commercial clustered file systems from Panasas and DDN are currently in use. The Panasas system is used as a long term data repository, the DDN system employing Lustre serves as high speed scratch space. To address the increased need for volatile storage, a new Lustre system has been built in house from commercial-off-the-shelf (COTS) hardware. Testing has been conducted to assess the performance of this new system in a multi-node test.