Intel® Solutions for
Intel® Enterprise Edition for Lustre* software
Making Parallel Storage Simpler and More Productive
Not long ago storage for high performance computing (HPC) meant complexity and challenging management. HPC was the domain of government-sponsored research or data-intensive applications, like weather prediction or large-scale manufacturing in the aerospace and automotive sectors.
Today, HPC has expanded beyond just national laboratories and research institutes to become a key technology for enterprises of all sizes as they seek to develop improved products or entirely new industries. Getting the maximum performance from HPC and data-intensive applications requires fast and scalable storage software. Simply put, today’s HPC workloads require storage infrastructure that scales endlessly and delivers unmatched I/O levels.
Intel® Enterprise Edition for Lustre* software (Intel® EE for Lustre software)unleashes the performance and scalability of the Lustre parallel file system for HPC workloads, including technical ‘big data’ applications common within today’s enterprises. It allows end-users that need the benefits of large–scale, high bandwidth storage to tap the power and scalability of Lustre, with the simplified installation, configuration, and management features provided by Intel® Manager for Lustre software, a management solution purpose-built by the Lustre experts at Intel for the Lustre file system. Further, Intel EE for Lustre software is backed by Intel, the recognized technical support providers for Lustre, including 24/7 service level agreement (SLA) coverage.
Intel® Manager for Lustre*
Intel Manager for Lustre software includes simple, but powerful, management tools that provide a unified, consistent view of Lustre storage systems and simplify the installation, configuration, monitoring, and overall management of Lustre. The manager consolidates all Lustre information in a central, browser-accessible location for ease of use.
Integrated Apache Hadoop* Adapter
When organizations operate both Lustre and Apache Hadoop* within a shared HPC infrastructure, there is a compelling use case for using Lustre as the file system for Hadoop analytics, as well as HPC storage.
Intel Enterprise Edition for Lustre includes an Intel-developed adapter which allows users to run MapReduce* applications directly on Lustre. This optimizes the performance of MapReduce operations while delivering faster, more scalable, and easier to manage storage.
Intel EE for Lustre software has been designed to enable fully parallel I/O throughput across thousands of clients, servers, and storage devices. Metadata and data are stored on separate servers to allow optimization of each system for the different workloads they present. Improved metadata scalability using Distributed Namespace (DNE) feature is now integrated in Intel Manager for Lustre. Intel EE for Lustre can also scale down efficiently to provide fast parallel storage for smaller organizations.
The object-based storage architecture of Intel EE for Lustre software can scale to tens of thousands of clients and petabytes of data.
Intel EE for Lustre software is based on the community release of Lustre software, and is hardware, server, and network fabric neutral. Enterprises can scale their storage deployments horizontally, yet continue to have simple-to-manage storage.
Lustre has been in use in the world’s largest datacenters for over a decade and hardened in the harshest big data environments. Intel EE for Lustre software is rigorously tested, reliable, and backed by Intel, the leading provider of technical support for Lustre software. Intel EE for Lustre software delivers commercial- ready Lustre in a package that can scale efficiently both up and down to suit your business workloads, with built-in manageability.
Lustre powers 60% of the world’s top 100 fastest computers (www.top500.org). Unleash the Lustre parallel file system as an enterprise platform—offering higher throughput and helping to prevent bottlenecks.
- Built on the community release of Lustre* software
- Intel® Manager for Lustre simplifies install and configuration
- Enormous storage capacity and I/O
- Open, documented interfaces for deep integration
- Throughput in excess of 1 terabyte per second
- Resilient, highly available storage
- Centralized, GUI-based administration for management simplicity
- Integrated support for Hadoop* MapReduce* applications with Lustre* storage
- Rigorously tested, stable software proven across diverse industries
- Flexible storage solution based on Intel-enhanced community release software
- Global 24/7 technical support
Differentiated Storage Services (DSS)
Available onlywith Intel EE for Lustre software, this advanced feature allows data “hints” to be passed through Lustre, enabling cache mechanisms to prioritize data for optimal performance.
Intel Manager for Lustre Monitoring for OpenZFS
Beginning with this release, storage solutions based on Intel EE for Lustre software can exploit the data resiliency and volume management capabilities available with OpenZFS.
Integrated HPC Scheduler “Connector” for MapReduce*
Building upon the unique Intel software “connector” that allows Lustre to replace HDFS, the newest connector couples SLURM* with YARN*, and augments the Hadoop scheduler allowing MapReduce applications to be scheduled like any HPC job.
Support for New System Software
Intel EE for Lustre delivers new support for Red Hat Enterprise Linux* and CentOS* 6.7 servers and clients, or for Red Hat Enterprise Linux* and CentOS* 7.1 clients only.
Increasing Metadata Performance
More easily scale out the metadata performance of Lustre by taking advantage of the new DNE feature using Intel Manager for Lustre.
For more information on Intel® Enterprise Edition for Lustre software, contact: email@example.com
Intel® Solutions for Lustre* Software Resources
Intel® Enterprise Edition for Lustre* Software Video
Learn why enterprises need high performance storage
Acclerating Kx® kdb+ with SFA7700™ & Intel® Lustre®
Read this DDN-authored whitepaper highlighting the advantages of running kdb+ over Intel® Lustre.
Enhanced Alpha Discovery with Storage Parallelism
Learn how alpha discovery is enhanced with storage parallelism.
A New Generation of Lustre* Software Expands HPC Into the Commercial Enterprise
Intel® Enterprise Edition for Lustre* software - HPC for enterprise
Architecting a High Performance Storage System
Storage software for HPC & Big Data
Intel Solutions for Lustre* Software – Overview Video
Focusing on big data, cloud services, and more
Intel® Cloud Edition for Lustre* Software Brief
Accelerate HPC applications with the industry-leading parallel storage system
Intel® Cloud Edition for Lustre* Software Video
Learn why innovative enterprises are tapping HPC cloud storage
Intel® Enterprise Edition for Lustre* Software Brief
A new generation of Lustre software expands high performance computing into the Commercial Enterprise
Intel® Enterprise Edition for Lustre* Software - ISC'14 Video
At ISC'14, Brent Gorda, GM of the High Performance Data team, describes the latest release of the Intel® Enterprise Edition for Lustre* software
Intel® HPC Distribution for Apache Hadoop* Software including Intel® Enterprise Edition for Lustre* Software
Learn about Intel® HPC Distribution for Apache Hadoop* with Lustre*.
Intel® Solutions for Lustre* Software - Brent Gorda
An introduction video from Brent Gorda, General Manager of Intel’s High Performance Data Division
Welcome to the Intel® Lustre* Reseller Portal
Brent Gorda, General Manager of Intel's High Performance Data Division, welcomes resellers to the Lustre Portal