The Lustre Storage System, a clustered file system can remove high performance computing I/O bottlenecks created by increasing load. The Lustre Storage System takes front stage of the methods used for traditional CPU performance because of growing computing requirements by HPC clusters.

The Lustre file system can provide data access that goes beyond performance of huge storage devices. With shared file system access, the Lustre file system, a storage solution is created. According to the article authors of "Solving the HPC I/O Bottleneck: Sun Lustre Storage System", this helps to meet the high "aggregate I/O bandwidth" that is needed by HPC applications. These HPC clusters may serve enterprises such as manufacturing, electronic design, government, and research.

"The result is a simple-to-deploy parallel storage solution that delivers sustained performance ranging from a few GB/sec to over 100 GB/sec, capacity scaling to multiple petabytes, and a compelling price to performance ratio," the article states.

Several areas are addressed in this Lustre Storage System Blueprint, whose solution is based on Sun Fire Servers and Sun Open Storage platforms. This Blueprint provides the following for the Sun Lustre Files system: target environments, an overview of both the Lustre file system in general and the Lustre Storage System design considerations, which includes hardware and software components. Then finally, a performance evaluation is provided which gives details based on data used for this article.

Contents

• Solving the HPC I/O Bottleneck: Sun Lustre Storage System

• Target environments

• The Lustre file system
• Lustre file system design
• Sun and Open Storage

• Sun Lustre Storage System overview
• Design considerations
• Hardware components
• HA MDS module
• Standard OSS module
• HA OSS module
• Software components

• Performance evaluation
• HA OSS testing and results
• IOZone benchmark runs
• Sample IOzone benchmark output
• HA OSS benchmark configuration
• RAID and disk configuration
• Standard OSS testing and results
• IOzone benchmark runs
• IOzone benchmark output
• Standard OSS benchmark configuration
• Proven scalability at TACC

• Summary, About the authors, Acknowledgements, References, Ordering Sun documents, Accessing Sun documentation online

Sun BluePrint Authors

• Sean Cochrane, Global HPC Sales
• Ken Kutzer, HPC Marketing
• Lawrence McIntosh, Engineering Solutions Group

More Information

Solving the HPC I/O Bottleneck: Sun Lustre Storage System (Sun registration/login is required)

Sun Servers

Sun Server: Family Comparison Chart

Lustre File System: Demo Quick Start Guide

Sun Lustre On-site Implementation Services

Daimler Gets Scalable STAR-CD I/O with Lustre

Seventh Annual Lustre User Group Meeting - LUG \'09

Sun in the Open Source Storage Market

Sun HPC Cluster Slated for University of Zurich [...read more...]

		fullsource
Print Email Current Profile Archive Blog Generate newsletter