System News
   
News about Solaris and Sun Microsystems

Free 2 Week Trial!


June 9, 2009
Article #21900
Volume 136, Issue 2
Section: HPC

 

featuring 2,208 nodes supported by the Sun Constellation System and Sun Blade X6275 server modules
 


 

New Julich Supercomputer Center and its 2000 Node Sun Constellation System
One of the First Large QDR-based InfiniBand Supercomputers

The most powerful Sun technology-based computer in Europe is now online. The new Julich Supercomputer Center is supported by 2208 node Sun Constellation System and Sun Blade X6275 server modules.

The Sun Constellation Systems operate with Intel Xeon processor 5570 series and communicate with each other via six newly developed "Project M9" InfiniBand switches from Sun that supply quad data rate (QDR) and up to 648 ports while slashing the amount of complex cabling required. Like the Sun Constellation System, the QDR InfiniBand switches are part of Sun's open PetaFLOP architecture, a package of integrated components for HPC applications.

Marc Hamilton, Sun VP of Americas Systems Practice, explains:

"One unique feature the Julich system is its InfiniBand fabric using Sun and Mellanox QDR switches. Besides the 2000 node Sun Constellation System using Sun Magnum QDR switches, the Julich QDR fabric also supports a 1000 node Bull cluster using Mellanox QDR switches. While both the Sun and Bull supercomputers are built out of 2-socket Intel Nehalem compute nodes, the physical size and complexity of the systems stands in stark contrast. Using regular 4x IB cables to connect to the Mellanox switches, the Bull cluster, while only half the number of compute nodes, requires more cables than the Sun Constellation System with its 3-in-1 12x cables. In addition, the Sun Constellation System racks require no internal cables to connect the compute nodes to its built-in 'QNEM', the world's first in-chassis QDR leaf switch. While most Sun Constellation Systems use the QNEM to build a fully connected 'fat tree' IB fabric, the QNEM also supports mesh and 3D Torus IB fabrics, the latter being used at a Sun Constellation System being deployed at Sandia National Labs in the US.

Bull does a good job of packing 72 of their Nehalem compute nodes into a single rack, but counting their IB racks still requires almost 2x the floorspace of the Sun Constellation System sporting 96 compute nodes in each rack."

Other Sun solutions at work in Julich include:

  • Sun Lustre Storage System, which is directly connected to the Julich system's InfiniBand network. It uses multiple Lustre Object Storage Servers (OSS) to provide high speed and parallel access to large single namespace filesystem easily expandable to PetaBytes of storage and 10's or even 100's of GB/sec of storage bandwidth. Currently, the Lustre parallel file system is installed on 14 Sun storage servers, which has a current total capacity of 500 terabytes.

  • Sun Cooling Door for the Sun Constellation System. Sun Constellation System racks can require 30-40 KW of cooling per rack depending upon exact CPU and memory configuration.

More Information

Supercomputing by Julich

Julich web site

Sun Constellation System

Sun Lustre Storage System Datasheet

Sun Lustre Storage System Product Page

Sun Cooling Door Systems

Sun Cooling Door 5600

Sun Cooling Door Systems

Sun High Performance Computing - Overview

Sun High Performance Computing - Software

Europe\'s largest supercomputer [...read more...]

fullsource

Keywords:
Other articles in the HPC section of Volume 136, Issue 2:

See all archived articles in the HPC section.


From the latest issue:



 


Customized news reports about Sun Microsystems. Just the news you need, none of what you don't.
50,000+ Members. 20,000+ Articles Published since 1998.