The most powerful Sun technology-based computer in Europe is now online. The new Julich Supercomputer Center is supported by 2208 node Sun Constellation System and Sun Blade X6275 server modules.

The Sun Constellation Systems operate with Intel Xeon processor 5570 series and communicate with each other via six newly developed "Project M9" InfiniBand switches from Sun that supply quad data rate (QDR) and up to 648 ports while slashing the amount of complex cabling required. Like the Sun Constellation System, the QDR InfiniBand switches are part of Sun's open PetaFLOP architecture, a package of integrated components for HPC applications.

Marc Hamilton, Sun VP of Americas Systems Practice, explains:

"One unique feature the Julich system is its InfiniBand fabric using Sun and Mellanox QDR switches. Besides the 2000 node Sun Constellation System using Sun Magnum QDR switches, the Julich QDR fabric also supports a 1000 node Bull cluster using Mellanox QDR switches. While both the Sun and Bull supercomputers are built out of 2-socket Intel Nehalem compute nodes, the physical size and complexity of the systems stands in stark contrast. Using regular 4x IB cables to connect to the Mellanox switches, the Bull cluster, while only half the number of compute nodes, requires more cables than the Sun Constellation System with its 3-in-1 12x cables. In addition, the Sun Constellation System racks require no internal cables to connect the compute nodes to its built-in 'QNEM', the world's first in-chassis QDR leaf switch. While most Sun Constellation Systems use the QNEM to build a fully connected 'fat tree' IB fabric, the QNEM also supports mesh and 3D Torus IB fabrics, the latter being used at a Sun Constellation System being deployed at Sandia National Labs in the US.

Bull does a good job of packing 72 of their Nehalem compute nodes into a single rack, but counting their IB racks still requires almost 2x the floorspace of the Sun Constellation System sporting 96 compute nodes in each rack."

Other Sun solutions at work in Julich include:

• Sun Lustre Storage System, which is directly connected to the Julich system's InfiniBand network. It uses multiple Lustre Object Storage Servers (OSS) to provide high speed and parallel access to large single namespace filesystem easily expandable to PetaBytes of storage and 10's or even 100's of GB/sec of storage bandwidth. Currently, the Lustre parallel file system is installed on 14 Sun storage servers, which has a current total capacity of 500 terabytes.

• Sun Cooling Door for the Sun Constellation System. Sun Constellation System racks can require 30-40 KW of cooling per rack depending upon exact CPU and memory configuration.

More Information

Supercomputing by Julich

Julich web site

Sun Constellation System

Sun Lustre Storage System Datasheet

Sun Lustre Storage System Product Page

Sun Cooling Door Systems

Sun Cooling Door 5600

Sun Cooling Door Systems

Sun High Performance Computing - Overview

Sun High Performance Computing - Software

Europe\'s largest supercomputer [...read more...]

		fullsource
Print Email Current Profile Archive Blog Generate newsletter

Other articles in the HPC section of Volume 136, Issue 2: Sun BluePrints: "Sun's High Performance Computing Reference Architecture" New Julich Supercomputer Center and its 2000 Node Sun Constellation System (this article) See all archived articles in the HPC section.

Top 10 Most Popular Articles in Current Issue (Vol 167, Issue 4) Simplified Administration with ZFS Documentation for Common Sysadmin Tasks Solaris 10 OS and ZFS Cut Costs, Boost Uptime as Alternative to RAID Oracle Certified Associate (OCA), Oracle Solaris 11 System Administrator MySQL: An Introduction for Oracle DBAs illumos Meetup at FOSDEM Linux Adoption Trends 2012: A Survey of Enterprise End Users MySQL 5.0 and 5.1 available on Solaris 11 World Record x86 TPC-C Result Java Spotlight Episode 65: Deployment & Plugin Recent Blog Entries as of February 4, 2012, 9:26 am Oracle Enterprise Manager Enables Cerner Health Care to Cut Capital Expenditures by $9.5 Million Beefing Up Xeon Reliability, Availability, and Serviceability: Slide Set Java Spotlight Episode 54: Stuart Marks on the Coinification of JDK7 Getting PostgreSQL HA to Work in vFabric Data Director November 9th, Oracle Solaris 11 Launch, New York City The [System] Developer's Edge: 322 page pdf Oracle Global IT Upgrades to Sun Storage Products UNIX - Dead or alive? LibreOffice Adopts ODF 1.2 as an OASIS Standard The Growth Prospects for Tape vs. HDD and NAND as a Storage Devices Blog RSS Feed