The world's smallest , yet fastest supercomputer to be built

Red Storm will be faster, yet smaller and less expensive, than previous supercomputers, say researchers at the National Nuclear Security Administration’s Sandia National Laboratories, where the machine will be assembled.

The first quarter of the $90 million, 41.5 teraflops (trillion operations/second) machine should be installed at Sandia by the end of September and fully up and running by January, says Bill Camp (Sandia’s Director of Computation, Computers, Information and Mathematics), who heads the effort to design and assemble the innovative machine.

Performance testing will begin in early 2005. By the end of 2005, the machine should be capable of 100 teraflops, after each single-processor chip is replaced with a new chip that contains two independent processors, each running 25 percent faster than the original chip.

Japan’s Earth Simulator, currently the world’s fastest supercomputer, has a peak eight megawatts of power compared to Red Storm’s projected two megawatts and takes up approximately three times the space.

Red Storm, an air-cooled supercomputer, is being developed by Sandia and Cray Inc. using mostly off-the-shelf parts.

Design innovations permit the machine, from concept to assembly, to be completed with unusual rapidity. While manufacturers typically require four to seven years from concept to first product on a new supercomputer, Cray says Red Storm will begin testing at Sandia less than 30 months after conceptual work began.

The main purpose of the machine is work for the U.S. nuclear stockpile: designing new components; virtually testing components under hostile, abnormal, and normal conditions; and helping in weapons engineering and weapons physics. The machine is expected to run ten times as fast as Sandia’s ASCI Red computer system on Sandia’s important application codes. (ASCI Red held first place on the top-500 list of the world’s supercomputers for three-and-one-half consecutive years.)

But the machine, because of its uniquely inexpensive design, may become the center of Cray’s future supercomputer line, says Camp. “From Cray’s point of view, the approach we’re pioneering here is so powerful they may want their next supercomputers to follow suit.”

The machine has unique characteristics: it is scalable from a single cabinet (96 processors) to approximately 300 cabinets (30,000 processors). In addition, the system was designed with a unique capability to monitor and manage itself. Much of the cost incurred for the machine is non-recurring engineering design costs.

“We couldn’t afford a ‘Rolls Royce’ — an entirely custom-designed machine,” says Camp. “The way Red Storm is designed, we don’t have to shut down to replace a part. We work around failed components until we decide to fix them — all without shutting down.”

Cray was chosen because the company was “forward-looking, flexible, willing to work with us to design a new architecture, and had the lowest cost proposal.”

The machine itself — a few facts
The machine has 96 processors in each computer cabinet, with four processors to a board. Each processor can have up to eight gigabytes of memory sitting next to it. Four Cray SeaStars — powerful networking chips — sit on a daughter board atop each processor board. All SeaStars talk to each other “like a Rubik cube with lots of squares on each face,” says Camp. “Cray SeaStars are about a factor of five faster than any current competing capability.”

Messages encoded in MPI (the Message Passage Interface standard) move from processor to processor at a sustained speed of 4.5 gigabytes per second bidirectionally. The amount of time to get the first information bit from one processor to another is less than 5 microseconds across the system. The machine is arranged in four rows of cabinets. There are a total of 11,648 Opteron processors and a similar number of SeaStars.

The SeaStar chip includes an 800 MHz DDR Hypertransport interface to its Opteron processor, a PowerPC core for handling message-passing chores, and a seven-port router (six external ports). SeaStars are linked together to make up the system¹s 3-D (X-Y-Z axis) mesh interconnect.

IBM is fabricating the SeaStar chips using 0.13-micron CMOS technology. Visualization will occur inside the computer itself — a capability unique to Red Storm among supercomputers.

Related stories:

1 million trillion 'flops' per second targeted by new Institute for Advanced Architectures
Preparing groundwork for an exascale computer is the mission of the new Institute for Advanced Architectures, launched jointly at Sandia and Oak Ridge national laboratories.
Red Hat to Build a Virtual Appliance OS
The open-source solutions provider has partnered with Intel Corp. to deploy appliances in a virtual machine to bring enterprise-class management and security to the PC.
Virtual Iron's Server Virtualization Is Ironclad
Virtual Iron Software's Virtual Iron builds on the Xen hypervisor and other open-source components to form an effective virtualization solution with a price tag low enough to keep market leader VMware on its toes.
Red Storm upgrade lifts Sandia supercomputer to 2nd in world, but 1st in scalability, say researchers
A $15 million upgrade to Sandia’s Red Storm computer has increased its peak speed from 41.5 to 124.4 teraflops in a computing terrain in which a single teraflop was a big deal only 6 years ago.
Sandia-designed supercomputer ranked world's most efficient in two of six categories
A new series of measurements -- the next step in evolution of criteria to determine more accurately the efficiency of supercomputers -- has rated Sandia National Laboratories' Red Storm computer the best in the world in two of six new categories, and very high in two other important categories.
IBM Announces POWER5 Server for Entry-Level Unix Segment
IBM today announced it will offer the latest in a new series of aggressively priced IBM POWER5(TM) processor-based servers. The new IBM eServer(TM) p5 510 is designed to bring impressive POWER5 performance and advanced virtualization capabilities to an entry level UNIX® and Linux® server, making POWER5 affordable for every small and medium business.

Red Flag Delivers First Commercial Version Of Linux Compiled With Intel Compiler
Intel Corporation and Red Flag Software Co., Ltd, today announced that Red Flag is the first company to use the Intel® C++ Compiler 8.0 for Linux* to compile a commercial version of its Linux operating system. Red Flag used Intel's tools to optimize its Red Flag Server 4.1 series products. Red Flag will include 60-day evaluation copies of the Intel Compiler in its distribution to enable customers to use the tool to optimize their own applications.
20 TFlops Supercomputer to be Built by IBM for U.S. military, Sandia and Cray Inc. building 100TFlops Machine
Red Storm, an air-cooled supercomputer, is being developed by Sandia and Cray Inc. By the end of 2005, the machine should be capable of 100 teraflops. At the same time, IBM announced that the Department of Defense (DoD) has selected new high-performance computing (HPC) systems from IBM for deployment at the Naval Oceanographic Office (NAVOCEANO) Major Shared Resource Center (MSRC) that, when deployed, are expected to include the fastest supercomputer in the US military, and one of the fastest supercomputing clusters in the world.

News discussion:

Technology news