CERN openlab adds a new dimension to Grid computing

Geneva, Switzerland 5 July 2004. The CERN openlab for DataGrid applications, a partnership between CERN , the European Organization for Nuclear Research, and five leading IT companies – Enterasys Networks, HP, IBM, Intel and Oracle – has announced a series of server and storage technical results regarding the first global science Grid – the Large Hadron Collider Computing Grid project, LCG. The announcement was made at the recent annual sponsors meeting of the CERN openlab.

The openlab partners have demonstrated that a cluster of 40 HP servers running 64-bit Intel® Itanium® 2 processors can be successfully integrated with the LCG, which involves over 60 major scientific computing centres in Europe, North America and Asia. The openlab partners have also completed intensive testing of IBM’s SAN File System to demonstrate scale-out capabilities of the new storage software.

With this landmark addition of servers, the openlab partners have proven that the LCG, otherwise based on 32-bit processors, can be extended to a truly heterogeneous computing environment. This is crucial for the future evolution of this Grid, as it must grow rapidly in capacity and power to prepare for the tremendous data storage and analysis requirements of CERN’s Large Hadron Collider (LHC) project. The LHC is expected to produce some 15 petabytes of data per year after it is switched on in 2007. Thousands of physicists will sift through this data for years to come, analysing it for tell-tale signs of new fundamental particles that will provide insights into the early origins of our Universe.

The CERN openlab, a three-year industrial cooperation formally launched in January 2003, marked its halfway mark at the annual sponsors meeting on June 22nd, and has already tallied a number of impressive technical results. Together, the partners have built the CERN opencluster, a state-of-the-art system for testing prototype Grid applications of increasing power and functionality. The open, collaborative environment of the partnership places an emphasis on a common development programme for data-intensive Grid computing based on open standards. This includes a 28 terabyte high-end storage system and advanced storage management software, supplied by IBM, state-of-the-art switching and routing equipment from Enterasys Networks, and the advanced, grid-enabled Oracle® Database 10g.

CERN’s Director General, Dr. Robert Aymar, described the contribution of the CERN openlab as being of crucial importance to the LHC project. Looking ahead, he noted that “The CERN openlab provides a role model for how CERN and its academic partners may in future wish to organise collaboration between the private and public sector, in order to develop the many new technologies that will surely be needed for endeavours beyond the LHC. As the results so far show, CERN openlab has effectively established a framework for collaboration between multiple industrial partners, in a pre-competitive spirit and based on open standards.”

Other key results obtained with the CERN opencluster include a data challenge where storage-to-tape rates of over 1GB/s were maintained for hours, corresponding to the maximum rates at which data from the LHC will need to be stored to a primary tape backup. The high-speed switching environment sponsored by Enterasys Networks played a crucial role in that result. Also, some of the HP server nodes with Intel Itanium® 2 dual processors contributed to the Internet-2 landspeed record that was set last October by CERN and partner Caltech, during Telecom 2, which demonstrated the rate – more than 1 terabyte in 30 minutes – at which data from the LHC will need to be distributed to the LCG’s so-called Tier-1 centres around the globe, for local storage and analysis.

Additionally, the researchers completed breakthrough testing on IBM’s Storage Tank™ storage management technology, which is used in IBM’s latest storage software product the IBM TotalStorage® SAN File System. The software is designed without inherent limitations on the amount of storage that can be supported. The project recently managed more than 100 simultaneous SAN File System clients and over 28 terabytes of storage distributed among 10 storage servers. These tests measured data rates exceeding the initial expectations from CERN.

Recently, Oracle-sponsored researchers in the CERN openlab managed to increase the availability of CERN’s grid computing environment by significantly reducing downtime of its catalogue, whose job is to ensure correct mapping of filenames and file IDs and identified a way to upgrade an Oracle database from one release to another whilst keeping the database operational. Both results represent new ways to use existing technology to address the challenges of grid-based computing.

The original press release can be found here.

Related stories:

Digital preservation: Alliance set to tackle science's new frontier
A new digital divide, or rather chasm, is opening up in the scientific enterprise, and something urgently needs to be done to prevent data from being lost into oblivion At the Second International Conference on Permanent Access to the Records of Science held in Brussels on the 15th November, the Alliance for Permanent Access, a group of stakeholders dedicated to preserving digital science records, was launched to do just that.
New Chicago-Indiana computer network prepared to handle massive data flow
Massive quantities of data will soon begin flowing from the largest scientific instrument ever built into an international network of computer centers, including one operated jointly by the University of Chicago and Indiana University. The first phase of the Chicago-Indiana center, formally known as the MidWest Tier 2 Center, is now up and running, crunching test data in preparation for the real thing.
Physicists Set New Record for Network Data Transfer
An international team of physicists, computer scientists, and network engineers led by the California Institute of Technology, CERN, and the University of Michigan and partners at the University of Florida and Vanderbilt, as well as participants from Brazil (Rio de Janeiro State University, UERJ, and the State Universities of São Paulo, USP and UNESP) and Korea (Kyungpook National University, KISTI) joined forces to set new records for sustained data transfer between storage systems during the SuperComputing 2006 (SC06) Bandwidth Challenge (BWC).
NICADD scientists develop detector technology for International Linear Collider
Scientists at the Northern Illinois Center for Accelerator and Detector Development (NICADD) are celebrating the successful run of a prototype sub-detector for the proposed International Linear Collider (ILC).
Open Science Grid receives $30 million award
Scientists on the track to discovery got good news this month when a powerful computing tool received critical government funding. A five-year, $30 million award to the Open Science Grid Consortium, announced by the National Science Foundation and the U.S. Department of Energy's Office of Science, will operate and expand the Open Science Grid, a computing environment used by scientists to harness computing resources and scientific data from around the world.
Record-breaking luminosity boosts discovery potential at Fermilab's Tevatron collider
The record-breaking performance of the Tevatron collider at the Department of Energy's Fermi National Accelerator Laboratory is pushing the search for dark matter, supersymmetric particles and extra dimensions to new limits. Repeatedly smashing peak luminosity records, the Tevatron has created record numbers of proton-antiproton collisions that provide the means to unveil the secrets of the universe.
'Maiden Flight' for LHC Computing Grid Breaks Gigabyte-per-Second Barrier
UK physicists have successfully taken part in a challenge to test an international scientific computing Grid under working conditions. During the week-long challenge, the LHC Computing Grid sustained transfer rates of a gigabyte per second. - a world first for a permanent, international Grid using scientific data.
High energy physics team captures network prize
Researchers from the U.S. Department of Energy's Fermi National Accelerator Laboratory and Stanford Linear Accelerator Center recently joined an international team in shattering the world network speed record. To capture first place in the SC|05 Bandwidth Challenge, the team of high energy physicists, computer scientists and network engineers led by the California Institute of Technology transferred physics data at a rate of over 150 gigabits per second--equivalent to downloading over 130 DVD movies in one minute.

News discussion:

Technology news