HPC in the Cloud: French Atomic Energy Group Expands HPC File System to 11 Petabytes

Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Translation Disclaimer

Subscribe | Sign In

January 25, 2012

French Atomic Energy Group Expands HPC File System to 11 Petabytes

BRUYERES-LE-CHATEL, France, Jan. 24 -- The Military Applications Department of the French Alternative Energies and Atomic Energy Commission (CEA/DAM) today announced that it doubled the capacity of its largest HPC production file system. With over 11 Petabytes of usable storage space, this Lustre v2 file system is one of the largest single namespace system ever deployed. A Petabyte (PB) is a quadrillion bytes, a thousand times more that today's current desktop computer storage space.

Starting in September 2010, the storage capacity has been gradually increased, to reach today 75% of TERA computing center's global Lustre storage space and bandwidth (200GB/s), a step forward to its final configuration of 15PB planned this year.

With 768 16TB Object Storage Targets (OST), TERA global file system consists in 70 bullx S6030 Lustre servers, a Voltaire InfiniBand QDR storage fabric and 89 NetApp (formerly LSI) E5400-60 disk arrays. Tera 100, Europe's first supercomputer to break the Petaflops barrier (http://www-hpc.cea.fr/docs/cp-Tera100-091110_VE1.pdf), and other ancillary systems such as post-processing clusters, mount this file system through more than 50 Lustre routers.

System administration

To optimize deployment time, availability and to simplify daily administration tasks, CEA engineers use a common set of open libraries and tools accross CEA's computing centers: TERA, TGCC and CCRT (http://www-hpc.cea.fr). Shine, an open-source Lustre administration tool developed at CEA, manages all Lustre components, allowing configuration of servers, routers and thousands of clients (http://lustre-shine.sourceforge.net).

Data workflow

With such a large amount of data, traditional tools usually used to scan and maintain a file system are notoriously inefficient. CEA developed Robinhood (http://robinhood.sourceforge.net), an open-source policy engine designed to address this specific issue. It uses Lustre MDT changelogs (a Lustre v2 feature) to update an internal database reflecting the file system state. CEA also actively contributes to Lustre development, with features such as OST pools, and is the main developer for the forthcoming Lustre-HSM binding feature (Lustre 2.x).

CEA also develops NFS-Ganesha (http://nfs-ganesha.sourceforge.net), a user-space NFS server capable of using the Lustre API to export very large file system to non Lustre clients, such as smaller systems or individual workstations.

About the CEA

The French Alternative Energies and Atomic Energy Commission (CEA) leads research, development and innovation in four main areas: low-carbon energy sources, global defense and security, information technologies and healthcare technologies. The CEA’s leadership position in the world of research is built on a cross-disciplinary culture of engineers and researchers, ideal for creating synergy between fundamental research and technology innovation. With its 15,600 researchers and collaborators, it has internationally recognized expertise in its areas of excellence and has developed many collaborations with national and international, academic and industrial partners.

Information about HPC at CEA can be found at http://www-hpc.cea.fr/index-en.htm

-----

Source: CEA

Share Options

Subscribe

Subscribe to HPC in the Cloud

Discussion

There are 0 discussion items posted.

Join the Discussion

Become a Registered User Today!

Registered Users Log in join the Discussion

RSS Feeds

Feeds by Topic

Feeds by Content Type

Subscribe to All Content

All

May 16, 2012

May 15, 2012

May 14, 2012

May 11, 2012

AWS, SAP Announce Certification of AWS Infrastructure for SAP Business All-in-One Solutions

May 10, 2012

May 09, 2012

May 08, 2012

May 07, 2012

Feature Articles

Cloud Services Satisfy a Higher Calling

Higher education involves many collaborative projects that lend themselves to cloud services, however often those services are not tailored to the uniqueness of an academic environment. That's where the Internet2 NET+ project comes in. By partnering with 16 major cloud providers, the networking consortium is seeking to expedite the delivery of cloud services and by doing so advance research and innovation in the United States.
Read more...

Univa CEO Gary Tyreman on the Evolution of HPC, Big Data and Cloud

It's been a little over a year since Univa took over stewardship of the open source workload manager and acquired the founding Sun Grid Engine team from Oracle, and the company just announced its third production release. CEO Gary Tyreman discusses the latest enhancements as well as the company's plans around cloud, big data and the enterprise.
Read more...

Read more HPC in the Cloud features...

Around the Web

Breaking the Cloud Barrier

May 15, 2012 | New Microsoft report shows that beyond the expected financial benefits, cloud services may offer more comprehensive security features compared to in-house IT operations.
Read more...

Vendors Demo Next-Gen Sequencing Platforms for Pharma

May 14, 2012 | During the second annual Pistoia Alliance conference, three teams demonstrated their newly-implemented cloud-based next-generation sequencing platforms.
Read more...

Zunicore Offers Bare Metal by the Hour

May 10, 2012 | PEER1's cloud division, Zunicore, will soon be offering GPU-equipped servers on-demand.
Read more...

US Cloud Providers Struggle With Data Privacy Laws

May 08, 2012 | The Patriot Act leads foreign governments to question the security of US cloud services.
Read more...

Genomic Data Gets Comfy in the Cloud

May 07, 2012 | Startup DNANexus is helping to bring personalized medicine to the masses with its cloud-based next-gen sequencing platform.
Read more...

Read more headlines...

Appro White Paper: Enabling Performance-per-Watt Gains in HPC

04/05/2012 | Appro | Designed to meet the growing global demand for HPC solutions, Appro's Xtreme-X™ Supercomputer delivers superior performance-per-watt and reduced I/O latency while bringing significant flexibility to HPC workload configurations including capacity, hybrid, data intensive and capability computing.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.