December 08, 2011
NSF-funded ExoGENI project will enable scientists to test and evaluate networking infrastructure for the future Internet
CHAPEL HILL, NC, Dec. 8 — RENCI at the University of North Carolina, Chapel Hill and Duke University in partnership with IBM will lead a new project to build a nationwide test bed for networking and networked cloud computing.
The project is part of the National Science Foundation's Global Environment for Network Innovation (GENI) initiative, which enables researchers to explore networks of the future.
The NSF awarded just over $2 million to the three-year ExoGENI project, led by Ilia Baldine, director of RENCI's networking research group and Jeff Chase, a Duke University computer science professor.
The project will deploy and operate 13 ExoGENI sites at research universities and labs across the U.S. The project will use software based on the Open Resource Control Architecture (ORCA) to control the networked cloud infrastructure. The project team developed the ORCA platform in earlier NSF-funded research and extended it for use in the GENI initiative.
Each ExoGENI site will receive a rack of equipment with multiple IBM x3650 servers featuring dual socket Intel Westmere and Sandy Bridge CPUs, each with 6 to 8 cores and 48 gigabytes of RAM. The sites will connect to a variety of advanced research networks offering dynamic circuit capabilities and programmable control.
ExoGENI sites in North Carolina's Research Triangle area will connect to each other using RENCI's Breakable Experimental Network (BEN), a networking test bed that links RENCI, Duke, NC State University and UNC-Chapel Hill. The sites will link to national research networks such as National Lambda Rail (NLR), Internet2 and the Department of Energy's Energy Sciences Network (ESnet).
The ORCA control software will enable experimenters to construct on demand private virtual networks spanning these research networks and ExoGENI sites. ExoGENI racks will use OpenFlow-enabled switches to link to OpenFlow-enabled campus infrastructures and national networks. OpenFlow technology separates a network switch's packet forwarding, or data, path from its high-level routing decisions, or control path, thereby allowing researchers to easily deploy innovative routing and switching protocols.
When all the hardware is operational and all the sites are connected, ExoGENI will operate as a networked cloud infrastructure — a virtual laboratory for networking and computer science experiments that will help researchers advance the development of a faster, smarter and more reliable Internet, said Baldine.
"Future computer science and applied research must bring together computation, storage and network capabilities on a global scale to address emerging complex problems related to network science, large-scale distributed computations, large dataset mobility and future network architectures," said Baldine. "With ExoGENI researchers will gain a global, elastic reconfigurable platform to conduct such research."
ExoGENI will support a variety of experiments that will create network topologies consisting of nodes allocated from ExoGENI sites tied together with network connections that will be provisioned based on the bandwidth needed for the experiment. ExoGENI will support using custom kernels to experiment with different network protocols. To support research into high-speed protocols, some ExoGENI sites will be capable of transferring data at 10 gigabits per second (Gbp/s) and in the future at 40 Gbp/s and 100 Gbp/s.
Using ExoGENI, researchers will be able to allocate private networks spanning the continental U.S., allocate computing clusters and storage for use by scientists who collect and analyze data, and tie these experimental resources to production networks, devices or instruments. Because ExoGENI will interact with other networking and compute resources assembled through the GENI initiative, researchers will be able to create more powerful assemblies, or slices, of linked resources that include wireless, mobile and sensor networks.
In addition, ExoGENI will serve as a test environment for a global federated cloud infrastructure that can reconfigure collections of linked computational resources as needed and bring together diverse resources from multiple cloud providers. Such an environment could someday replace typical institutional computational resources, which today exist in a single lab or datacenter.
ExoGENI sites will be deployed over the course of the next 18-24 months and the facility will begin operation as soon as the first sites are deployed. The first four sites will be operational before the end of September 2012.
Researchers from the Suddhananda Engineering and Research Centre in Bhubaneswar, India developed a job scheduling system, which they call Service Level Agreement (SLA) scheduling, that is meant to achieve acceptable methods of resource provisioning similar to that of potential in-house systems. They combined that with an on-demand resource provisioner to ensure utilization optimization of virtual machines.
Experimental scientific HPC applications are continually being moved to the cloud, as covered here in several capacities over the last couple of weeks. Included in that rundown, Co-founder and CEO of CloudSigma Robert Jenkins penned an article for HPC in the Cloud where he discussed the emergence of cloud technologies to supplement research capabilities of big scientific initiatives like CERN and ESA (the European Space Agency)...
When considering moving excess or experimental HPC applications to a cloud environment, there will always be obstacles. Were that not the case, the cost effectiveness of cloud-based HPC would rule the high performance landscape. Jonathan Stewart Ward and Adam Barker of the University of St. Andrews produced an intriguing report on the state of cloud computing, paying a significant amount of attention to the problems facing cloud computing.
Jun 19, 2013 |
Ruan Pethiyagoda, Cameron Boehmer, John S. Dvorak, and Tim Sze, trained at San Francisco’s Hack Reactor, an institute designed for intense fast paced learning of programming, put together a program based on the N-Queens algorithm designed by the University of Cambridge’s Martin Richards, and modified it to run in parallel across multiple machines.
Jun 17, 2013 |
With that in mind, Datapipe hopes to establish themselves as a green-savvy HPC cloud provider with their recently announced Stratosphere platform. Datapipe markets Stratosphere as a green HPC cloud service and in doing so partnering with Verne Global and their Icelandic datacenter, which is known for its propensity in green computing.
Jun 12, 2013 |
Cloud computing is gaining ground in utilization by mid-sized institutions who are looking to expand their experimental high performance computing resources. As such, IBM released what they call Redbooks, in part to assist institutions’ movement of high performance computing applications to the cloud.
Jun 06, 2013 |
The San Diego Supercomputer Center launched a public cloud system for universities in the area designed specifically to run on commodity hardware with high performance solid-state drives. The center, which currently holds 5.5 PB of raw storage, is open to educational and research users in the University of California.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.