HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Blog: The Essence of 'On-Demand'

Cloud Innovation Happens Outside Silicon Valley, Too


I'm heading to Toronto this weekend to be part of a panel on cloud computing at a conference called "Powering Innovation: A National Summit," co-sponsored by Canadian research networks CANARIE and ORION. Although my presentation will focus on the enterprise, the overall focus of the conference takes me back to the early focus of GRIDtoday -- and I think that's a good thing.

Just as the enterprise is struggling with cloud computing and how to best leverage its myriad benefits, so, too, is the research sector. And just like the research sector drove many advancements in grid computing, it wouldn't be shocking to me to see the same computer scientists driving comparable evolutions in cloud computing. In fact, some might say the TeraGrid, with its Science Gateways and associated Web portal, is a precursor to today's consumer-oriented cloud offerings (albeit a tad more rigid).

And just how, you ask, are a bunch of stodgy, old researchers and academicians going to effect change in a hip, Web 2.0-inspired paradigm like cloud computing? There are many reasons, actually, beginning with three biggies: (1) they’re smart; (2) they’re used to working together; and (3) they’re not as old as you might think.

First, the men and women at our national labs and universities have been responsible for just about every technology underlying cloud computing -- including grid computing, virtualization and the Internet -- so I’m not about to put anything past them. If they are putting their considerable brainpower to work thinking about cloud computing -- and something tells me they are (and here)-- good things are bound to follow. Prior to becoming CTO of Amazon and all but launching the cloud revolution, Werner Vogels was a research scientist at Cornell.

A big area of concern for enterprise users is the prospect of provider lock-in in the cloud, and the research sector should be able to help here, too. For starters, I know that cloud computing is on the Open Grid Forum’s radar, so it’s possible we could see some real work around cloud standards get underway relatively soon from the guys who brought us the HPC Basic Profile Specification. Although it won’t necessarily solve the problems of disparate APIs and databases, any progress on the standardization front is good news. Or maybe the world’s cloud providers could get together to work some of these things out. At any rate, a coming together of researchers, users and vendors under one banner or another could help ensure everybody’s best interests are considered as the cloud moves forward.

Government-funded grid computing initiatives like EGEE also are looking at how to both leverage and learn from cloud computing. This could have a big impact because the key to such projects is interoperability. I think a lot was learned as EGEE worked to get its network of grids to work together, and we all could benefit if they figure out a way to make that international grid network interoperate with large public clouds. The world of scientific grid computing thrives on worldwide collaborative efforts, and I think this experience can play a significant role in cloud interoperability, as well.

Finally, those folks behind the scenes at today’s Web companies -- including many of the founders -- are relatively young and only getting younger. If we look back, we might recall that a couple of the first shots in cloud computing war, if you will, were fired by Google and IBM, then by Yahoo, when they launched their respective cloud efforts within leading computer science universities. Mere teenagers, in some cases, will be exposed to the technologies that make the respective Web giants click, and by the time these 19-year-olds become grad students and Ph.D. candidates, they will be veterans in developing Web-scale applications and management software. It wouldn’t be surprising to see innovation coming directly out of the universities, from either students, researchers or their increasingly knowledgeable instructors. When these kids enter the workforce and have the R&D resources of someone like Google or Amazon at their disposal, forget about it.

Posted by Derrick Harris - October 30, 2008 @ 6:52 PM, Pacific Daylight Time

Derrick Harris

Derrick Harris

Derrick Harris is the Editor of On-Demand Enterprise

More Derrick Harris

Aspen

Recent Comments

No Recent Blog Comments

Feature Articles

CometCloud: Using a Federated HPC-Cloud to Understand Fluid Flow in Microchannels

The ever-growing complexity of scientific and engineering problems continues to pose new computational challenges. Thus, we present a novel federation model that enables end-users with the ability to aggregate heterogeneous resource scale problems. The feasibility of this federation model has been proven, in the context of the UberCloud HPC Experiment, by gathering the most comprehensive information to date on the effects of pillars on microfluid channel flow.
Read more...

CERN, Google, and the Future of Global Science Initiatives

Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...

Avoiding Scientific Computing Bottlenecks in the Cloud

Frank Ding, engineering analysis & technical computing manager at Simpson Strong-Tie, discussed the advantages of utilizing the cloud for occasional scientific computing, identified the obstacles to doing so, and proposed workarounds to some of those obstacles.
Read more...

Short Takes

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

In Support of Cloud-based Rendering

May 10, 2013 | Australian visual effects company, Animal Logic, is considering a move to the public cloud.
Read more...

Internet2 Awards Program Seeks Innovative Applications

May 10, 2013 | Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Blogs by Topics

Blogs by Author

HPC Blogroll

ISC

Featured Events



  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States




HPC in the Cloud Conferences & Events