HPC in the Cloud: A Game-Changing Day for Cloud and HPC

Dedicated to Covering Enterprise & Scientific Large Scale Cloud Computing

HPC in the Cloud >> Blogs

Blog: Behind the Cloud

July 13, 2010

A Game-Changing Day for Cloud and HPC

On Monday the news was abuzz with word from the Microsoft Partner Conference—tales of its various partnerships to enhance its Azure cloud offering were proliferating, complete with the requisite surprises and some items that dropped off the radar as soon as I heard them given our HPC focus. Monday night, I went to bed comforted by the notion that when I would wake up on Tuesday, for once I would have a predictable amount of news coming directly from the Redmond camp. I wasn’t sure what partnerships they would declare or how they planned on bringing their private cloud in a box offering to real users, but I knew that I would be writing about them in one way or another.

Little did I know that the Tuesday news I was expected didn’t surface at all and in its place,this remarkable announcement from Amazon about its HPC-tailored offering, which they (rather clunkily) dubbed “Cluster Compute Instances” --(which is thankfully already being abbreviated CCI).

I almost fell off my chair.

Then I think I started to get a little giddy. Because this means that it’s showtime. Cloud services providers, private and public cloud purveyors—everyone needs to start upping their game from here on out, at least as far as attracting HPC users goes. If I recall, Microsoft at one point noted that HPC was a big part of their market base—a surprise, of course, but it’s clear that this new instance type (that makes it sound so non-newsy, just calling it another new instance type) is set to change things. Exciting stuff, folks.

As you can probably tell from this little stream of consciousness ramble, this release today turned my little world on its head, I must admit. I hate to be too self-referential, but man, I wish I could back now and rewrite some elements of a few articles that have appeared on the site where I directly question the viability of the public cloud for a large number of HPC applications in the near future, including those that invoke the term “MPI”—Actually though, it’s not necessarily me saying these things, it’s a host of interviewees as well. The consensus just seemed to be, Amazon is promising and does work well for some of our applications but once we step beyond that, there are too many performance issues for it to be a viable alternative. Yet. Because almost everyone added that “yet” caveat.

I did not expect to see news like this in the course of this year. I clapped my hands like a little girl when I read the news (which was after I almost fell off my chair). It is exciting because it means big changes in this space from here on out. Everyone will need to step up their game to deliver on a much-given promise of supercomputing for the masses. This means ramped up development from everyone, and what is more exciting that a competitive kick in the behind to get the summer rolling again in high gear on the news-of-progress front?

Microsoft’s news was drowned out today—and I do wonder about the timing of Amazon’s release. Did Amazon really, seriously time this with Redmond’s conference where they’d be breaking big news? Or was the timing of this release a coincidence? This one gets me—and no one has answered my question yet about this from Amazon. What am I thinking though; if I ask a question like that I get a response that is veiled marketing stuff anyway like, “we so firmly believed that the time is now to deliver our product to our customers—just for them. Today. For no other reason than that we’re just super excited.”

We’re going to be talking about this in the coming week. We need to gauge the impact on HPC—both the user and vendor sides, and we also need to get a feel for what possibilities this opens up, especially now that there is a new player on the field who, unlike the boatload of vendors in the space now, already probably has all of our credit card numbers and personal info. How handy.

Posted by Nicole Hemsoth - July 13 @ 11:49PM, Eastern Daylight Time

(Digg, Technorati, more)

Discussion

There are 0 discussion items posted.

Nicole Hemsoth

Nicole Hemsoth is the managing editor of HPC in the Cloud and will discuss a range of overarching issues related to HPC-specific cloud topics in posts, which will appear several times per week in Behind the Cloud.

More Nicole Hemsoth

Feature Articles

On Par for 2 Billion: 3PAR Discusses Cloud Strategy

Storage vendor 3PAR has been at the heart of an intense bidding war between HP and Dell due to its unique refinements and developments in virtualized storage platform concepts. Thin provisioning and a focus on the needs of large-scale enterprises and cloud providers have catapulted the company into the public eye but as 3PAR's Craig Nunes discusses with HPC in the Cloud, the cloud strategy has been consistent since 1999--even if the world is just taking notice now.
Read More...

Busting the "Cloud in a Box" Myth

The concept of private clouds is gaining traction and due to the buzz, more enterprises are taking a much closer look at the possibility—if they haven’t taken steps to virtualize some or all of their infrastructure already. For those who have not yet made the transition, a lack of understanding of the complex process behind private cloud implementation is at the core of hesitancy, therefore vendors are looking for ways to convince users to fear not, the private cloud is not only within reach—but simple to step into.
Read More...

Achieving Ultra High Performance in the Cloud

Companies in competitive domains, such as financial services, create large data repositories containing significant amounts of data collected from daily operations. Using supercomputers to analyze these massive datasets might yield the highest level of performance, but this is prohibitively expensive. Using proprietary, custom-built HPC atop cloud environments is also a viable option--although one that does come with a series of drawbacks that must be mitigated to achieve critical performance levels.
Read More...

Read more HPC in the Cloud features...

Around the Web

Application Flexibility and the New Enterprise Architecture

Aug 31 | Application delivery strategies must be shaped with flexibility in mind as the number of platforms delivering core applications is bound to change with time. Since a greater number of devices and platforms are entering the infrastructure mix, those who do not adapt quickly face being locked into strategies that do not mesh well with new developments. Read more...

A Maturation Stage for Storage Virtualization

Aug 27 | Storage virtualization has been gaining momentum as it moves from concept to practice but some suggest the offerings in this realm have not matured sufficiently and require a longer maturation process before wider adoption occurs. Read more...

HP Seeks to Boost Cloud Service Automation Capability

Aug 27 | Although it was lost in the chaos of the 3PAR bidding war between, HP announced news that it acquired cloud service automation firm Stratavia to bolster its cloud management offering and further its strategy in the arena. Read more...

NASA CIO Weighs in on Nebula, Public Clouds

Aug 26 | In an interview from the NASA IT Summit last week, the agency's CIO, Linda Cureton weighs in on developments with Nebula platform and the adoption of the open source code by other agencies looking to the cloud. Read more...

Facing the Realities of Private Cloud Building

Aug 24 | While private clouds are getting far more attention than they received at the beginning of the cloud buzz boom, the realities of the complexities of actual building them--not to mention the financial and time investments--are often overlooked. Read more...

Read more headlines...

Featured Whitepapers

Increase IT Performance from the Enterprise to the Cloud with WAN Optimization

Aug 30 | | Enterprises face a paradox today: while workers become increasingly distributed, IT infrastructure is rapidly consolidating. Virtualization has made it possible to create consolidated, elastic pools.

Grid Computing in the Cloud White Paper

May 14 | | Empower business users, scientists and researchers with their own grid computing infrastructure in the cloud.

View the White Paper Library

Multimedia

Webcast: Storm Clouds - Security Issues in the Cloud and How to Address Them

This Webinar will highlight the four critical areas of concern when securing cloud infrastructure services and managed enterprise applications.

Webcast: Confronting HPC Cloud Computing Security Concerns

Escalating energy and operational costs of building and maintaining data centers are forcing enterprises to adopt cloud computing models. But are Infrastructure as a Service (IaaS) solutions like IBM's Computing on Demand (CoD) really cost effective? Join the discussion as industry experts discuss how you can exploit cloud computing for maximum ROI.