Univa HPC Job Bank
HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Blog: The Essence of 'On-Demand'

Why Web 2.0 Needs Grid Computing


If one were asked to cite companies whose datacenters epitomize the idea of Grid 2.0, he could do a lot worse than to point to any of the Internet giants that have taken advantage of grid technologies to forever transform the ways in which we shop, access information and communicate, and address just about every other aspect of our lives.

Companies like Google, Yahoo!, Amazon and eBay set the standard because they are using their massive, distributed computing infrastructures to not only host applications and store data, but also to host countless services, both internal and external, and handle hundreds of millions to billions of transactions every single day -- in real time. It is for this reason that I am so pleased to have Paul Strong, the man spearheading eBay's current grid efforts, contributing this week's lead article. If there's one man who understands what it means to manage epic quantities of data and provide access to it in real-time across numerous applications and services, and across a vast network, it's Paul.

In his article, "Interesting Times for Distributed Datacenters," Strong takes on just this topic, discussing grid computing's expansion from being solely an HPC technology to being the basis for the distributed platforms necessary to make the Web 2.0 world run. If his assertion is correct, then I have to question every time I've read an analyst or "mainstream" IT columnist declare grid a promise unfulfilled and/or a technology that simply isn't mature enough to handle the big, scary world of commercial IT. Rather, it would seem that grid technologies, while not always possessing life-changing capabilities out of the box, are firmly entrenched among some of today's most important IT users -- and their grids, or whatever you want to call them, aren't going away anyime soon.

I'll finish my thoughts on this by giving a rather large excerpt from Strong's article, which sums up this idea far more succinctly than my attempt:

Historically, the term "grid computing" has been intimately associated with the high-performance and technical computing community. The term was, of course, coined by some leading members of that community and, unsurprisingly, to many it has been almost completely defined within the context of this specific type of use. Yet when you look closely at what grid computing actually is predicated upon, it becomes apparent that the notion of grid computing is far more universally applicable than perhaps many people think. Indeed, one could make the assertion that grids are the integrated platforms for all network-distributed applications or services, whether they are computationally or transactionally intensive.

In other news, last week saw the Open Grid Forum and the Enabling Grids for E- sciencE project co-locate their respective meetings in Manchester, England, drawing in more than 900 attendees. And although the combined conference didn't produce large amounts of news in the form of product announcements, vendor partnerships, etc., it did produce a little. If you check out our "Scientific Applications" section, you'll see three items -- "Full Speed Ahead for the Grid," "Science on the Grid -- Live" and "Users Set the Standard" -- from EGEE recapping various demonstrations and applications showcased over the course of the week. In addition, the OGF portion of the event should producing some news in the weeks/months to come, as organizational leadership planned to use OGF20 as an opportunity to conduct face-to-face interviews with the more-promising presidential candidates. It shouldn't be long now before we learn who will be replacing Mark Linesch come autumn.

Rounding out the issue, we have a slew of big announcements, including: EMC forming an information infrastructure research network; Appistry EAF supporting Spring; Oracle updating its Fusion Middleware; Lenovo joining the ranks of those using Callidus' Sun Grid-powered on-demand application; and WS- Transaction becoming an OASIS standard.

-----

Comments about GRIDtoday are welcomed and encouraged. Write to me, Derrick Harris, at editor@gridtoday.com.

Posted by Derrick Harris - May 14, 2007 @ 11:30 AM, Pacific Daylight Time

Derrick Harris

Derrick Harris

Derrick Harris is the Editor of On-Demand Enterprise

More Derrick Harris

Aspen

Recent Comments

No Recent Blog Comments

Feature Articles

CometCloud: Using a Federated HPC-Cloud to Understand Fluid Flow in Microchannels

The ever-growing complexity of scientific and engineering problems continues to pose new computational challenges. Thus, we present a novel federation model that enables end-users with the ability to aggregate heterogeneous resource scale problems. The feasibility of this federation model has been proven, in the context of the UberCloud HPC Experiment, by gathering the most comprehensive information to date on the effects of pillars on microfluid channel flow.
Read more...

CERN, Google, and the Future of Global Science Initiatives

Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...

Avoiding Scientific Computing Bottlenecks in the Cloud

Frank Ding, engineering analysis & technical computing manager at Simpson Strong-Tie, discussed the advantages of utilizing the cloud for occasional scientific computing, identified the obstacles to doing so, and proposed workarounds to some of those obstacles.
Read more...

Short Takes

NASA Builds 'Climate in a Box'

May 23, 2013 | The study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
Read more...

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Blogs by Topics

Blogs by Author

HPC Blogroll

ISC

Featured Events



  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States




HPC in the Cloud Conferences & Events