HPC in the Cloud: The Big Data/Cloud Symbiosis

Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Translation Disclaimer

Subscribe | Sign In

Tabor Communications
Corporate Video

Top News from Leading HPC in the Cloud Solution Providers

March 24, 2011

The Big Data/Cloud Symbiosis

Nicole Hemsoth

During GigaOm’s Structure event, which connects those in the ever-widening field of big data, CA Technologies’ CTO and EVP, Donald Ferguson made the statement that the drive toward big data could spur massive cloud growth.

As Derrick Harris reported, the CA CTO imagines that “because many organizations’ big data jobs are still batch-oriented and relatively variable in terms of frequency, they’re ideal workloads to run in the cloud, which lets users rent out computing capacity by the hour rather than investing heavily in expensive hardware to meet only their peak needs.”

On the other side of the coin, Ferguson also suggested that there is a symbiotic relationship playing out between big data and cloud developments. On the one hand, while big data workloads can be a prime fit for cloud computing, clouds themselves are making the possibilities of big data within closer reach.

Ferguson argues that this is in part because “the ideal of having large amounts of data available in the cloud and accessible via an API makes it far easier for organizations—specifically their end users-to run jobs they never would have been able to without calling it IT.

Harris speculated that while it’s difficult to draw firm conclusions about how the two movements have an impact on one another, the fact that Ferguson claimed that many of their customers are formulating big data strategies could be a big indicator about this symbiosis.

Full story at GigaOm

RSS Feeds

Feeds by Topic

Feeds by Content Type

Feature Articles

CERN, Google, and the Future of Global Science Initiatives

Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...

Avoiding Scientific Computing Bottlenecks in the Cloud

Frank Ding, engineering analysis & technical computing manager at Simpson Strong-Tie, discussed the advantages of utilizing the cloud for occasional scientific computing, identified the obstacles to doing so, and proposed workarounds to some of those obstacles.
Read more...

Overcoming the Cloud Security Barrier for Financial Services

The private industry least likely to adopt public cloud services for data storage are financial institutions. Holding the most sensitive and heavily-regulated of data types, personal financial information, banks and similar institutions are mostly moving towards private cloud services – and doing so at great cost.
Read more...

Read more HPC in the Cloud features...

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.