Intel HPC Job Bank
HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Blog: Behind the Cloud

High Hopes: Live from Storage Visions 2011


It’s January 4th and I find myself in Las Vegas at Storage Visions 2011, a small but well focused event, as a run up to CES 2011, which is perhaps the biggest technology shindig on the planet.

This is a two day event and I expect the second day will not eclipse today, (and by the way, there was a partial eclipse today—a real one) given the energy of the opening moments.

Sessions opened with panel on bridging the gap between professional and consumer content creation.  This was mainly a vendor session with seven speakers/panelists, only one of which was a non-vendor.

It would have been nice to have heard more real users, both professional and consumer, but oh well, as we all know (gasp!) the Voice of the Customer is critical.  My take is simple: the professional needs of the entertainment industry dwarfs anything consumers can even imagine.  Moviemakers, for example, have petabytes of data with real performance issues, real reliability issues and driving need to make money by controlling costs.

The analyst panel was lackluster; I would have like to hear some real controversy and debate on HDD under attack by SSD.  Basically the market is growing year over year and even though SSDs are increasing at an enormous rate the cost per gigabyte will still rule. 

There was plenty of discussion around storage and cloud computing. The most persistent question, “will Apple TV take over the world?” proved to be great fodder.  Now they do not mean Apple TV, mind you, but rather that Apple TV streams data directly to the ‘cloud’ as there is no HDD inside Apple TV. 

There is no doubt that streaming to and from storage in the cloud is happening and will grow.  Another model is Netflix, with streaming data and watching it flow in real-time - look no HDD needed. However, there is a critical piece to making this happen--access to real high speed Internet.  If you do not have a true high-speed connection you will be disappointed.  In this model real-time becomes downloading to local storage and play back; all the benefits of streaming technology are gone.  It is all about latency and bandwidth as consumers few of us have access to either.

In addition to the speaking and panel events there is a small exhibit with about three-dozen vendors pedaling their wares.  Exhibitors include household names such as Hitachi, Toshiba, Intel and Oracle together with high profile younger companies such as Nimbus Data, Distributed Data Networks, SugarSync and Virident Systems.

Despite the huge installed base of HDDs, Solid-state Storage vendors or traditional HDD vendor with SSD products are on the rise and clearly evident.  Price of SSD per gigabyte will continue to tumble, increasing the attractiveness of this technology, but it will never cheaper than magnetic media.  At least in my lifetime.   Intel, Toshiba and Virident are examples of this trending toward SSD for the consumer and in Virident’s case the high performance enterprise market space where the need for reliability and huge bandwidth and IOPS are the name of the game.

Day one is almost over, cocktails courtesy of Oracle coming up next.  Which is why I’m writing this now.

Tomorrow’s another day.

 

Posted by Steve Campbell - January 05, 2011 @ 5:53 AM, Pacific Standard Time

Steve Campbell

Steve Campbell

An HPC industry consultant and cloud evangelist, Steve Campbell is a seasoned senior HPC executive.

More Steve Campbell


Recent Comments

No Recent Blog Comments

Feature Articles

SLA-Aware Scheduling and Virtual Efficiency

Researchers from the Suddhananda Engineering and Research Centre in Bhubaneswar, India developed a job scheduling system, which they call Service Level Agreement (SLA) scheduling, that is meant to achieve acceptable methods of resource provisioning similar to that of potential in-house systems. They combined that with an on-demand resource provisioner to ensure utilization optimization of virtual machines.
Read more...

CloudSigma CEO Elaborates on Science Cloud

Experimental scientific HPC applications are continually being moved to the cloud, as covered here in several capacities over the last couple of weeks. Included in that rundown, Co-founder and CEO of CloudSigma Robert Jenkins penned an article for HPC in the Cloud where he discussed the emergence of cloud technologies to supplement research capabilities of big scientific initiatives like CERN and ESA (the European Space Agency)...
Read more...

Examining Questions of Virtualization and Security in the Cloud

When considering moving excess or experimental HPC applications to a cloud environment, there will always be obstacles. Were that not the case, the cost effectiveness of cloud-based HPC would rule the high performance landscape. Jonathan Stewart Ward and Adam Barker of the University of St. Andrews produced an intriguing report on the state of cloud computing, paying a significant amount of attention to the problems facing cloud computing.
Read more...

Short Takes

Datapipe and Verne Global's Green Cloud

Jun 17, 2013 | With that in mind, Datapipe hopes to establish themselves as a green-savvy HPC cloud provider with their recently announced Stratosphere platform. Datapipe markets Stratosphere as a green HPC cloud service and in doing so partnering with Verne Global and their Icelandic datacenter, which is known for its propensity in green computing.
Read more...

IBM's Guide to Cloud Based HPC

Jun 12, 2013 | Cloud computing is gaining ground in utilization by mid-sized institutions who are looking to expand their experimental high performance computing resources. As such, IBM released what they call Redbooks, in part to assist institutions’ movement of high performance computing applications to the cloud.
Read more...

OpenStack and the SDSC Research Cloud

Jun 06, 2013 | The San Diego Supercomputer Center launched a public cloud system for universities in the area designed specifically to run on commodity hardware with high performance solid-state drives. The center, which currently holds 5.5 PB of raw storage, is open to educational and research users in the University of California.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Blogs by Topics

Blogs by Author

HPC Blogroll


Featured Events




  • November 17, 2013 - November 22, 2013
    SC'13
    Denver, CO
    United States


HPC in the Cloud Conferences & Events