HPC Job Bank
HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Hybrid Workflow Model at Heart of Tornado Research


Researchers examining how tornadoes form have turned into “twister chasers” rushing from site to site to get their equipment on the ground before the tornado hits. Their efforts are aimed at more accurately predicting when touchdown will occur to improve evacuation and warning, but this is, as one can imagine, quite a dangerous and troublesome process. Simply getting to the cell’s site at the right time is a challenge for the VORTEX2 group, thus other compute-based esearchers are looking to distributed computing to take on the challenge and reduce the complex of fieldwork.

The Center for Analysis and Prediction of Storms undertook a hybrid computing project called the “Linked Environments for Atmospheric Discovery II” (LEAD II) with the help of the Big Red cluster and Microsoft’s Azure to better predict tornado conditions and to aid in the advancement of VORTEX2 goals.

Although LEAD II is only a fraction of the larger VORTEX2 project, part of what makes it remarkable is that it signals the first use of a hybrid workflow model for the participants, which was created using Microsoft’s Trident Scientific Workflow Workbench to handle the front-end workflow system, which then doled out pieces of it to backend Unix and Linux-based resources, including Indiana University’s Big Red.

As LEAD II researcher Beth Plale explained, “A lot of scientists use Windows tools such as Excel…We think that utilizing a Windows workflow system on a Windows box is a step towards providing broader flexibility, because of this affinity of a lot of scientists to use Excel and because of the emergence of the cloud-based Azure platform.”

Overall, the team decided that the use of the hybrid workflow model for the project was a success due to the added flexibility it offered, not to mention a great exercise in experimenting with different models for use in future projects.


Full story at International Science Grid This Week

This Week's Headlines


Most Read Blogs

Intel

Feature Articles

SLA-Aware Scheduling and Virtual Efficiency

Researchers from the Suddhananda Engineering and Research Centre in Bhubaneswar, India developed a job scheduling system, which they call Service Level Agreement (SLA) scheduling, that is meant to achieve acceptable methods of resource provisioning similar to that of potential in-house systems. They combined that with an on-demand resource provisioner to ensure utilization optimization of virtual machines.
Read more...

CloudSigma CEO Elaborates on Science Cloud

Experimental scientific HPC applications are continually being moved to the cloud, as covered here in several capacities over the last couple of weeks. Included in that rundown, Co-founder and CEO of CloudSigma Robert Jenkins penned an article for HPC in the Cloud where he discussed the emergence of cloud technologies to supplement research capabilities of big scientific initiatives like CERN and ESA (the European Space Agency)...
Read more...

Examining Questions of Virtualization and Security in the Cloud

When considering moving excess or experimental HPC applications to a cloud environment, there will always be obstacles. Were that not the case, the cost effectiveness of cloud-based HPC would rule the high performance landscape. Jonathan Stewart Ward and Adam Barker of the University of St. Andrews produced an intriguing report on the state of cloud computing, paying a significant amount of attention to the problems facing cloud computing.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Newsletters

Stay informed! Subscribe to HPC in the Cloud email Newsletters.

HPC in the Cloud Update
HPCwire Weekly Update
Digital Manufacturing Report
Datanami
HPCwire Conferences & Events
Job Bank
HPCwire Product Showcases



HPC Job Bank


Featured Events




  • November 17, 2013 - November 22, 2013
    SC'13
    Denver, CO
    United States


HPC in the Cloud Conferences & Events