Univa HPC Job Bank
HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Globus Online Announces Big Data Sharing


Nov. 13 – Globus Online announced today a new file sharing service that makes it easy for researchers to securely share their data with collaborators. The sharing service builds on Globus Online’s reliable high-performance file transfer software-as-a-service (SaaS) and allows large data sets to be shared without requiring complex software or moving the data to expensive cloud storage.

Globus Online will enable data on existing storage systems to be easily shared with users at multiple institutions. The service will provide researchers complete control over which Globus Online users can access their data and the level of access that is permitted. It is currently undergoing final testing and will be made available in early 2013.

The service will utilize updated versions of Globus Connect and GridFTP to connect a storage system to the Globus Online cloud, and the same logical endpoint structure currently used by Globus Online for transferring files. This means that system administrators need only change a configuration option to enable sharing for their users on their endpoints—and can further control which of their local folders and users are permitted for sharing.

Sharing will be offered as part of a new Globus Online Plus plan that incorporates additional features such as peer-to-peer file transfer, which enables reliable file transfer between any two Globus Online endpoints, including desktops and laptops, even if they are behind a network address translation (NAT) service.

The Globus Online sharing service complements the multitude of cloud storage and sharing services currently available. Services like Dropbox™ are widely used by researchers for sharing individual files and gigabyte-sized data sets, but they are not well suited to scientific data whose size routinely exceeds hundreds of gigabytes to terabytes, and spans thousands—or even millions—of files. At this scale, such services become prohibitively expensive, due to storage and data transfer costs—and cumbersome, as they require data to be moved into the cloud order to share it. “We identified a need among collaborative research groups to share increasingly large volumes of data across multiple institutions,” said Steve Tuecke, project lead for Globus Online. “Existing file sharing services are not capable of addressing this need cost effectively and with high performance, forcing researchers to either craft their own custom solution—assuming they have the technical expertise and funding to do so—or compromise the effectiveness of their research.”

Globus Online is also making available a full-featured group management service that enables researchers to define groups and use those groups as a means for efficiently sharing data across teams that span multiple organizations. A researcher can invite collaborators to join a group and once the invitation is accepted, any data shared with the group is instantly available to all members of the group, without requiring them to have accounts on the storage resource where the data resides. Globus Online provides multiple levels of security to verify a user’s identity before making shared data available, and resource owners have full control over both the data that may be shared and the permissions that may be granted to external users.

The Globus Online team is committed to providing the current file transfer service free of charge for all users. The Plus plan—which includes sharing and peer-to-peer transfers, among other features—will cost $7 per month, or $70 per year, for individual users, with lower per-user prices available for larger groups. Globus Online is developed and operated as a non-profit service by University of Chicago, with the mission to serve researchers at universities and other non-profit institutions. All funds raised by the Plus plan will be used to support operations, with the objective of making Globus Online a self-sustaining service.

Over the past four years, development of Globus Online has been funded by grants from multiple agencies, including the National Science Foundation, The Department of Energy, and the National Institutes of Health, as well as support from the University of Chicago and Argonne National Laboratory. While core research by the Globus Online team continues to be funded by these institutions, the growing operational and support costs are not covered by such grants. “We take very seriously the need to sustain Globus Online operations without direct support from federal grants,” said Ian Foster, principal investigator for Globus Online. “Since the project’s inception our objective has been to create a sustainable service for researchers that is not subject to the uncertainty of traditional research funding sources. We believe that a nominal charge to partially cover operating costs moves us along the path to sustainability.”

Globus Online currently has almost 7,000 registered users and has been used to transfer over 8 petabytes (1 x 1015) of data since its initial launch two years ago.

About Globus Online
Globus Online is software-as-a-service for research data management. Globus Online provides a reliable, high-performance file transfer service for easily and securely moving big data between resources, such as supercomputing facilities, cloud storage systems, campus clusters, lab servers, or personal computers. The service also enables data on existing storage systems to be shared with users at multiple organizations, without specialized software or expensive cloud storage. Designed specifically for researchers, Globus Online is recommended by dozens of institutions and high-performance computing facilities worldwide. Globus Online is an initiative by the Computation Institute at the University of Chicago and Argonne National Laboratory, and is supported in part by funding from the Department of Energy, the National Science Foundation, and the National Institutes of Health.

-----

Source: Globus Online

Most Read Blogs


Feature Articles

CometCloud: Using a Federated HPC-Cloud to Understand Fluid Flow in Microchannels

The ever-growing complexity of scientific and engineering problems continues to pose new computational challenges. Thus, we present a novel federation model that enables end-users with the ability to aggregate heterogeneous resource scale problems. The feasibility of this federation model has been proven, in the context of the UberCloud HPC Experiment, by gathering the most comprehensive information to date on the effects of pillars on microfluid channel flow.
Read more...

CERN, Google, and the Future of Global Science Initiatives

Large-scale, worldwide scientific initiatives rely on some cloud-based system to both coordinate efforts and manage computational efforts at peak times that cannot be contained within the combined in-house HPC resources. Last week at Google I/O, Brookhaven National Lab’s Sergey Panitkin discussed the role of the Google Compute Engine in providing computational support to ATLAS, a detector of high-energy particles at the Large Hadron Collider (LHC).
Read more...

Avoiding Scientific Computing Bottlenecks in the Cloud

Frank Ding, engineering analysis & technical computing manager at Simpson Strong-Tie, discussed the advantages of utilizing the cloud for occasional scientific computing, identified the obstacles to doing so, and proposed workarounds to some of those obstacles.
Read more...

Short Takes

NASA Builds 'Climate in a Box'

May 23, 2013 | he study of climate change is one of those scientific problems where it is almost essential to model the entire Earth to attain accurate results and make worthwhile predictions. In an attempt to make climate science more accessible to smaller research facilities, NASA introduced what they call ‘Climate in a Box,’ a system they note acts as a desktop supercomputer.
Read more...

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

In Support of Cloud-based Rendering

May 10, 2013 | Australian visual effects company, Animal Logic, is considering a move to the public cloud.
Read more...

Internet2 Awards Program Seeks Innovative Applications

May 10, 2013 | Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Newsletters

Stay informed! Subscribe to HPC in the Cloud email Newsletters.

HPC in the Cloud Update
HPCwire Weekly Update
Digital Manufacturing Report
Datanami
HPCwire Conferences & Events
Job Bank
HPCwire Product Showcases



HPC Job Bank


Featured Events



  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States




HPC in the Cloud Conferences & Events