November 13, 2012
Nov. 13 – Globus Online announced today a new file sharing service that makes it easy for researchers to securely share their data with collaborators. The sharing service builds on Globus Online’s reliable high-performance file transfer software-as-a-service (SaaS) and allows large data sets to be shared without requiring complex software or moving the data to expensive cloud storage.
Globus Online will enable data on existing storage systems to be easily shared with users at multiple institutions. The service will provide researchers complete control over which Globus Online users can access their data and the level of access that is permitted. It is currently undergoing final testing and will be made available in early 2013.
The service will utilize updated versions of Globus Connect and GridFTP to connect a storage system to the Globus Online cloud, and the same logical endpoint structure currently used by Globus Online for transferring files. This means that system administrators need only change a configuration option to enable sharing for their users on their endpoints—and can further control which of their local folders and users are permitted for sharing.
Sharing will be offered as part of a new Globus Online Plus plan that incorporates additional features such as peer-to-peer file transfer, which enables reliable file transfer between any two Globus Online endpoints, including desktops and laptops, even if they are behind a network address translation (NAT) service.
The Globus Online sharing service complements the multitude of cloud storage and sharing services currently available. Services like Dropbox™ are widely used by researchers for sharing individual files and gigabyte-sized data sets, but they are not well suited to scientific data whose size routinely exceeds hundreds of gigabytes to terabytes, and spans thousands—or even millions—of files. At this scale, such services become prohibitively expensive, due to storage and data transfer costs—and cumbersome, as they require data to be moved into the cloud order to share it. “We identified a need among collaborative research groups to share increasingly large volumes of data across multiple institutions,” said Steve Tuecke, project lead for Globus Online. “Existing file sharing services are not capable of addressing this need cost effectively and with high performance, forcing researchers to either craft their own custom solution—assuming they have the technical expertise and funding to do so—or compromise the effectiveness of their research.”
Globus Online is also making available a full-featured group management service that enables researchers to define groups and use those groups as a means for efficiently sharing data across teams that span multiple organizations. A researcher can invite collaborators to join a group and once the invitation is accepted, any data shared with the group is instantly available to all members of the group, without requiring them to have accounts on the storage resource where the data resides. Globus Online provides multiple levels of security to verify a user’s identity before making shared data available, and resource owners have full control over both the data that may be shared and the permissions that may be granted to external users.
The Globus Online team is committed to providing the current file transfer service free of charge for all users. The Plus plan—which includes sharing and peer-to-peer transfers, among other features—will cost $7 per month, or $70 per year, for individual users, with lower per-user prices available for larger groups. Globus Online is developed and operated as a non-profit service by University of Chicago, with the mission to serve researchers at universities and other non-profit institutions. All funds raised by the Plus plan will be used to support operations, with the objective of making Globus Online a self-sustaining service.
Over the past four years, development of Globus Online has been funded by grants from multiple agencies, including the National Science Foundation, The Department of Energy, and the National Institutes of Health, as well as support from the University of Chicago and Argonne National Laboratory. While core research by the Globus Online team continues to be funded by these institutions, the growing operational and support costs are not covered by such grants. “We take very seriously the need to sustain Globus Online operations without direct support from federal grants,” said Ian Foster, principal investigator for Globus Online. “Since the project’s inception our objective has been to create a sustainable service for researchers that is not subject to the uncertainty of traditional research funding sources. We believe that a nominal charge to partially cover operating costs moves us along the path to sustainability.”
Globus Online currently has almost 7,000 registered users and has been used to transfer over 8 petabytes (1 x 1015) of data since its initial launch two years ago.
About Globus Online
Globus Online is software-as-a-service for research data management. Globus Online provides a reliable, high-performance file transfer service for easily and securely moving big data between resources, such as supercomputing facilities, cloud storage systems, campus clusters, lab servers, or personal computers. The service also enables data on existing storage systems to be shared with users at multiple organizations, without specialized software or expensive cloud storage. Designed specifically for researchers, Globus Online is recommended by dozens of institutions and high-performance computing facilities worldwide. Globus Online is an initiative by the Computation Institute at the University of Chicago and Argonne National Laboratory, and is supported in part by funding from the Department of Energy, the National Science Foundation, and the National Institutes of Health.
Source: Globus Online
Researchers from the Suddhananda Engineering and Research Centre in Bhubaneswar, India developed a job scheduling system, which they call Service Level Agreement (SLA) scheduling, that is meant to achieve acceptable methods of resource provisioning similar to that of potential in-house systems. They combined that with an on-demand resource provisioner to ensure utilization optimization of virtual machines.
Experimental scientific HPC applications are continually being moved to the cloud, as covered here in several capacities over the last couple of weeks. Included in that rundown, Co-founder and CEO of CloudSigma Robert Jenkins penned an article for HPC in the Cloud where he discussed the emergence of cloud technologies to supplement research capabilities of big scientific initiatives like CERN and ESA (the European Space Agency)...
When considering moving excess or experimental HPC applications to a cloud environment, there will always be obstacles. Were that not the case, the cost effectiveness of cloud-based HPC would rule the high performance landscape. Jonathan Stewart Ward and Adam Barker of the University of St. Andrews produced an intriguing report on the state of cloud computing, paying a significant amount of attention to the problems facing cloud computing.
Jun 19, 2013 |
Ruan Pethiyagoda, Cameron Boehmer, John S. Dvorak, and Tim Sze, trained at San Francisco’s Hack Reactor, an institute designed for intense fast paced learning of programming, put together a program based on the N-Queens algorithm designed by the University of Cambridge’s Martin Richards, and modified it to run in parallel across multiple machines.
Jun 17, 2013 |
With that in mind, Datapipe hopes to establish themselves as a green-savvy HPC cloud provider with their recently announced Stratosphere platform. Datapipe markets Stratosphere as a green HPC cloud service and in doing so partnering with Verne Global and their Icelandic datacenter, which is known for its propensity in green computing.
Jun 12, 2013 |
Cloud computing is gaining ground in utilization by mid-sized institutions who are looking to expand their experimental high performance computing resources. As such, IBM released what they call Redbooks, in part to assist institutions’ movement of high performance computing applications to the cloud.
Jun 06, 2013 |
The San Diego Supercomputer Center launched a public cloud system for universities in the area designed specifically to run on commodity hardware with high performance solid-state drives. The center, which currently holds 5.5 PB of raw storage, is open to educational and research users in the University of California.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.