May 21, 2012
Since the introduction of feature-length digitally-animated films like Toy Story and Shrek, animation artists have been trading in their paintbrushes for software. As demand continues to grow for these films, animation studios require more compute power and storage to handle their workloads. Recently, DreamWorks announced a continuation of their decade-long partnership with HP as they look to take advantage of HP's cloud services.
Derek Chan, head of digital operations at DreamWorks, spoke with CloudPro about the technology behind its digitally-animated features. Chan explained that a feature film for the studio would generate roughly 500 million files and consume 200 terabytes of data. Beyond the storage requirements, an estimated 70 million CPU hours are needed to develop and render a film.
Chan mentioned in an interview at CloudBeat 2011 that DreamWorks was implementing grid computing and private cloud infrastructures with HP as far back as 2003. The deployments were made because the studio simply didn't have enough physical space to house necessary processing power.
In 2010, the animation studio again looked to HP cloud technology to build continuity between their three production facilities, two in Redwood City and Glendale California, as well as one in Bangalore, India. They replaced point-to-point connections in favor of HP's Switch Cloud in Las Vegas. Both California facilities are attached to the switch via 10Gb fiber.
Ideally, the Bangalore studio would have the same bandwidth, but it's physical distance makes installing the pipe unfeasible.
"It is pretty cost prohibitive to get a 10Gb line between there and the US, so there we run at 500ms. We would love to have a global system that could provide a single view of that same data across all of this, whether private or public cloud. This is one of our big targets – the next evolution of the cloud for us is to make this a viable reality," said Chan in an interview with Datacenter Dynamics.
One of the company's largest challenges comes from demand to create more films, placing additional stress on their compute capacity. Since producing two feature films from 1998-2001, the studio has increased output considerably, creating five features between 2008-2010. To continue to making films at this pace, DreamWorks will be relying on a hybrid cloud setup. In 2010, the cloud processed five percent of the company's rendering workload, while now that figure is up to 20 percent – it's an evolution says Chan.
For entertainment companies, and especially digital animation studios, cloud storage and rendering services are becoming a viable alternative to managing private datacenters. As the industry continues to push the boundaries of technology, cloud providers can expect to receive more attention from content creators.
Researchers from the Suddhananda Engineering and Research Centre in Bhubaneswar, India developed a job scheduling system, which they call Service Level Agreement (SLA) scheduling, that is meant to achieve acceptable methods of resource provisioning similar to that of potential in-house systems. They combined that with an on-demand resource provisioner to ensure utilization optimization of virtual machines.
Experimental scientific HPC applications are continually being moved to the cloud, as covered here in several capacities over the last couple of weeks. Included in that rundown, Co-founder and CEO of CloudSigma Robert Jenkins penned an article for HPC in the Cloud where he discussed the emergence of cloud technologies to supplement research capabilities of big scientific initiatives like CERN and ESA (the European Space Agency)...
When considering moving excess or experimental HPC applications to a cloud environment, there will always be obstacles. Were that not the case, the cost effectiveness of cloud-based HPC would rule the high performance landscape. Jonathan Stewart Ward and Adam Barker of the University of St. Andrews produced an intriguing report on the state of cloud computing, paying a significant amount of attention to the problems facing cloud computing.
05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.
04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.