Intersect360 HPC500 HPC Job Bank
HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

Datanami
Digital Manufacturing Report
HPCwire

Blog: Behind the Cloud

Yale-Born Startup Sets Sights on Big Data Analytics


Hadapt, Inc., which spawned from a joint research endeavor at Yale University, fleshed out details today about what it hopes to bring to the increasingly noisy sphere of big data analysis.

The company’s name provides a subtle hint about the nature of the offering (marrying the words Hadoop and Adapt). The startup plans to provide an analytical platform that will allow users to handle complex analytics workloads across what it calls a “cloud-optimized system.”

This morning the New Haven-based crew announced that it received its first round of financing to boost efforts behind their patent-pending technologies for high performance analytics on both structured and unstructured data. Hadapt’s technology is designed to tackle big data in both private and public cloud environments.

According to Hadapt, they are “adapting and expanding the Hadoop architecture to bring a more complete SQL interface, a patent-pending Adaptive Query Execution capability, and a hybrid storage engine to handle structured as well as unstructured data on a single platform.

In short, this means that they are another company seeking to bring the power of Hadoop to enterprise users by expanding the possibilities to analyze even more data types with help from a relational database.

The key piece of the company’s offering lies in the Adaptive Query Execution, which will be capable of dynamically load balancing queries in cloud environments and will allow jobs to be automatically split between relational database engines and Hadoop to maximize performance.

According to Borgman, there is nothing like the Adaptive Query Execution available today. He claims that during testing at Yale the group “was able to document query results 50 times faster than Hadoop with Hive and 600 times faster than Hadoop with HBase.”

On the cloud front, the company’s appeal is that this is native cloud-ware. In other words, as Borgoman stated, this was born for a virtualized environment thus, “unlike other second generation data warehousing companies, Hadapt has optimized the product architecture for big data and big analysis in virtualized environments.”

Hadapt is certainly not the only startup with an eye on the value of big data for enterprise use. Companies like Cloudera, for instance, which has at the heart of their branding the same  wish to “bring Hadoop to the masses” are no threat to Hadapt, according to Borgman during a recent interview. He notes that their offering is actually complementary to Cloudera, noting that “Cloudera focuses on tools and services to help ordinary IT staff run Hadoop whereas Hadapt is more fundamentally trying to make Hadoop better.”

Borgman is one of several co-founders behind the startup, which has its public “coming out” party today at the Structure event sponsored by GigaOm.

The founders of Habapt led a research team at Yale University that created and tested the initial prototype. Dr. Daniel Abadi, Chief Scientist and Co-founder is a database systems expert and behind the key Adaptive Analytical Platform at the heart of the company’s model. Abadi maintains a faculty position within Yale’s Computer Science department.

Also supporting the development and research for the Adaptive Analytical Platform is Kamil Bajda-Pawlikowski, who serves as chief software architect and co-founder in addition to his post at Yale. Dr. Avi Silberschatz, who is the team’s technical advisor (and another co-founder) was one of the visionaries behind the HadoopDB research that the company hopes to capitalize upon. Before joining the Yale computer science faculty, he was VP of the Information Sciences Research Center at Bell Labs.

The only co-founder who wasn’t involved in the research and testing directly was Justin Borgman, who serves as CEO comes from software development positions at MIT Lincoln Laboratory and Raytheon and more recently as head of product development at Covectra, a counterfeit prevention company. His Yale connection, however, extends to the university’s School of Management.

Hadapt hopes to tie up their software for formal release later in the year.
 

Posted by Nicole Hemsoth - March 23, 2011 @ 9:24 AM, Pacific Daylight Time

Discussion

There are 0 discussion items posted.

Join the Discussion

Join the Discussion

Become a Registered User Today!


Registered Users Log in join the Discussion

Nicole Hemsoth

Nicole Hemsoth

Nicole Hemsoth is the managing editor of HPC in the Cloud and will discuss a range of overarching issues related to HPC-specific cloud topics in posts.

More Nicole Hemsoth

Arkeia

Recent Comments

No Recent Blog Comments

Feature Articles

Cloud Services Satisfy a Higher Calling

Higher education involves many collaborative projects that lend themselves to cloud services, however often those services are not tailored to the uniqueness of an academic environment. That's where the Internet2 NET+ project comes in. By partnering with 16 major cloud providers, the networking consortium is seeking to expedite the delivery of cloud services and by doing so advance research and innovation in the United States.
Read more...

Around the Web

NVIDIA Raises Its Game to the Cloud

May 17, 2012 | NVIDIA GeForce GRID, a cloud gaming platform announced at the 2012 GPU Technology Conference (GTC), seeks to reduce the the latency associated with cloud gaming.
Read more...

Breaking the Cloud Barrier

May 15, 2012 | New Microsoft report shows that beyond the expected financial benefits, cloud services may offer more comprehensive security features compared to in-house IT operations.
Read more...

Vendors Demo Next-Gen Sequencing Platforms for Pharma

May 14, 2012 | During the second annual Pistoia Alliance conference, three teams demonstrated their newly-implemented cloud-based next-generation sequencing platforms.
Read more...

Zunicore Offers Bare Metal by the Hour

May 10, 2012 | PEER1's cloud division, Zunicore, will soon be offering GPU-equipped servers on-demand.
Read more...

US Cloud Providers Struggle With Data Privacy Laws

May 08, 2012 | The Patriot Act leads foreign governments to question the security of US cloud services.
Read more...

Sponsored Whitepapers

Appro White Paper: Enabling Performance-per-Watt Gains in HPC

04/05/2012 | Appro | Designed to meet the growing global demand for HPC solutions, Appro's Xtreme-X™ Supercomputer delivers superior performance-per-watt and reduced I/O latency while bringing significant flexibility to HPC workload configurations including capacity, hybrid, data intensive and capability computing.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedia

Blogs by Topics

Blogs by Author

HPC Blogroll

Intersect360 HPC500

Featured Events









HPC in the Cloud Conferences & Events