And Presto; an Open-Source SQL-on-Hadoop Engine from Facebook

Pete Prestipino
by Pete Prestipino 07 Nov, 2013
And Presto; an Open-Source SQL-on-Hadoop Engine from Facebook

Facebook announced that it is taking its SQL query engine for Hadoop, dubbed Presto, open source. 

The offering is widely considered far faster than other data warehouse frameworks including Hive, which Facebook actually developed several years ago. Facebook software engineer Martin Traverso actually said Presto was upwards of ten times faster than Hive. 

Facebook currently uses Presto for interactive queries against several of its internal data stores, including their 300PB data warehouse. Over 1,000 Facebook employees use Presto daily to run more than 30,000 queries that in total scan over a petabyte each per day. Companies including Airbnb and Dropbox also use the solution. 

Presto, of course, is far from the only SQL-on-Hadoop engine. Cloudera offers Impala, Google offers Dremel, and several including Hortonworks' Stinger project, and Pivotal's HAWQ are all clamoring for developer and analyst attention.

Pete Prestipino
Pete Prestipino
Digital marketing executive with proven experience in all aspects of search engine optimization (SEO), performance-based advertising, consumer-generated/social media, email marketing, lead generation, Web design, usability, and analytics. - 20-year Internet marketing veteran, currently serving as the Digital Marketing Campaign Manager at Antenna Group (formerly Chicago Digital). - Former Editor-In-Chief of Website Magazine, and a regular speaker on Web technology digital marketing strategy - Author of several books on digital marketing Including Web 360: The Fundamentals of Web Success; Affiliate 360: The Fundamentals of Performance Marketing; Domains 360: The Fundamentals of Buying & Selling Domain Names, and SEO 360: The Fundamentals of Search Engine Optimization.