Does Facebook still use Presto?

Who uses it? Facebook uses Presto for interactive queries against several internal data stores, including their 300PB data warehouse. Over 1,000 Facebook employees use Presto daily to run more than 30,000 queries that in total scan over a petabyte each per day.

Is Presto software free?

Many folks may wonder “is Presto free”? In fact, PrestoDB is a free, open source federated, distributed SQL query engine used for ad hoc analytics. The PrestoDB AMI is 100\% open source and available for use in production immediately.

Does Facebook still use hive?

Facebook’s business analysts push the business in a variety of ways. They rely heavily on Hive, which enables them to use Hadoop with standard business intelligence tools, as well as Facebook’s homegrown, closed source, end-user tool, HiPal.

What is Facebook Presto?

Presto is an open source distributed query engine that supports much of the SQL analytics workload at Facebook. Presto is designed to be adaptive, flexible, and extensible. It supports a wide variety of use cases with diverse characteristics.

Is Presto open source?

Presto is an open source, distributed SQL query engine designed for fast, interactive queries on data in HDFS, and others.

Is Presto an Apache project?

Presto is community driven open-source software released under the Apache License.

Is Facebook a data warehouse?

At Facebook, we have unique storage scalability challenges when it comes to our data warehouse. Our warehouse stores upwards of 300 PB of Hive data, with an incoming daily rate of about 600 TB. In the last year, the warehouse has seen a 3x growth in the amount of data stored.

Why Presto is fast?

As Presto is an in-memory query engine, it can only process data as fast as the storage layer can provide it. There are MANY different types of storage that can be queried by Presto, some faster than others. So if you can choose the fastest data source this will boost Presto’s speed.

Is Facebook closed source?

Since Facebook is a closed source application, without access to the code security holes are usually found through a process of black-box testing, whereby an external party will probe the application in an attempt to work out how the application behaves and to try and find potential race conditions.

Why is open-source free?

As mentioned above, the OSI’s definition of open source software is “free” in the sense of giving freedom to those who use it. So in the most common way of thinking, where “free” means no upfront cost to use, modify, or distribute, the answer is yes: the software is free.

Does Presto require Hadoop?

Presto and Hadoop Unlike Hadoop/HDFS, it does not have its own storage system. Thus, Presto is complimentary to Hadoop, with organizations adopting both to solve a broader business challenge. Presto can be installed with any implementation of Hadoop, and is packaged in the Amazon EMR Hadoop distribution.

What technology did Facebook use to build Presto?

Prior to building Presto, Facebook used Apache Hive, which it created and rolled out in 2008, to bring the familiarity of the SQL syntax to the Hadoop ecosystem. Hive had a significant impact on the Hadoop ecosystem for simplifying complex Java MapReduce jobs into SQL-like queries, while being able to execute jobs at high scale.

What is the history of Presto?

Presto was originally developed by Facebook to scale to the data size and performance they needed. In Fall 2012 a small team of four engineers at Facebook started working on Presto. By Spring 2013, the first version was successfully rolled out within Facebook. Later that year, Facebook open sourced Presto under the Apache License.

What companies are using Presto?

Presto is used in production at very large scale at many well-known organizations. You’ll find it used at Facebook, Airbnb, Netflix, Atlassian, Nasdaq, and many more. Facebook’s implementation of Presto is used by over a thousand employees, who run more than 30,000 queries, processing one petabyte of data daily.

Where can I find the Presto community?

The broader Presto community can be found on this forum and on the Presto page on Facebook. Presto is an ideal workload in the cloud, because the cloud provides performance, scalability, reliability, availability, and massive economies of scale. You can launch a Presto cluster in minutes.