Presto Update (2016)

Martin Traverso 3/22/2016

By The Numbers▪12 months ▪43 releases (0.99 to 0.142) ▪104 contributors (150 total) ▪2355 commits (6946 total) ▪3411 files changed ▪319,734 insertions(+) 79,818 deletions(-)

Language Features▪CREATE TABLE ▪Table Properties ▪ALTER TABLE, CREATE TABLE AS, DROP ▪INSERT/DELETE

Language Features▪CUBE, ROLLUP, GROUPING SETS ▪Uncorrelated scalar subqueries ▪Non-equality predicates for inner joins

Language Features▪New functions (e.g., bitwise operations) ▪TRY ▪VARCHAR(length) ▪Binary literals ▪Unicode support ▪CALL

Security▪Authentication (Kerberos) ▪Authorization ▪Extensible

Performance▪Physical awareness ▪Dictionary-aware execution ▪Structural types representation

Workload Management▪Configurable admission queues ▪Memory management ▪Network topology-aware scheduling ▪Adaptive split concurrency ▪Draining

Hive▪INSERT/DELETE ▪S3 integration improvements ▪New Parquet reader ▪HA metastore support

Miscellaneous▪Integration testing suite ▪Blackhole connector ▪Redis connector ▪RPM package ▪Tableau web connector ▪Query plan/execution visualization

Next

Presto@Facebook▪Warehouse ▪Batch ▪Interactive ▪Application analytics ▪A/B testing ▪User-facing products

Language▪Data Types ▪DECIMAL, FLOAT, SMALLINT, INTEGER ▪CHAR(n), BINARY(n), VARBINARY(n) ▪Correlated subqueries ▪Non-equi outer join ▪Lambdas

Language▪Prepared statements ▪GRANT/REVOKE ▪Materialized query tables ▪Simple query rewrites ▪EXPLAIN ANALYZE

Performance▪Joins and aggregations ▪Structural types ▪Task parallelism ▪Colocated joins ▪Communication layer

Workload Management▪Resource groups and queueing ▪Parallelism vs memory tradeoff

Hive▪ORC writer ▪RCFile reader/writer ▪Kerberos support for HDFS/Metastore ▪Bucketed tables ▪Transaction support (INSERT OVERWRITE)

Optimizer▪Cost-based search ▪Connectors can participate ▪Whole subquery pushdown

(c) 2007 Facebook, Inc. or its licensors.  "Facebook" is a registered trademark of Facebook, Inc.. All rights reserved. 1.0