Upload
others
View
10
Download
0
Embed Size (px)
Citation preview
Starburst Presto on Kubernetes
Starburst: www.starburstdata.com
Agenda
Starburst Introduction
Overview of Starburst Presto Kubernetes
Autoscaling
Demo
Questions
Starburst Offering• Enterprise Presto
• Latest Cost Based Query Optimizer• Fully Tested, Stable Releases
• Management• Starburst Mission Control• Presto Coordinator High Availability• Autoscaling with Graceful Shutdown
• Connectivity• Enterprise ODBC & JDBC drivers• Long list of connectors, including Oracle,
Teradata, BigQuery, and Snowflake4
• Security• Apache Ranger Integration• Apache Sentry Integration• Data Encryption• Query Auditing
• Support• 24x7 Support SLA from the Presto
Experts• Long Term Presto Version Support• Hot fixes and Security Patches• Access to Customer Success team of Data
Architects• Starburst & Presto Roadmap Influence
Overview
Key TakeawaysK8S
Starburst Presto Kubernetes solution provides the data architect the most deployment flexibility for cloud, multi-cloud, hybrid-cloud, and on-premises environments. Presto runs wherever Kubernetes runs.
Deployment Option What to Sell
•
GCP
Azure
AWS
On Prem
Starburst Enterprise with Kubernetes (on GKE)
Starburst Enterprise with Kubernetes (on AKS)
Starburst Enterprise via AMI/CFT
Starburst Enterprise with Marketplace (via AMI/CFT)
Starburst Enterprise with Kubernetes (on EKS)
Starburst Enterprise on bare metal
Starburst Enterprise on VMs
Starburst Enterprise with Kubernetes
Starburst Presto on Kubernetes
Starburst Presto Kubernetes Operator allows you to easily deploy and manage Presto on Kubernetes
• Google Kubernetes Engine (GKE)• Amazon Elastic Container Service for Kubernetes (EKS)• Azure Kubernetes Service (AKS)• RedHat OpenShift Container Platform (In Certification Process)
7
Why Kubernetes?
8
https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/
Concepts: K8s Cluster• K8s cluster is made up of nodes• Adding nodes to the cluster adds CPU/Memory available• User interact with Kubernetes cluster API, and not the nodes directly• Kubernetes handles where your program runs
9
Concepts: K8s Pod
• K8s does not run containers. It runs Pods which contain the containers.• Containers in the pods share the same resources and network• Containers in the same pod can communicate with each other as if on
the same machine (i.e. localhost)
10
16128 GB
Presto WorkerPod
Presto WorkerPod
Starburst Presto on K8s Architecture
11
Presto CoordinatorPod
Presto WorkerPod
Horizontal Pod Autoscaler (HPA)
Presto OperatorK8s Operator
PrestoService
Hive Metastore ServicePod
Config Properties:connection-url=<pgsql_url>connection-password=<password>connection-user=<sb-user>RDS=PostgreSQL
Hadoop / Hive
RDBMS
What is a Kubernetes Operator?
• Deploy non-trivial application on top of k8s• Introduced by CoreOS (2016)• Another layer of abstraction used to maintain state and expand the
types of applications that can run on K8s. • Focus on business logic. Domain Knowledge as code.• Reduce complexity and boilerplate code• Pattern for building Kubernetes native applications. Runs as a
container.https://github.com/operator-framework
What Does the Presto Kubernetes Operator Do?
• Autoconfiguration of Presto cluster• Coordinator High Availability using liveliness probes• Presto Worker Autoscaling• Graceful Scale down
• Operator Metering (coming soon)• Enable usage reporting for operators and resources with K8s• Do reports for showing “chargeback”
Demo
Questions?