24
Datastax Academy: What ? Why ? How ? DuyHai DOAN

Data stax academy

Embed Size (px)

Citation preview

Page 1: Data stax academy

Datastax Academy: What ? Why ? How ?DuyHai DOAN

Page 2: Data stax academy

Cassandra as Infrastructure Technology•  ING (Cassandra as a service)•  Netflix •  Sony Playstation Network •  Microsoft Office 365 •  Ebay (40Tb in a single table …)•  Etc ..

© 2015 DataStax, All Rights Reserved. 2

Page 3: Data stax academy

Cassandra as Infrastructure Technology•  The SMACK stack as an alternative to the Hadoop stack for streaming•  Spark•  Mesos•  Akka•  Cassandra•  Kafka

•  Read @helenaedelson slides here http://goo.gl/cCIE7F

© 2015 DataStax, All Rights Reserved. 3

Page 4: Data stax academy

Rich eco-system around Cassandra•  Apache Spark (C* connector)•  Apache Zeppelin (C* interpreter)•  Apache Mesos (https://github.com/mesosphere/cassandra-mesos)•  Apache Kafka (KIP-30)

•  Apache Shiro (C* as cluster session store)•  Hunk, JasperSoft, Pentaho, Tableau ..

© 2015 DataStax, All Rights Reserved. 4

Page 5: Data stax academy

Increasing SQL-like features•  CQL DML (SELECT, INSERT, UPDATE, DELETE …)•  CQL DDL CREATE/ALTER/DROP (SCHEMA, TABLE, TYPE, FUNCTION …)•  CQL Credentials

•  CREATE/ALTER/DROP (USER, ROLE) •  GRANT <xxx> PERMISSION ON <resource> TO <user_name>•  REVOKE <xxx> PERMISSION ON <resource> FROM <user_name>

© 2015 DataStax, All Rights Reserved. 5

Page 6: Data stax academy

Increasing SQL-like features•  User Defined Functions

CREATE [OR REPLACE] FUNCTION [IF NOT EXISTS] keyspace';'function-name ( <arg-name> <arg-type> )

(CALLED | RETURNS NULL) ON NULL INPUT

RETURNS <type>

LANGUAGE <language>

AS <body>

© 2015 DataStax, All Rights Reserved. 6

Page 7: Data stax academy

Increasing SQL-like features•  Materialized Views

CREATE MATERIALIZED VIEW [IF NOT EXISTS] keyspace_name.view_name AS

SELECT column1, column2, ...

FROM keyspace_name.table_name

WHERE column1 IS NOT NULL AND column2 IS NOT NULL ...

PRIMARY KEY(column1, column2, ...)

•  Real time notifications (CDC) CASSANDRA-8844

© 2015 DataStax, All Rights Reserved. 7

Page 8: Data stax academy

More powerful search in future•  Apple open-sourced Secondary Index Impl

•  https://github.com/xedin/sasi

CREATE CUSTOM INDEX ON sasi (bio) USING 'org.apache.cassandra.db.index.SSTableAttachedSecondaryIndex'

WITH OPTIONS = {

'analyzer_class': 'org.apache.cassandra.db.index.sasi.analyzer.StandardAnalyzer', 'tokenization_enable_stemming': 'true',

'analyzed': 'true',

'tokenization_normalize_lowercase': 'true', 'tokenization_locale': 'en'

};

© 2015 DataStax, All Rights Reserved. 8

Page 9: Data stax academy

More powerful search in future•  Apple open-sourced Secondary Index Impl

•  https://github.com/xedin/sasi

SELECT *

FROM sasi WHERE (created_at > 1442959315018 OR first_name = 'P')

AND age > 26 ALLOW FILTERING;

© 2015 DataStax, All Rights Reserved. 9

Page 10: Data stax academy

More powerful search in future•  Limited to 2.0.x branch•  Needs special patch to OSS code•  Support only COMPACT STORAGE table•  Only compatible with Murmur3Partitioner

•  CASSANDRA-10661 to merge to Cassandra 3.0 !!!•  Github issues to support full CQL3 (https://github.com/xedin/sasi/issues/3)

© 2015 DataStax, All Rights Reserved. 10

Page 11: Data stax academy

Datastax Gartner reports (Operational DB)

© 2015 DataStax, All Rights Reserved. 11

Oct 2013

Page 12: Data stax academy

Datastax Gartner reports (Operational DB)

© 2015 DataStax, All Rights Reserved. 12

Oct 2014

Page 13: Data stax academy

Datastax Gartner reports (Operational DB)

© 2015 DataStax, All Rights Reserved. 13

Oct 2015

Page 14: Data stax academy

Cassandra Job Trend

© 2015 DataStax, All Rights Reserved. 14

Page 15: Data stax academy

Cassandra Job Offers (I’ve received)

© 2015 DataStax, All Rights Reserved. 15

Page 16: Data stax academy

Cassandra Job Offers (I’ve received)

© 2015 DataStax, All Rights Reserved. 16

Page 17: Data stax academy

Problem ?

© 2015 DataStax, All Rights Reserved. 17

•  Lack of Cassandra skills

•  Difficulty to hire Cassandra experts

Page 18: Data stax academy

Solution: https://academy.datastax.com

© 2015 DataStax, All Rights Reserved. 18

Page 19: Data stax academy

Self-Paced Courses

19 © 2015 DataStax, All Rights Reserved.

FREE

Page 20: Data stax academy

Instructor-Led Training

20 © 2015 DataStax, All Rights Reserved.

FREE

Page 21: Data stax academy

O’Reilly Certification

21 © 2015 DataStax, All Rights Reserved.

Page 22: Data stax academy

Technical Evangelists

22 © 2015 DataStax, All Rights Reserved.

•  On-site help, data-modeling, cluster health check

•  [email protected], @doanduyhai

FREE

Page 23: Data stax academy

From Devs & Ops perspective

23 © 2015 DataStax, All Rights Reserved.

Cassandra is mainstream+

You are trained & certified=

Career Boost

Page 24: Data stax academy

24 © 2015 DataStax, All Rights Reserved.

academy.datastax.com