Embed Size (px)
Citation preview
Graph Processing with Titan and ScyllaJason PluradSoftware Engineer, IBM Open TechnologyPMC and Committer, Apache TinkerPop
Graphs with Titan and Scylla
ØGraph computing
• Graph landscape
• Titan and Scylla
Common graph data domains
• Social network analysis
• Configuration management database
• Master data management
• Recommendation engines
• Knowledge graphs
• Internet of things
Apache TinkerPop:Graph ComputingFramework
http://tinkerpop.apache.org
Property graph and Gremlin
• Structure§ Vertex§ Edge§ Properties
• Gremlin§ Domain specific language (DSL) for graph§ Functional, data flow approach§ Full library of traversal steps§ Support for non-JVM languages
Graphs with Titan and Scylla
üGraph computing
ØGraph landscape
• Titan and Scylla
Graph Landscape• Graph database vs Graph processor
§ OLTP vs OLAP§ Neighborhood vs Whole graph
Apache Spark or Apache Giraph
• Pick a graph processor for OLAP…§ Spark is the new hotness in analytics§ Giraph is better suited for gigantic graphs
• By using Apache TinkerPop and Gremlin, we can use
either one seamlessly
Titan (Aurelius)
• Pick a graph database for OLTP…
• Pluggable storage backend
• Pluggable indexing backend
• Gift from Matthias Broecheler and Dan LaRocque
• Apache license but not in ASF?
http://titandb.io
DataStax Enterprise Graph?
• Apache TinkerPop compliant
• Not open source
• Titan inspired
• Gremlin tooling with DataStax Studio
Graphs with Titan and Scylla
üGraph computing
üGraph landscape
ØTitan and Scylla
Why Titan?
• Designed for big graphs (10B+ edges)
• Local graph traversals (OLTP)
• Batch graph processing (OLAP)
• Desire a free, open source distributed graph database
Titan Key Features
• Data management
• Vertex-centric indices
• Graph partitioning
• Edge compression
http://s3.thinkaurelius.com/docs/titan/1.0.0/getting-started.html
Titan Architecture
http://s3.thinkaurelius.com/docs/titan/1.0.0/arch-overview.html
Why Scylla?
• Drop-in replacement for Cassandra 2.1.8
• Thrift support (Duarte Nunes)§ Partial support in 1.3§ Full support in 1.4
• Titan is compatible with Scylla 1.3§ OLTP with Scylla is crazy fast§ OLAP via SparkGraphComputer
https://github.com/scylladb/scylla/issues/693
Titan reawakened with Scylla
• Next steps
• Benchmarking OLTP and OLAP with Scylla
• Transition Titan to native CQL§ Essentially a rewrite§ Materialized views
• Native search in Scylla?
• Open source leads the way
• Partner with open communities
Thank You!http://titandb.io
http://tinkerpop.apache.org
Contact: [email protected], Twitter/GitHub @pluradj
