Drupal and Elasticsearch

Hi

What we are going to talk?• Elasticsearch technology - http://www.elasticsearch.org

• What is Elasticsearch?

• How it works?

• Elasticsearch and Drupal – Demohttp://www.drupal.org/project/elasticsearch_connector

Who made Elasticsearch?

• Shay Banon

• http://www.kimchy.org/

• https://github.com/kimchy

• https://twitter.com/kimchy/

Who is using it?

Why they use it?

• Distributed out of the box - Incredible easy to make cluster, just start new node!

• High availability

• Real time index/search

• REST API with JSON

• Build on top of Apache Lucene and Open Sourcehttp://github.com/elasticsearch/elasticsearch

• Schema free

• Document oriented

How to install it?

How to install it?

How to install it?

If using Chrome?

Sense

Indices API – Create index

index

Node2

How distributed works?

Node1

PUT /twitter index: number_of_shards:3 number_of_replicas:1

1P 2P

3P

2P 1R

3R

2R

Node3

3P 1R

3R

2R

3R

Node2

Multiple indices

Node1

1P 2P2R

Node3

3P 1R

3R

PUT /news?pretty index: number_of_shards:3 number_of_replicas:1

1NP

2NR

2NP

3NR

3NP

1NR

Index API - Request

index type id

Node2

Distributed indexing

Node1

PUT /twitter/tweet/1{….}

1P 2P2R

Node3

3P 1R

3R

Index API - Response

Get API - Req and Res

Node2

Distributed GET

Node1

GET /twitter/tweet/1

1P 2P2R

Node3

3P 1R

3R

Search API - Request

Node2

Distributed search

Node1

GET /twitter/_search?q=kimchy

1P 2P2R

Node3

3P 1R

3R

Update document

PUT the document again or…

Delete document

Delete index

How full text search works?

Search for: “berlin tweet”

Inverted index

1. Separate the string into words2. Create sorted unique list3. Specify which documents contains this terms

TERMS DOC 1 DOC 2 DOC 3

berlin X

looking X

tweet X X

presentations

X

elastic X X

trying X

Analysis

Tokenization + Normalizationor

tokenizer + token filters (>=0)

More features

DSL Query languageFacets/Aggregation APIAliasingPercolatingGEO searchingAttachmentss.o.

Video resources

http://www.youtube.com/watch?v=fEsmydn747c

http://www.youtube.com/watch?v=lpZ6ZajygDY

http://www.youtube.com/watch?v=52G5ZzE0XpY

http://www.elasticsearch.org/videos/

Elasticsearch and Drupal

Drupal Demo time!

Roadmap

Thank you!

Questions?