Elasticsearchfor full-text search and data analytics

by Lukáš Vlček for JBug.cz meeting in Brno on June 4, 2014

What we will talk about

Full-text SearchREST API, indexing, searching & plugins

Distributed Naturesharding & replication

Data Analyticsfacets & aggregations

JBoss.org Use Cases

What is...?

What is...?

Full-text Search

REST API

Indexing

Searching

DEMO TIME

Full-text Search

Plugins

Data Pull (Rivers), Analysis, Monitoring (Marvel) ...

Visual plugins

Bigdesk, Hammer, Head, HQ, Inquisitor, Kopf, Paramedic, SegmentSpy, Sense (part of Marvel) …

Distributed Nature

Sharding

Replication

DEMO TIME

Data Analytics

Facets

Aggregations

DEMO TIME

JBoss.org Use Cases

2010 - started working with Elasticsearch

2012 - first production release- search.jboss.org

2013 - decided to use Elasticsearch much more- Searchisko

2014 - www.jboss.org- (upcoming) new search.jboss.org- (plan) custom JBoss.org sites search

search.jboss.org

search.jboss.org

search.jboss.org

search.jboss.org

search.jboss.org

search.jboss.org

search.jboss.org

See more detailed presentation from Berlin BuzzWords 2011http://www.slideshare.net/lukas.vlcek/bbuzz-lukasvlcek2011

http://vimeo.com/26553486

Searchisko

- Content providers- Data normalizations- REST API- Optional data persistence outside ES- Indexing and reindexing tasks- More fine grained access roles (WIP)

Searchisko

Elasticsearch cluster

Searchisko

Elasticsearch cluster

Clustered JBoss EAP

Searchisko

Elasticsearch cluster

Clustered JBoss EAP

Persistent DB

Searchisko

Elasticsearch cluster

Clustered JBoss EAP

Content Providers Content Consumers

Persistent DB

Tutorials, Articles, Solutions, Quickstarts, Videos, Static web pages ...

JBoss Developer

JBossDeveloper(www.jboss.org)

Searchisko

Elasticsearch cluster

Clustered JBoss EAP

Content Providers Content Consumers

Persistent DB

Static web pages, Documentation, Tutorials ...

“Some Project”“Some Project” Webpage

Custom search for the project domain only.

Searchisko

Elasticsearch cluster

Clustered JBoss EAP

Content Providers Content Consumers

Persistent DB

Tutorials, Articles, Solutions, Quickstarts, Videos, Static web pages ...

JBoss Developer

Emails, JIRA issues, Forum posts, Blogs, IRC logs ...

.ORG Community

Static web pages, Documentation, Tutorials ...

“Some Project”

(upcomig) search.jboss.org

Searchisko

See more detailed presentation from DevConf.cz 2014http://www.devconf.cz/filebrowser/download/372

Questions?Thank you!