48
1 Search <everywhere/> Search {everything}

Search Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

1

Search <everywhere/>Search {everything}

Page 2: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

2

Hello

Page 3: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

33

Aravind Putrevu

<Developer/>

SIG-Contribex -

@aravindputrevu

Page 4: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

4

Why I’m here?

Page 5: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

5

Page 6: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

66

Page 7: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

77

Page 8: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

88

Page 9: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

9

Page 10: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

1010

But..

Search doesn’t stop there...

Page 11: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

11

Page 12: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

1212

Page 13: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

13

Page 14: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1
Page 15: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

you know, for search

Page 16: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

Store, Search, & Analyze

Visualize & Manage

Ingest

Elastic Stack

SOLUTIONS

Kibana

Elasticsearch

Beats Logstash

SaaS On-Prem

Elastic cloud Elastic cloudEnterprise

Standalone

Elastic cloudOn Kubernetes

Page 17: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

1717

Page 18: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

18 18

ElasticsearchHeart of the Elastic Stack

Distributed, Scalable High-availability Multi-tenancy

Developer Friendly Real-time, Full-text Search Aggregations

Page 19: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

19

github.com/elastic/elasticsearch

Page 20: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

20

Terms

Cluster

https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

A cluster is a collection of one or more nodes (servers)

Page 21: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

21

Terms

Node

https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

A node is a single server that is part of your cluster, stores your data, and participates in the cluster’s

indexing and search capabilities

Page 22: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

22

Terms

Index

https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

An index is a collection of documents that have somewhat similar characteristics

Page 23: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

23

Terms

Document

https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

JSON Document, which gets stored in Index

Page 24: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

24

Terms

Shard

https://www.elastic.co/guide/en/elasticsearch/reference/current/glossary.html

Elasticsearch provides the ability to subdivide your index into multiple pieces called shards

Page 25: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

2525

apps

meta content

Index

Page 26: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

2626

apps

meta content

Shards

Page 27: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

27 27

Types of Shards

Primary Shard

➢ Responsible for ○ Create○ Update○ Delete

➢ Pushes data to replica’s➢ Important for write-heavy

architecture

Replica Shard

➢ Helps with reads➢ Fault tolerance➢ Scalability➢ Important for read-heavy or

search architecture

Page 28: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

2828 28

Page 29: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

2929

Page 30: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

3030

Page 31: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

31

Solutions

TracingMetricsLogs

App Search Enterprise SearchSite Search

SIEM ENDPOINT

Page 32: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

32

Deploying Search. . .

Page 33: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

33

Ways to create Elasticsearch Cluster?

Self-managed Cloud Infra Managed Service

Page 34: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

34

Page 35: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

35

$> docker pull elasticsearch

Images: docker.elastic.co

Page 36: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

3636

Page 37: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

37

Running Elasticsearch on GCP

1 2 3 4 5

Login to GCP Console

Go to GCP Marketplace

Search “Elasticsearch Service

on Elastic Cloud”

Purchase &

Enable

Manage via Elastic

Page 38: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

38

Running Elasticsearch on GCP

1 2 3 4 5

Login to GCP Console

Go to GCP Marketplace

Search “Elasticsearch Service

on Elastic Cloud”

Purchase &

Enable

Manage via Elastic

Page 39: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

39

Running Elasticsearch on GCP

1 2 3 4 5

Login to GCP Console

Go to GCP Marketplace

Search “Elasticsearch Service

on Elastic Cloud”

Purchase &

Enable

Manage via Elastic

Page 40: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

40

Running Elasticsearch on GCP

1 2 3 4 5

Login to GCP Console

Go to GCP Marketplace

Search “Elasticsearch Service

on Elastic Cloud”

Purchase &

Enable

Manage via Elastic

Page 41: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

41

Running Elasticsearch on GCP

1 2 3 4 5

Login to GCP Console

Go to GCP Marketplace

Search “Elasticsearch Service

on Elastic Cloud”

Purchase &

Enable

Manage via Elastic

Page 42: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

42

Page 43: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

43

Page 44: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

44

Searching with Elastic Enterprise Search

Page 45: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

45

Managing and Connection Sources with Elastic Enterprise Search

Page 46: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

4646

Resources

ela.st/search

46

Page 47: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

4747

Resources

ela.st/community-trial

47

Page 48: Search  Search {everything} · Elasticsearch Beats Logstash SaaS On-Prem Elastic cloud Elastic cloud Enterprise Standalone Elastic cloud On Kubernetes. 17. 18 1

48

Fin!

discuss.elastic.co | [email protected] | @aravindputrevu