Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server

Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk ServerM.R. Ashwin Prabhu https://www.linkedin.com/in/mrashwinprabhu

fortuvis.com2

Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server

Ashwin Prabhu

fortuvis.com

By

fortuvis.com3

Agenda

What is ELK stack (Elastic Stack)? Why do we need ELK stack?

ELK Stack Architecture

Logstash

ElasticSearch

Kibana

ELK Installation notes in Windows?

ELK with BizTalk - Demo

Q&A

fortuvis.com4

Who am I?

• Ashwin Prabhu• Mircosoft Azure MVP for 2016, 2015 & 2014• Independent Consultant in BizTalk Server and Azure• Living in UK• 15 Years of experience in BizTalk Server• Blog: http://www.fortuvis.com/blog/• @mrashwinprabhu

• https://www.linkedin.com/in/mrashwinprabhu

fortuvis.com5

What is ELK stack (Elastic Stack)? Why do we need ELK?

• Log management platform

• Provides actionable insights in real time from structured and unstructured logs

fortuvis.com6

What’s is ELK stack (Elastic Stack)? Why do we need ELK? Continue..

• ElasticSearch (E), Logstash (L), Kibana (K)

• Free open source stack for log management with commercial support, managed solutions, and

additional tools from Elastic.

• ELK stack aka Elastic Stack

• Provides the value of convert these unstructured and structured log files, into more meaningful

dashboards and searchable data.

fortuvis.com7

ELK Stack Architecture

• Logstash can collect and parse the log from different sources, store it in Elasticsearch and Kibana

provides a visualization of that data

fortuvis.com8

ELK Architecture - Logstash

• Logstash event processing pipeline has three stages

Input

Filter

Output

fortuvis.com9

ELK Architecture - Elasticsearch

• Document based search engine

• JSON based

• Built on top of Apache Lucene

• Schema free

• Distributed by design

• API Centric

• NoSQL database

fortuvis.com10

ELK Architecture - Kibana

• Browser based analytics and search dashboard for data stored in Elasticsearch

• Create dashboard

• Similar to Power BI for analytics but more search based

fortuvis.com11

ELK with BizTalk – Demo

fortuvis.com12

Any Questions?

fortuvis.com13

Thank You

ashwin.prabhu@fortuvis.com

@mrashwinprabhu

Blog: http://www.fortuvis.com/blog/