Islands of node in a sea of Big Data

Glenn Block

Splunk Dev Platform

CC Image Carlota and Isabel Islands by Storm Crypt Flickr

About me

3

Glenn Block

4

5

Glenn Block

What is Splunk?Any Machine Data

HA Indexes and Storage

Search and Investigation

Proactive Monitoring

Operational Visibility

Real-time Business Insights

CommodityServers

Online Services Web

Services

ServersSecurity GPS

Location

StorageDesktops

Networks

Packaged Applications

CustomApplicationsMessaging

TelecomsOnline

Shopping Cart

Web Clickstreams

Databases

Energy Meters

Call Detail Records

Smartphones and Devices

RFID

7

node in the box

9

Let's generate some PDFs

10

How we do it

node

JSONJSON

pdfchartjsdom

11

Why node?• We needed an easy way to convert a web page into PDF

Node has modules for rendering web pages on the server (JSDOM)

Node has modules for PDF generation (PDFKIT)

12

13

14

15

16

Why node?

We needed a mobile-friendly façade for our non-mobile friendly API

The server is heavily IO bound / async, which node is perfect for.

It is easy and lightweight to spin up API servers and proxies in node. Great support for Auth as well.

17

node for integration and extensiblity

18

Log directly to Splunk via TCP,

UDP, HTTP

Integrate search results with other applications using

custom visualizations

Create and run searches from

other applications

Splunk SDK

19

VisualizeSearch Manage

Add/Delete Users

Manage Inputs

Index

20

node inputs

Public APIs DevicesOS levelInternal Systems

Generating test data

Input

21

Ingesting data with Socket.IO

22

Why node?

Inputs by their nature are heavily IO bound and async

Inputs are streaming results back to Splunk and node has great support in the box for streams.

It has a great ecosystem of modules

It’s JavaScript!

23

browserify

requirejsjsdom

pdfkit

htmlparser

koa

mocha

grunt

express

node-http-proxy

jshint

Where to go for More InfoTutorials, Code Samples, Getting Started, Downloads– http://dev.splunk.com/javascript – https://github.com/glennblock/splunk-socket.io

Support– https://www.splunk.com/page/submit_issue

GitHub– https://github.com/splunk/splunk-sdk-javascript

Twitter– https://twitter.com/splunkdev or follow me: https://twitter.com/gblock

Blog– http://blogs.splunk.com/dev/

24

Thank You!