Copyright © 2015 Splunk Inc.
Splunk in integration testingBetter not to make a mess than to clean it up
2
Splunk in integration testing
Better not to make a mess than to clean it up
3
Leading Cable TV and internet company of the NetherlandsRecently acquired by Liberty Global
Internet, Cable TV, mobile network, Telephony
4
My backgroundProgramme test manager (contracter)Experience in both test and operationsAuthor of a book on performance testing (available on Amazon)Joined a running programme in the integration phaseMy favorite Splunk tee-shirt tag line: Put that in your | and Splunk it
5
Testing
6
And the winner is
7
Exploratory testingTesting isn’t just creating and running some scripts
Simultaneous: learn / design executeNo up front scriptsFast, effectiveRelies on feedback what about logs?
8
Testing not the same
Testing or checking?Changed scene– Agile / devops / continuous delivery– SOA: chain or web?– Change based specs vs system based
9
Testers
Spider in the web (integration)Manage RCAMediate solutionsLooking for troubleTrouble shooting...
Ring a bell?
10
The situationLarge programme
Multiple vendorsInternal and off shore developmentInternal and off shore testing
Many new componentsMultiple teams and suppliers (off shore)Delays in integration (ticket ping pong)
Splunk guru in the team
11
Introduced SplunkTibco messages indexed in SplunkCore systems logs indexed in SplunkOrder tables (rising column)Created dashboards
Screenshot here
12
Application errors
12
13
Validations
13
14
Oracle (ORA) errors
14
15
Dreaded time-outs
15
16
The whip
16
17
Results
Solved the integration issuesTesters very happy:Insight in the total flowSelf service on test data issuesIssues assigned to the right teamFind the overlooked issues Jump started the integration phaseAfter care was cancelled due to NO reported issues
Team rule: no issue logged that hasn't been Splunked
17
18
Today’s challenges
18
19
Data’s story
19
DateTime Status CustI CorID Product Unit09/30/2015 10:45:00 Success B254788 CorID12548687 Apple 1
09/30/2015 10:45:01 Pending B356489 CorID12548688 Carrot 5
09/30/2015 10:45:02 Failed B366547 CorID12548689 Banana 5
CO12548689 2015-30-9 10:43:58.001 Order placed 5 Bananas
CO12548689 2015-30-9 10:44:20.001 Reply from logistics Bananas not by piece
CO12548689 2015-30-9 10:45:02 Order registered in Order DB Status failed
20
Why we do it
Testers: access, insight and first time right
(test) Management: facts and figures on quality and performance
Company: prevent embarrassing incidents, lower costs, faster time to market
20
21
Do’s
Get business process information in SplunkSOA messagesOrder tables (rising column)Logs, logs, logs
Get a Splunk expert on board.Create dashboards for test teams (detail)Create dashboards for management (pretty pictures)Train testers and admins
21
22
Splunk in test
Speeds up test phasesPrevents incidents in productionAn answer to today’s test challenges Facts and figures on qualityIncrease time to market Benefits increase exponentially with complexity
22
23
So why in test?
first time righthandle agile development handle complexityspeed up integration
23
24
Find a question?
24
Diagrams, Icons and Templates
25
26
Splunk Icons
Search Bar chart Lock Cloud Cloud – alt Folder Envelope
Storage - 3Storage
Server Indexer Forwarder Search head
Datacenters
Splunk serverFirewall
Desktop Laptop
Failed server
Hadoop storage Datacenter
27
Splunk Icons
Application - alt Virtual machine Virtual server Network www or Global Tools
Log file Router Load balancer Script
Pie chart Gears/Settings Gear Messaging Tag/ticket
Document
Application
Analyze
Network Switch
Shield
Active Directory
28
Splunk Icons
Checkmark InfoAlert StopiPhoneiPadAndroid
Twitter Facebook LinkedIn RSS You Tube Shopping cartGPS Tower
Healthcare Hospital Office building VoIP Phone Support POS Card Reader RFID
29
Splunk Icons
Forwarder - AIX Forwarder- Datastore Forwarder- Free BSD Forwarder- Linux Forwarder- Windows Forwarder- Web Forwarder- OSX
Forwarder- Solaris Splunk server - AIX Splunk server - Datastore
Splunk server - Gear
Splunk server - Linux
Splunk server - Network
Splunk server - Web
Splunk server - OSX Splunk server – Free BSD
Splunk server – Solaris Splunk search Failed Splunk server
30
Splunk Icons
31
Splunk Icons
Pivot
Cluster management
Analytics Store Data model
Forwardermanagement
HomeMaps
Predictiveanalytics
Simpledashboard
Webframework
Customdashboard
Enhanced search
32
Arrows
33
Boxes
34
Assign Default Object Style
35
Splunk Object Style and Color
Hardware ProductBusiness/Corporate
Highlight OnlyGenericVirtualization
Generic
These are suggested uses for colors only.
36
Applying Splunk Object Style
To apply the Splunk object style to any shape:1. Select the shape (Object A) with the desired style2. Click on Format Painter (paintbrush) tool in toolbar3. Click on new shape (Object B) to apply style
37
Logos
Corporate logo Product logo Product logo with Version Number
38
Logos
39
Logos
40
App Icons
41
Splunk Enterprise Overview
AlertsMessages Metrics ChangesScriptsConfigurationsLog Files
Indexes Any Data from Any Source
DatabasesNetworks Servers Virtual Machines
Smartphones and Devices
CustomApplicationsSecurity
Tickets
WebServerSensors
42
Splunk Enterprise ScalabilityEnterprise-class Scale, Resilience and Interoperability
Send data from thousands of servers using any combination of Splunk forwarders
Auto load-balanced forwarding to Splunk Indexers
Offload search load to Splunk Search Heads
43
Integrated Analytics Platform for Hadoop Data
43
Full-featured, Integrated Product
Insights for Everyone
Works with What You Have Today
Explore Visualize Dashboards ShareAnalyze
Hadoop (MapReduce &
HDFS)
NoSQL Data Stores
44
Industry Leading Platform for Machine DataAny Machine Data Operational Intelligence
HA Indexes and Storage
Search and Investigation
Proactive Monitoring
Operational Visibility
Real-time Business Insights
CommodityServers
Online Services Web
Services
ServersSecurity GPS
Location
StorageDesktops
Networks
Packaged Applications
CustomApplicationsMessaging
TelecomsOnline
Shopping Cart
Web Clickstreams
Databases
Energy Meters
Call Detail Records
Smartphones and Devices
RFID
45
Table ExampleColumn Title Column Title Column Title Column Title
Text Text Text Text
Text Text Text Text
Text Text Text Text
Text Text Text Text
Text Text Text Text
46
Quote Box
Our mission is to make machine data accessible, useable and valuable to everyone.
Thank You