29
Copyright © 2016 Splunk Inc. Marc Chéné IT Markets Product Manager, Splunk Denis Gladkikh Principal Dev Engineer (aka outcoldman), Splunk Monitoring and Troubleshooting Docker Across Cloud and On-prem Environments

Monitoring and Troubleshooting Docker Across Cloud and On-prem

  • Upload
    vudat

  • View
    228

  • Download
    2

Embed Size (px)

Citation preview

Page 1: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Copyright©2016Splunk Inc.

MarcChénéITMarketsProductManager,Splunk

DenisGladkikhPrincipalDevEngineer(akaoutcoldman),Splunk

MonitoringandTroubleshootingDockerAcrossCloudandOn-prem Environments

Page 2: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Whoweare?MarcChéné– Engineer,ITMarketsProductManager,APMer– Dadto3,super-fanandcoach– Loverofskiing,golfing,musicandgooddrink– Residentgroundskeeper/gardener– Twitter:@marccheneDenisGladkikh– Systemprogrammingdeveloper - building

Enterpriseapplications,MobileApps,DevToolsand scalablesystems

– Opensourcecontributor(VSCode, Docker,cAdvisor,antigen,MongoCDriver andmore...).

– Skydiver,Scuba diver,Downhill/nordic skier,hiker, GSDowner

– Twitter:@outcoldman

Page 3: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Disclaimer

3

Duringthecourseofthispresentation,wemaymakeforwardlookingstatementsregardingfutureeventsortheexpectedperformanceofthecompany.Wecautionyouthatsuchstatementsreflectourcurrentexpectationsandestimatesbasedonfactorscurrentlyknowntousandthatactualeventsorresultscoulddiffermaterially.Forimportantfactorsthatmaycauseactualresultstodifferfromthose

containedinourforward-lookingstatements,pleasereviewourfilingswiththeSEC.Theforward-lookingstatementsmadeinthethispresentationarebeingmadeasofthetimeanddateofitslivepresentation.Ifreviewedafteritslivepresentation,thispresentationmaynotcontaincurrentoraccurateinformation.Wedonotassumeanyobligationtoupdateanyforwardlookingstatementswemaymake.Inaddition,anyinformationaboutourroadmapoutlinesourgeneralproductdirectionandissubjecttochangeatanytimewithoutnotice.Itisforinformationalpurposesonlyandshallnot,beincorporatedintoanycontractorothercommitment.Splunkundertakesnoobligationeithertodevelopthefeaturesor

functionalitydescribedortoincludeanysuchfeatureorfunctionalityinafuturerelease.

Page 4: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Agenda Agenda

WhatisDocker?HowtoMonitorContainers?Splunk AnalyticsforDockerMonitoringyourCloudContainers

Page 5: Monitoring and Troubleshooting Docker Across Cloud and On-prem

First,abitaboutcontainers…

Page 6: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Docker,inoneSlide

6

Build- Ship- Runyourapplications– ”Infrastructureascode”– Enablesmicroservices architectures– Portable– EnablesCloudMigration

OpenSourceandCommunityMinded– DockerEngineisOpenSource– Thousandsofappscanbe“pulled”in

DockerHub/DockerStore– YourdevelopersLOVEDocker

Page 7: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Docker– It’snotVirtualization

7

VMs– focusonOSDocker– focusonapplicationsDocker– lightweightandFASTNOTmutuallyexclusivewithVMs

Page 8: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Docker– it’sabigdeal

8

OpenSourcedrivenecosystem

Massiveincreaseinadoption…

…Butthegrowthisjustgettingstarted

Page 9: Monitoring and Troubleshooting Docker Across Cloud and On-prem

3PrimaryContainerUseCases

ApplicationModernization

DevOps – NewApps

CloudMigration

9

Page 10: Monitoring and Troubleshooting Docker Across Cloud and On-prem
Page 11: Monitoring and Troubleshooting Docker Across Cloud and On-prem

DockerAddressesCustomerPainPoints

11

StandardizationbetweendevandproductionenvironmentsLessefforttoputintoreleasemanagement=fasterdevelopment

“Butitworkedindev...”

Page 12: Monitoring and Troubleshooting Docker Across Cloud and On-prem

DockerCreatesNewMonitoringChallenges

12

NewlayersofabstractionContainershaveShortlifespansYoustillhavedependenciesonotherlevelsofthestackNewconsumersofmonitoringdata

Containermonitoringandtroubleshootingneedstobeeasy,focusedonanalytics,andrelatedwithotherpartsofyourinfrastructure

Page 13: Monitoring and Troubleshooting Docker Across Cloud and On-prem

HowtoMonitorContainers?- GettingDataIn(GDI)

13

Page 14: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Splunk LogStreamingOptionsforDockerDockerNativeLogging– Splunkloggingdriver,Syslog,AWS,JSONfiles,etc.

Logginglibraries in.NET,Javaandnode.js

Custom(e.g.,KafkawithHTTPEventCollector)

UniversalForwarder– AppLogs,Syslogforwarding,Performance,etc.

Cloud– AWS,GCP,Azure

Usetheoptionthatisrightforyou!

Page 15: Monitoring and Troubleshooting Docker Across Cloud and On-prem

VisibilitytoyourContainerEnvironments

Secure—supportsTLS/SSLandtokensSimple– config-basedsetupandcollectdataScale– BasedonHTTPDataCollectorBasedonSplunk HTTPConfigurable- Supportscontainerlabels,environmentvariables

SplunkLoggingDriverforDocker

BasedonSplunkHTTPEventCollector+DriverbuiltdirectlyintoDocker

Page 16: Monitoring and Troubleshooting Docker Across Cloud and On-prem

VisibilityintoyourContainerEnvironmentsSkipverificationforthevalidsplunk urlRawdatacollectionfromthenativelogdriverEmbeddedjson formatsupport

SplunkLoggingDriverforDocker(comingsoondocker 1.13)

Page 17: Monitoring and Troubleshooting Docker Across Cloud and On-prem

VisibilitytoyourContainerEnvironmentsLogs– AccesstoApplogs,syslogUDPforwarding,JournalDStats– DatafromDockercontainersSearch– TroubleshootDockerrelatedproblemsDashboardsandAlerts-ProactivelymonitorDockerenvironments

AddingUniversalForwarderstoyourDockerEnvironments

ManywaystogetDocker-basedmachinedata– choosewhat’sbestforyou

Page 18: Monitoring and Troubleshooting Docker Across Cloud and On-prem

Splunk Analytics

- Splunk Images- It’sTimeforAnalytics

18

Page 19: Monitoring and Troubleshooting Docker Across Cloud and On-prem

DeliveringSplunkasaContainerImage

19

Splunk containerimages– Splunk Enterprise6.4.1– Splunk UniversalForwarder6.4.1IncludesconfigurationandDockerAdd-Onforcontainermonitoringout-of-the-boxCertifiedimageComingsoontotheDockerStore(http://store.docker.com)

docker run splunk/enterprise:6.4.1-monitordocker run splunk/universalforwarder:6.4.1-monitor

Page 20: Monitoring and Troubleshooting Docker Across Cloud and On-prem

DemoSetup

20

Usecase:ContainerLogAnalysisandMonitoring“fullstack”applicationwith4containersmonitoredwithSplunk– MariaDB – ouropensourcedatabaselayer– Wordpress -- aratherbusyapplication– My_app – ourmade-upapp– Splunk – yes,we’rerunningSplunk INACONTAINER!Keytakeaways– Time-to-value– Splunk ispre-configuredtodiscoverandcollectmachinefromall

yourcontainersrunningonanode– Insightacrosslogsandmetrics– Insightintocontainers,applications,compliance,andthedatathoseapplications

generate– Docker– upandrunningfast!

Page 21: Monitoring and Troubleshooting Docker Across Cloud and On-prem

DemoTime!

- GettingDataIn(GDI)- Splunk LoggingDriver- Analytics

21

Page 22: Monitoring and Troubleshooting Docker Across Cloud and On-prem

MonitoringyourCloudContainers

22

Page 23: Monitoring and Troubleshooting Docker Across Cloud and On-prem

MonitoringforYourCloudEnvironments

23

AmazonWebServiceintegrationviaCloudWatch andElasticContainerService(ECS)GoogleCloudPlatformintegrationviaStackdriver Pub/SubandcloudmonitoringAPIs

Page 24: Monitoring and Troubleshooting Docker Across Cloud and On-prem

SampleDockerCloudData

Page 25: Monitoring and Troubleshooting Docker Across Cloud and On-prem

VisibilitytoyourContainerEnvironmentsSplunkAdd-OnforDockerUniversalControlPlane

MonitorChanges– Identifychangesincontainers,updatestocontainerdeploymentsUsageInsight– Insightintocontainers,clusters,andnodesAnalyzeandCorrelate– Changes,usage,errorsandconfiguration

ImproveDockercontainercompliance,availabilityandperformance

Page 26: Monitoring and Troubleshooting Docker Across Cloud and On-prem

# 1. Come visit us at our boothdocker run splunk/visitourboothvisitourbooth_1 | Booth IT Markets

# 2. Test out our Splunk logging driverdocker run --name wordpress --label web=wordpress \--log-driver=splunk \--log-opt splunk-token=00000000-0000-0000-0000-000000000000 \--log-opt splunk-url=https://192.168.99.100:8088 \--log-opt labels=web --log-opt tag="{{.Name}}" \--publish 80:80 \-d wordpress

CalltoAction…

Page 27: Monitoring and Troubleshooting Docker Across Cloud and On-prem

# 3. Try out our docker images in Docker Storedocker run splunk/enterprise:6.4.1-monitordocker run splunk/universalforwarder:6.4.1-monitor

# 4. Demos will all be available on GitHub under Splunk!git clone https://github.com/splunk/docker-gettingstarted-conf2016.git

# 5. Visit our site to learn more about containerscurl http://www.splunk.com/containers

CalltoAction…

Page 28: Monitoring and Troubleshooting Docker Across Cloud and On-prem

WhatNow?

28

HowtorunSplunk asaDockerImage?SessionID:SF88089

Relatedbreakoutsessionsandactivities…

Page 29: Monitoring and Troubleshooting Docker Across Cloud and On-prem

THANKYOU