2014 DevOps Day – Philippines2014 DevOps Day – PhilippinesFebruary 22, 2014February 22, 2014

Microsoft PhilippinesMicrosoft Philippines8th Floor, 6750 Ayala Ave., Makati City

{ { DevOps WayDevOps Way } : Consistent } : Consistent Development Environment using Development Environment using

Vagrant and ChefVagrant and Chef

Gerald Z. VillorenteDevOps Engineer | Drupal Developer | Open-Source EnthusiastDevOps Engineer | Drupal Developer | Open-Source Enthusiast

Gerald Z. VillorenteDevOps Engineer | Drupal Developer | Open-Source EnthusiastDevOps Engineer | Drupal Developer | Open-Source Enthusiast

About MeAbout Me

Started to learn how to use computer in 2005Started to learn how to use computer in 2005 I became a computer technician in 2007I became a computer technician in 2007 I became a Web Developer in 2009I became a Web Developer in 2009 Drupalista since 2011Drupalista since 2011 Drupal Developer at CNN Travel|KiteSystems 2011-2013Drupal Developer at CNN Travel|KiteSystems 2011-2013 DevOps Engineer at BodogNation 2013-2014DevOps Engineer at BodogNation 2013-2014 Drupal Engineer at X-Team 2014-presentDrupal Engineer at X-Team 2014-present

About MeAbout Me

Started to learn how to use computer in 2005Started to learn how to use computer in 2005 I became a computer technician in 2007I became a computer technician in 2007 I became a Web Developer in 2009I became a Web Developer in 2009 Drupalista since 2011Drupalista since 2011 Drupal Developer at CNN Travel|KiteSystems 2011-2013Drupal Developer at CNN Travel|KiteSystems 2011-2013 DevOps Engineer at BodogNation 2013-2014DevOps Engineer at BodogNation 2013-2014 Drupal Engineer at X-Team 2014-presentDrupal Engineer at X-Team 2014-present

The Traditional SetupThe Traditional Setup What is VagrantWhat is Vagrant Why to use VagrantWhy to use Vagrant DevOps with Vagrant in MindDevOps with Vagrant in Mind What is ChefWhat is Chef Why to use ChefWhy to use Chef

The Traditional SetupThe Traditional Setup What is VagrantWhat is Vagrant Why to use VagrantWhy to use Vagrant DevOps with Vagrant in MindDevOps with Vagrant in Mind What is ChefWhat is Chef Why to use ChefWhy to use Chef

Agenda:Agenda:

Your Dev and Prod Your Dev and Prod environment environment

are not the same!are not the same! Different Operating SystemsDifferent Operating Systems Different version of PHP|Python|Ruby|Node.jsDifferent version of PHP|Python|Ruby|Node.js Different configuration filesDifferent configuration files Different libraries and extensionsDifferent libraries and extensions

Your Dev and Prod Your Dev and Prod environment environment

are not the same!are not the same! Different Operating SystemsDifferent Operating Systems Different version of PHP|Python|Ruby|Node.jsDifferent version of PHP|Python|Ruby|Node.js Different configuration filesDifferent configuration files Different libraries and extensionsDifferent libraries and extensions

Well, it worked on my Well, it worked on my machine!machine!

Well, it worked on my Well, it worked on my machine!machine!

Against DevOps principle!Against DevOps principle!Against DevOps principle!Against DevOps principle!

Dev and Ops WarDev and Ops WarDev and Ops WarDev and Ops War

The Right Way!The Right Way!The Right Way!The Right Way!

Virtualized EnvironmentsVirtualized EnvironmentsVirtualized EnvironmentsVirtualized Environments

Consistent Operating Systems and PHP|Python|Ruby|Node.js Consistent Operating Systems and PHP|Python|Ruby|Node.js versions between production and development machine.versions between production and development machine.

New comers can get going with the development right away. No New comers can get going with the development right away. No more painful setups.more painful setups.

Redistributable in case of hardware failure.Redistributable in case of hardware failure.

Consistent Operating Systems and PHP|Python|Ruby|Node.js Consistent Operating Systems and PHP|Python|Ruby|Node.js versions between production and development machine.versions between production and development machine.

New comers can get going with the development right away. No New comers can get going with the development right away. No more painful setups.more painful setups.

Redistributable in case of hardware failure.Redistributable in case of hardware failure.

Reasons why we should:Reasons why we should:Reasons why we should:Reasons why we should:

Can never get the networking between host and guest OS.Can never get the networking between host and guest OS. Scared of the command line.Scared of the command line. Massive overhead keeping the VM up to date.Massive overhead keeping the VM up to date.

Can never get the networking between host and guest OS.Can never get the networking between host and guest OS. Scared of the command line.Scared of the command line. Massive overhead keeping the VM up to date.Massive overhead keeping the VM up to date.

Reasons why we don't:Reasons why we don't:Reasons why we don't:Reasons why we don't:

What What is Vagrant?is Vagrant?

What What is Vagrant?is Vagrant?

A tool for building and A tool for building and distributing virtualized distributing virtualized

environments.environments.

A tool for building and A tool for building and distributing virtualized distributing virtualized

environments.environments.

Why Vagrant?Why Vagrant?Why Vagrant?Why Vagrant?

IsolationIsolationIsolationIsolation

Mirror ProductionMirror ProductionMirror ProductionMirror Production

Test Ops scripts Test Ops scripts with a free serverwith a free serverTest Ops scripts Test Ops scripts

with a free serverwith a free server

Designers and QA Designers and QA can setup their can setup their

environment easilyenvironment easily

Designers and QA Designers and QA can setup their can setup their

environment easilyenvironment easily

Faster OnboardingFaster OnboardingFaster OnboardingFaster Onboarding

Getting StartedGetting Started Install Virtualbox | VMwareInstall Virtualbox | VMware Install VagrantInstall Vagrant Import your base OS (Import your base OS ($ vagrant box add [BASE_NAME] [PATH.box]$ vagrant box add [BASE_NAME] [PATH.box])) Generate Vagrantfile config (Generate Vagrantfile config ($ vagrant init [BASE_NAME]$ vagrant init [BASE_NAME])) Boot your guest machine (Boot your guest machine ($ vagrant up$ vagrant up))

Getting StartedGetting Started Install Virtualbox | VMwareInstall Virtualbox | VMware Install VagrantInstall Vagrant Import your base OS (Import your base OS ($ vagrant box add [BASE_NAME] [PATH.box]$ vagrant box add [BASE_NAME] [PATH.box])) Generate Vagrantfile config (Generate Vagrantfile config ($ vagrant init [BASE_NAME]$ vagrant init [BASE_NAME])) Boot your guest machine (Boot your guest machine ($ vagrant up$ vagrant up))

DemoDemoDemoDemo

That's the OS only. That's the OS only. How about the How about the

packages I needed?packages I needed?Should I install them manually?Should I install them manually?

That's the OS only. That's the OS only. How about the How about the

packages I needed?packages I needed?Should I install them manually?Should I install them manually?

Well, you have 2 options.Well, you have 2 options. Package an existing running environment. Package an existing running environment.

$ vagrant package --base VM_ID --output BOX_NAME.box Use Chef or Puppet to provision that packages and needed config.Use Chef or Puppet to provision that packages and needed config.

Well, you have 2 options.Well, you have 2 options. Package an existing running environment. Package an existing running environment.

$ vagrant package --base VM_ID --output BOX_NAME.box Use Chef or Puppet to provision that packages and needed config.Use Chef or Puppet to provision that packages and needed config.

DevOps with DevOps with Vagrant in MindVagrant in Mind

DevOps with DevOps with Vagrant in MindVagrant in Mind

The Goal:The Goal: Develop Develop Cookbooks and Modules Cookbooks and Modules

to run in a to run in a VM and ProductionVM and Production

The Goal:The Goal: Develop Develop Cookbooks and Modules Cookbooks and Modules

to run in a to run in a VM and ProductionVM and Production

Little Extra EffortLittle Extra EffortBig GainBig Gain

Good PracticesGood Practices

Little Extra EffortLittle Extra EffortBig GainBig Gain

Good PracticesGood Practices

Vagrant and DevOps:Vagrant and DevOps:

ChefChefA tool for automating the provisioning and management of serversA tool for automating the provisioning and management of servers

ChefChefA tool for automating the provisioning and management of serversA tool for automating the provisioning and management of servers

A Good ExampleA Good ExampleA Good ExampleA Good Example

Why Chef?Why Chef?Why Chef?Why Chef?

Less documentationLess documentationLess documentationLess documentation

Bash doesn't scale. Bash doesn't scale. Seriously.Seriously.

Bash is a wonderful thing, but like all UNIX tools, it is fundamentally Bash is a wonderful thing, but like all UNIX tools, it is fundamentally limited by design. Bash doesn't have a code reuse mechanism more limited by design. Bash doesn't have a code reuse mechanism more

powerful than functions.powerful than functions.

Bash doesn't scale. Bash doesn't scale. Seriously.Seriously.

Bash is a wonderful thing, but like all UNIX tools, it is fundamentally Bash is a wonderful thing, but like all UNIX tools, it is fundamentally limited by design. Bash doesn't have a code reuse mechanism more limited by design. Bash doesn't have a code reuse mechanism more

powerful than functions.powerful than functions.

Maybe you can do this using “sed”. But hey are you sick? Maybe you can do this using “sed”. But hey are you sick? Maybe you can do this using “sed”. But hey are you sick? Maybe you can do this using “sed”. But hey are you sick?

Technical Awesomeness.Technical Awesomeness.Technical Awesomeness.Technical Awesomeness.

NOSQL FTWNOSQL FTWOne of the virtues that many *nix tools share is that they store their One of the virtues that many *nix tools share is that they store their

configurations in text files rather than binary formats or in a configurations in text files rather than binary formats or in a database. database.

Chef stores your system configurations in text Chef stores your system configurations in text and in a database. It accomplishes this by using the document-and in a database. It accomplishes this by using the document-

oriented database, CouchDB.oriented database, CouchDB.

NOSQL FTWNOSQL FTWOne of the virtues that many *nix tools share is that they store their One of the virtues that many *nix tools share is that they store their

configurations in text files rather than binary formats or in a configurations in text files rather than binary formats or in a database. database.

Chef stores your system configurations in text Chef stores your system configurations in text and in a database. It accomplishes this by using the document-and in a database. It accomplishes this by using the document-

oriented database, CouchDB.oriented database, CouchDB.

Knowing is Half the BattleKnowing is Half the BattleChef uses Ohai to collect data about your system. Your recipes can Chef uses Ohai to collect data about your system. Your recipes can

access these attributes and make decisions based on them. access these attributes and make decisions based on them. For example, you can determine which version of Red Hat you are For example, you can determine which version of Red Hat you are

using simply by looking up the value of node['platform_version']. You using simply by looking up the value of node['platform_version']. You don't have to cat | grep | awk to find out which release you are on.don't have to cat | grep | awk to find out which release you are on.

Knowing is Half the BattleKnowing is Half the BattleChef uses Ohai to collect data about your system. Your recipes can Chef uses Ohai to collect data about your system. Your recipes can

access these attributes and make decisions based on them. access these attributes and make decisions based on them. For example, you can determine which version of Red Hat you are For example, you can determine which version of Red Hat you are

using simply by looking up the value of node['platform_version']. You using simply by looking up the value of node['platform_version']. You don't have to cat | grep | awk to find out which release you are on.don't have to cat | grep | awk to find out which release you are on.

SearchSearchSearch is a feature in Chef Server that allows you to query the Search is a feature in Chef Server that allows you to query the

configuration information of all other servers and of globally-defined configuration information of all other servers and of globally-defined databags (global variable). This allows you to do things like configure databags (global variable). This allows you to do things like configure clusters where a member of cluster needs to know not only about its clusters where a member of cluster needs to know not only about its

own configuration but about the configurations of the other own configuration but about the configurations of the other members of the cluster.members of the cluster.

SearchSearchSearch is a feature in Chef Server that allows you to query the Search is a feature in Chef Server that allows you to query the

configuration information of all other servers and of globally-defined configuration information of all other servers and of globally-defined databags (global variable). This allows you to do things like configure databags (global variable). This allows you to do things like configure clusters where a member of cluster needs to know not only about its clusters where a member of cluster needs to know not only about its

own configuration but about the configurations of the other own configuration but about the configurations of the other members of the cluster.members of the cluster.

KnifeKnifeKnife is one of the truly great command line tools. It is your primary Knife is one of the truly great command line tools. It is your primary mechanism for interacting with the chef-server. Knife shares many mechanism for interacting with the chef-server. Knife shares many

usage patterns with git. If you love git, you'll love knife.usage patterns with git. If you love git, you'll love knife.

KnifeKnifeKnife is one of the truly great command line tools. It is your primary Knife is one of the truly great command line tools. It is your primary mechanism for interacting with the chef-server. Knife shares many mechanism for interacting with the chef-server. Knife shares many

usage patterns with git. If you love git, you'll love knife.usage patterns with git. If you love git, you'll love knife.

ShefShefShef works the way you work, in an iterative manner. Most of us Shef works the way you work, in an iterative manner. Most of us system administrators are self-taught and we learn best by doing. system administrators are self-taught and we learn best by doing. Fire up shef and you can on the fly play with attributes and create Fire up shef and you can on the fly play with attributes and create recipes. Further, you can connect to your server and download the recipes. Further, you can connect to your server and download the

cookbooks.cookbooks.

ShefShefShef works the way you work, in an iterative manner. Most of us Shef works the way you work, in an iterative manner. Most of us system administrators are self-taught and we learn best by doing. system administrators are self-taught and we learn best by doing. Fire up shef and you can on the fly play with attributes and create Fire up shef and you can on the fly play with attributes and create recipes. Further, you can connect to your server and download the recipes. Further, you can connect to your server and download the

cookbooks.cookbooks.

Chef grows with you.Chef grows with you.Chef uses pure Ruby as its configuration language, not a shackled Chef uses pure Ruby as its configuration language, not a shackled

subset of ruby, nor yet another custom configuration language. You subset of ruby, nor yet another custom configuration language. You only have to learn a small amount of ruby to get started with chef.only have to learn a small amount of ruby to get started with chef.

Chef grows with you.Chef grows with you.Chef uses pure Ruby as its configuration language, not a shackled Chef uses pure Ruby as its configuration language, not a shackled

subset of ruby, nor yet another custom configuration language. You subset of ruby, nor yet another custom configuration language. You only have to learn a small amount of ruby to get started with chef.only have to learn a small amount of ruby to get started with chef.

You can stop You can stop reinventing the wheel.reinventing the wheel.

Until Chef, we sysadmins did not have a truly modular way to Until Chef, we sysadmins did not have a truly modular way to abstract and share our system configurations.abstract and share our system configurations.

You can stop You can stop reinventing the wheel.reinventing the wheel.

Until Chef, we sysadmins did not have a truly modular way to Until Chef, we sysadmins did not have a truly modular way to abstract and share our system configurations.abstract and share our system configurations.

DemoDemoDemoDemo

I don't know Ruby. How I don't know Ruby. How can I create a robust can I create a robust

script|recipe|manifest?script|recipe|manifest?

I don't know Ruby. How I don't know Ruby. How can I create a robust can I create a robust

script|recipe|manifest?script|recipe|manifest?

rove.iorove.iorove.iorove.io

PuPHPetPuPHPetPuPHPetPuPHPet

Questions?Questions?Questions?Questions?

Thank You!Thank You!Thank You!Thank You!

1. http://www.scoop.it/1. http://www.scoop.it/2. http://devopsanywhere.blogspot.com/2. http://devopsanywhere.blogspot.com/3. 3. http://www.vagrantup.com/http://www.vagrantup.com/4. 4. https://puphpet.com/https://puphpet.com/5. 5. http://rove.io/http://rove.io/6. 6. http://www.getchef.com/http://www.getchef.com/7. http://puppetlabs.com/7. http://puppetlabs.com/

1. http://www.scoop.it/1. http://www.scoop.it/2. http://devopsanywhere.blogspot.com/2. http://devopsanywhere.blogspot.com/3. 3. http://www.vagrantup.com/http://www.vagrantup.com/4. 4. https://puphpet.com/https://puphpet.com/5. 5. http://rove.io/http://rove.io/6. 6. http://www.getchef.com/http://www.getchef.com/7. http://puppetlabs.com/7. http://puppetlabs.com/

References:References:References:References:

1. Mitchell Hashimoto 1. Mitchell Hashimoto Founder of HashiCorp, Creator of Vagrant and PackerFounder of HashiCorp, Creator of Vagrant and Packer2. Opscode 2. Opscode Creator of ChefCreator of Chef3. Puppet Labs 3. Puppet Labs Creator of PuppetCreator of Puppet

1. Mitchell Hashimoto 1. Mitchell Hashimoto Founder of HashiCorp, Creator of Vagrant and PackerFounder of HashiCorp, Creator of Vagrant and Packer2. Opscode 2. Opscode Creator of ChefCreator of Chef3. Puppet Labs 3. Puppet Labs Creator of PuppetCreator of Puppet

Credits:Credits:Credits:Credits: