Mongo db at_customink

@nathenharveyNathen Harvey

Hello!

Nathen HarveyWeb Operations at CustomInknharvey@customink.com@nathenharvey

Organize MongoDC MeetupsSee you there next month!

@nathenharveyNathen Harvey @nathenharveyNathen Harvey

Thanks for attending

In the other trackEliot Horowitz, CTO & Co-Founder, 10gen

Schema Design at Scale

CustomInk

CustomInk Customers

Customer Reviews

Nathen HarveyNathen Harvey

CustomInk Technology

Divide our technology into two classes:ECommerce – pre-checkout and shopping cartOperations Technology – post-check-out, fulfillment, etc.

Ruby on RailsWith some legacy Java

Approximately 30 different applications running in production

CustomInk Databases

Primarily OracleWas the “right” choice 11 years ago when the company was startedNo longer a good solution for us

MySQLPercona Server with XtraDB

MongoDB

ChampionsEasy to set-up and configure“Greenfield” projects with loose schema definitionsMakes development easier and developers happyLimited amount of time between releases

ChallengesNo prior experience with running productionLimited amount of time between releasesUnproven solution

Nathen HarveyNathen Harvey

Problem

Complex Production EnvironmentsOrchestratedServices

Why Mongo?

Introduces company to MongoDBEasily to modify document structureLightweight developmentEasy to install and deployCapped Collections

Central Logger

Subclasses Buffered LoggerIt’s a gem loaded into Rails applications as a RailtieCaptures useful metadataUse the MongoDB Ruby Driverhttp://github.com/customink/central_logger

Central Logger

Record Structure

Log Viewer

Product Catalog

Why Mongo?

Frequently changing requirementsGridFSWide variety of products with varied characteristics

Case for Document-based Schema

Application Architecture

Rails application for managing the product catalogWrites to MongoDB as it’s databaseUtilizes GridFS for storing filesUses Mongoid as the ODM

Implementation Flow

Oracle MongoDB

ECommerceApplication

CatalogApplication

Next Steps

Continue to adopt MongoDB in the Operations Technology applicationsBegin using MongoDB with ECommerce applications

Reporting artwork usageCapturing JavaScript logs

Automated Deployment

Chef is an open source systems integration framework built to bring the benefits of configuration management to your entire infrastructure.We use Chef to manage our infrastructure and deploy MongoDB

MongoDB Cookbook

Use Vagrant and VirtualBox as the development environment for our CookbooksCookbook shared on Github and, soon, OpsCode Community Site.

Monitoring Production

http://github.com/mzupan/nagios-plugin-mongodb

Monitoring Production

Lessons Learned

Capped CollectionsTesting replica set failoverSchema free != design freeJSON in the DB, JQuery in the browser == happy developersmongo_import could not handle carriage returns in CSV filesUnserializable data typesData transformations on a large dataset still painfulUnless you’re sharding, map reduce probably slower and more complex than what you’re used to

MongoDC Meetup

Join fellow MongoDB enthusiasts for a monthly meetupMeetings are held at CustomInk in McLean, VAhttp://www.meetup.com/Washington-DC-MongoDB-Users-Group/

Thank You!

Nathen HarveyWeb Operations at CustomInknharvey@customink.com@nathenharvey

Organize MongoDC MeetupsSee you there next month!

Mongo db at_customink

Technology

Mongo db basics

Mongo DB Presentation

Mongo db aggregation-guide

Mongo db reference-manual

Mongo db iot_london_v0.1

Firstov attacking mongo db

07.2-Mongo DB 1

Mongo db applicationmonitor

Mongo db docker_ec2

Mongo db tutorials

Mongo db security guide

Mongo db administration guide

Mongo db online training

Mongo db london

Mongo DB in Action

Mongo db &_spark

Mongo db bangalore

Mongo db aggregation guide

Rails + mongo db

Mongo DB: Fundamentals & Basics/ An Overview of MongoDB/ Mongo DB tutorials