ODPi 101: Who we are, What we do

ODPi 101: Who We Are, What We Do Alan Gates

Apache MemberCo-founder, Hortonworks

Chairperson ODPi Technical Steering [email protected]

@alanfgates#futureofdata

4ZBDATA

INTERNETOF

ANYTHING

44ZBDATA

TOMORROW

2

AGE OF DATAOpen source is the norm,

and Apache is the center of gravity

3

4

Assembly of data-defined applications

INTRODUCTORY PRESENTATION

Who we are and our objectives

Non-profit organization committed to simplification and standardization of the big data ecosystem

Removes costs and complexity and accelerates the development of Big Data solutions

Provide a common runtime, reference implementations and test suites

Open ecosystem of big dataCommon Reference Specification

5

• ODPi, a Linux Foundation Collaborative Project, operates under an open governance model

• Any company can join as a member

• All member companies have an equal vote on ODPi Core decisions

• The elected Board of Directors is responsible for the

financial, legal, and promotional aspects of ODPi

Collaborative, Independent, and Openly-Governed


29 member companies

35 maintainers

6

INTRODUCTORY PRESENTATION 7


What Benefit Does ODPi Bring?

8

Without ODPiMulti-distro certifications and regression testing increases ISV development, burden, and enterprise support costs

With ODPi


What Benefit Does ODPi Bring? (cont’d.)

• Run any “ODPi-compatible” big data software on any “ODPi-compliant” platformEnd-Customers

• ISVs• Apps

Developers• System

Integrators

Hadoop platform providers

• Compatibility guidelines to “test once, run everywhere.”

• Eliminate the burden and cost of certification and testing across multiple Hadoop distributions.

• Predictable release cadence and reduced maintenance and support costs.

• Compliance guidelines that enable ODPi-compatible software to run successfully on their solutions.

• The guidelines allow providers to patch their customers in an expeditious manner to deal with emergencies.

9

• Hadoop 2.7o HDFS, YARN, and MapReduce

• Use version 7 or 8 of Java• Not alter the public API• Vendors may include patches, but not feature patches• Vendors may include additional features/functions

o They make the source code availableo Code must be committed to the ASF

Runtime Spec• Ambari 2.3.0 (future release)• Use version 7 or 8 of Java• Defines how distributions and ISVs should define and

deploy custom stacks and services• Provides standards for custom views and for

monitoring custom applications

Operations Spec (draft)

Runtime and Operations Spec Components


Now available

10

June/July

Big Data Application Vendors can test their App and be confident that it will run on All

ODPi Runtime-Compliant Distros

Big Data Application Vendors can deploy and monitor their in any ODPi Operations-

Compliant Distros

ODPi leverages Apache Bigtop testing capabilities


Packaging Smoke testing Virtualization

Bigtop packages Hadoop RPMs and DEBs, so that you can manage and maintain your Hadoop cluster.

Bigtop provides an integrated smoke testing framework, alongside a suite of over 50 test files.

Bigtop provides vagrant recipes, raw images, and (work-in-progress) docker recipes for deploying Hadoop from zero.

● The ODPi Test Framework is based on Apache Bigtop. ○ More than 50% of the code in the latest Big Top release originated in ODPi

● All ODPi Runtime-Compliance tests are linked directly to lines in the ODPi Runtime Specification

● To assist with compliance, in addition to the test suite, ODPi also provides:○ A reference build○ Recipes for building VM, Vagrant, and Docker images

11


1) Become ODPi member www.odpi.org

2) Get involved with the ODPi project on GitHub http://www.github.com/odpi

3) Join ODPi User Advisory Board (UAB)

Get Involved!

12

http://visitwww.odpi.org/members

http://www.github.com/odpi

Technology

ODPi 101: Who we are, What we do