From MapReduce to Apache Spark

1©Cloudera,Inc.Allrightsreserved.

FromMapReduce toApacheSpark:AnEcosystemEvolvesDougCutting(@cutting)ChiefArchitect/ApacheHadoopCo-founder

2©Cloudera,Inc.Allrightsreserved.

TheMergingEcosystems

3©Cloudera,Inc.Allrightsreserved.

Genomics(Broad Institute)

Physics(CERN)

Healthcare Delivery(CHOA)

TheNewUseCasesareAmazing

4©Cloudera,Inc.Allrightsreserved.

BringYourQuestions AboutLivytotheClouderaBooth

Livy.io

• ForsubmittingSparkjobsfromanyweb/mobileapp,withnoSparkclientinstall — enablingnewarchitecturesandusecases

• Providesmulti-tenancyandfaulttolerancetosupportmultipleusersreliably

• Works instandalonemode,withYARN,orwithMesos

• Nocodechangesneeded

• ApacheLicense.Initialcontributors includeemployeesofCloudera,Intel, andMicrosoft+morewanted!

NewContribution:Livy,anOpenSourceRESTServiceforSpark(Alpha)

5©Cloudera,Inc.Allrightsreserved.

Thankyou@cutting

cloudera.com/spark