Embed Size (px)
Citation preview
@wattsteve
Hadoop for the disillusioned Steve Watt, Red Hat
CC flickr rubenswieringa
@wattsteve
@wattsteve
Wired Magazine - July 2008
@wattsteve
Hadoop in 2013
CC flickr lowfatbrains
Platform Layers Technologies
Computational Runtimes
YARN, GiRAPH, MapReduce, HBase, Phoenix, Spark/BDAS, Drill, Impala, Stinger & more
FileSystems Azure, CassandraFS, CephFS, CleverSafe, GlusterFS, GridGain, HDFS, LustreMapR FS, S3, SWIFT, Quantcast FS, Symantec VCFS & more
Infrastructures System on a Chip, x86, Virtualization and Cloud
Distributions Cloudera, Hortonworks, IBM, Intel, MapR, WanDisco
@wattsteveSource: Gartner Hype Cycle
@wattsteveCC flickr kakadu
Your data is growing beyond your ability to manage & query it
@wattsteveCC flickr martijnsnels
Save money when asking the same questions of your data
@wattsteve
Geoffrey Moore’s Technology Adoption Lifecycle
CHASM
Innovators EarlyAdopters
EarlyMajority
LateMajority
Laggards
Hadoop Customer, “Great, but now what?”
@wattsteveCC flickr cbcastro
new
and build data products
@wattsteveCC flickr birdwatcher63
Ask your domain experts and LOB folks what unanswered questions they have Where can you get the data you need to answer that question? (domain experts should know
where to get it) Some of this data may be outside your organization (Social Media, Sensor Data, Data
brokerages/Marketplaces, Web Pages) and some of it may be inside. If the data for the query doesn’t exist, figure out how to instrument or gather it. Pair your domain experts with your data engineers so they can work out how to obtain and
massage the data given the types of queries desired
@wattsteveCC flickr syume
• Building data products is a similar exercise except that it involves typical product planning, such as identifying a market.
• This is also a great way for an organization to explore what assets they have within their data
@wattsteve
Mapping the night sky
CC flickr bobfamiliar
@wattsteveCC flickr oxfam
Analyzing farm soil content to predict human conflict
@wattsteveCC flickr flodigrip
Crisis Management for the Chilean Earthquake
