Embed Size (px)
Citation preview
Enterprise Search and Big DataBenefits, Challenges & Uses
Cathy McKnightDigital Clarity GroupAugust 2012
2
Presenter
Cathy McKnight• Partner & Principal
Analyst, Digital Clarity Group
• Industry consultant 15+ years
• Runner, gardener, photographer, social media enthusiast
What are we talking about?
Big DataBig Data is a general term used to describe the voluminous amount of unstructured and semi-structured data a company creates -- data that would take too much time and cost too much money to load into a relational database for analysis. Although Big data doesn't refer to any specific quantity, the term is often used when speaking about petabytes and exabytes of data.
~ TechTarget
Enterprise SearchEnterprise search is the organized retrieval of structured and unstructured data within an organization. Properly implemented, enterprise search creates an easily navigated interface for entering, categorizing and retrieving data securely, in compliance with security and data retention regulations.
~ TechTarget
What is Big Data, really?
Large Unstructured Real-time
Just how large is Big?Unit Just how many zeros is that? Reality CheckKilobyte(kB) 1 000 bytes ½ page of text
Megabyte (MB) 1 000 000 bytes Small novel
Gigabyte (GB) 1 000 000 000 bytes Printed paper filling up a pick-up
Terabyte (TB) 1 000 000 000 000 bytes 50K trees made into paper and
printedPetabyte (PB) 1 000 000 000 000 000 bytes 2 PB = All content in U.S.
academic research librariesExabyte (EB) 1 000 000 000 000 000 000 bytes 5 EB = All words ever spoken
And Big is getting Bigger
“Between the birth of the world and 2003, there were five exabytes of information created. We [now] create five exabytes every two days.”
Eric Schmidt CEO, Google August 2010
What does unstructured mean?
Text Heavy Irregular/
ambiguous Difficult to search
and/or analyze Sources:– Email– Social– Rich data
files
Real time means NOW!
• More data, coming in faster
• Decision windows getting smaller
• Valuable to worthless in a matter of minutes .. no seconds … no milliseconds.
This isn’t new(s)
But there is new(s) in Big Data
Big can now be made small(er). Search (and other)
technology today lets us make Big Data smaller and more manageable.
How has/does it affect business?
Data is becoming the new raw material of business: an economic input almost on a par with capital and labour. “Every day I wake up and ask, ‘how can I flow data better, manage data better, analyse data better?” says Rollin Ford, the CIO of Wal-Mart.
Source: Data, Data EverywhereThe Economist, February 25, 2010
12
Big Data challenges and frustrations
Working with Big Data is akin to …
13
But it does have potential benefits
Can be used to identify:– Trends– Patterns– Risk
Big Data Analysis
14
Cool (if not useful) Big Data use cases
