Unlock your Big Data with Analytics and BI on Office365

Brian Culver ● SPS Utah ● SPT 104 ● March 1-3, 2016

About Brian Culver, MCM

SharePoint Solutions Architect for Expert Point Solutions in Houston, Texas. Microsoft Certified Master (MCM) in SharePointMicrosoft Certified Professional Developer (MCPD). Brian has worked in the Information Technology industry for

since 1998 and he has been working with SharePoint since 2005. His deep expertise includes Azure, Office365, SharePoint, ASP.Net, SQL Server and Project Server. He has been involved in many large SharePoint implementations including Internet and Intranet sites, Partner Portals, Enterprise Content Management and Governance, and much custom application integration and development. Author, Speaker and Blogger

Email : brian.culver(at)expertpointsolutions.comTwitter : @spbrianculverLinkedIn : https://www.linkedin.com/in/bculver Blog : http://blog.expertpointsolutions.com

Session Agenda

What is Big Data?Understanding Sentiment AnalysisConnecting Big Data and Business IntelligenceCreate an Azure HDInsight Cluster Load data into Blob StorageValidate data via HDInsightHadoop and C#Visualizing Results via PowerViewClosing comments

What is Big Data?

Big Data is about personalization and knowledge. Understanding our customers and relationships to the world.

• 27% of customers have seen Personalization online

• 86% of those say Personalization influenced what they purchased to some extent

• 31% want a more Personalized experience

• 59% of customers who have experienced Personalization believe it has a noticeable influence on purchasing

• 58% prefer product recommendations from previous purchases over other forms of personalization

What is Big Data?

What is Big Data?

What is Big Data?

What is Big Data?

Big Data is data that is “too” complex, large, and/or fast.Big Data offers a new set of approaches for analyzing data sets that were not previously accessible which posed challenges across one or more of the “3 V’s”:

Volume - too big and large - Terabytes (and more) of credit card transactions, web usage data, system logs, etc.

Variety - too Complex - Unstructured data such as social media, customer reviews, call center records, etc.

Velocity - too Fast - Sensor data, live web traffic, mobile phone usage, GPS data, etc.

Data Complexity: Variety and Velocity

Terabytes

Gigabytes

Megabytes

Petabytes

What is Big Data?

What is Big Data?

Web app optimization

Smart meter monitoring

Advertising analysis

Fraud detection

Healthcare outcomes

Weather forecasting

Natural resource exploration

Social network analysis

Traffic flow optimization

IT infrastructure optimization

Legal discovery

COMMON BIG DATA CUSTOMER SCENARIOS

GAIN COMPETITIVE ADVANTAGE BY MOVING FIRST AND FAST IN YOUR INDUSTRY

Internet of Things (IoT)

What is Big Data?

How are customers using HDInsight?Azure HDInsight + Machine LearningHow Pier 1 uses HDInsight to improve and customize customer experience: http://www.youtube.com/watch?v=fN8Cixcc5yg

What is Big Data?

Ambari - Cluster provisioning, management, and monitoring.Avro (Microsoft .NET Library for Avro) - Data serialization for the Microsoft .NET environment.Hive - Structured Query Language (SQL)-like querying.Mahout - Machine learning.MapReduce and YARN - Distributed processing and resource management.Oozie - Workflow management.Pig - Simpler scripting for MapReduce transformations.Sqoop - Data import and export.ZooKeeper - Coordination of processes in distributed systems.

RED

UC

EM

APMap + Reduce = Extract, Load + Transform

Raw Data

Raw Data

Raw Data

Raw Data

Mapper Mapper Mapper Mapper

Data Data Data Data

Reducer

Output

What is Big Data?

Understanding Sentiment Analysis

Sentiment Analysis is the process of understanding the emotional content of text.

Understanding Sentiment Analysis

I had a fantastic time on holiday at your resort. The service was excellent and awesome. My family really enjoyed themselves. We look forward to next year. One thing though, the pool was closed which sucked.

Hotel Feedback

Understanding Sentiment Analysis

Take a list of positive and negative words

PositiveGoodGreat

FantasticExcellentFriendly

AwesomeEnjoyed

NegativeBad

WorseRubbishSuckedAwful

TerribleBogus

Understanding Sentiment Analysis

I had a fantastic time on holiday at your resort. The service was excellent and awesome. My family really enjoyed themselves. We look forward to next year. One thing though, the pool was closed which sucked.

Hotel Feedback

Understanding Sentiment Analysis

PositiveFantasticExcellentAwesomeEnjoyed

NegativeSucked

4 1

Understanding Sentiment Analysis

4 1- = 3Overall sentiment Positive

Understanding Sentiment Analysis

Sentiment Analysis gets a lot more complicated…

Big Data & Business Intelligence

In the following demo, we will cover the following:1. [If you don’t have one] Create an Azure Account2. Go to https://portal.azure.com/3. Create Storage4. Create HDInsight Cluster5. Load data into Blob Storage6. Validate data via HDInsight 7. Hadoop and C#8. Visualizing Results via Excel PowerView

Connecting Big Data and Business Intelligence

Demo

Closing Comments

Big Data is about understanding what your customers are saying and thinking.

Anything can be understood and processed but it requires time to analyze and understand.

Any device that creates data can produce valuable information. Try different things and let the patterns emerge. But Where Is Big Data’s ROI?

Collecting data - the kind of data that provides valuable insights into customer preferences, cost savings and revenue generation.

Roughly 40% of companies are unsure whether they’ll receive any return—and that includes 38% of companies that have already made some investment in big data, according to Gartner data (437 large companies surveyed in June 2015).

“Gartner has also warned that the majority of big data projects in the short term are likely to fail.”

Thank you

Brian Culver, MCMTwitter: @spbrianculverE-mail:brian.culver(at)expertpointsolutions.com Blog:http://blog.expertpointsolutions.com/Slides:http://www.slideshare.net/bculver

Questions

??

?

?

Constructive Feedback Is Appreciated

Great information, but would like to have learned more about [Insert Topic]

Brian – Your presentation was …

Good Demos!

Thanks!

Thank you!

Brian Culver, MCMTwitter: @spbrianculver

E-mail:brian.culver(at)expertpointsolutions.com

Blog:http://blog.expertpointsolutions.com/

Slides:http://www.slideshare.net/bculver

ResourcesTwitter Sentiment Processing http://tweetsentiment.azurewebsites.net/ http://azure.microsoft.com/en-us/documentation/articles/hdinsight-hbase-analyze-twitter-

sentiment/ https://azure.microsoft.com/en-us/documentation/articles/hdinsight-connect-excel-hive-

odbc-driver/ https://support.office.com/en-us/article/Power-View-Explore-visualize-and-present-your-

data-98268d31-97e2-42aa-a52b-a68cf460472e https://support.office.com/en-ca/article/Power-View-in-Excel-on-Office-365-or-in-

SharePoint-Server-99127d68-d7b7-42d0-a4ee-20e2d9897472?ui=en-US&rs=en-CA&ad=CA https://support.office.com/en-ca/article/Power-View-in-HTML5-c71dc902-2a2c-482e-b5a5-

e9c884650a26?ui=en-US&rs=en-CA&ad=CA https://apps.twitter.com/ https://manage.windowsazure.com https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hbase-tutorial-get-

started/ https://www.gartner.com/doc/3123817?ref=QuickSearch&sthkw=heudecker%20AND%20k

art&refval=155652106&qid=2aa81339616939553482e7aae26523f4 http://www.datacenterjournal.com/big-datas-roi/