Transcript
Page 1: Instant Visualizations in Every Step of Analysis

Easier, Faster, Smarter

Page 2: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

View Recording !!!

You can view the recording of this webinar at:!http://info.datameer.com/Online-Slideshare-

Instant-Visualizations-in-Every-Step-of-Analysis-OnDemand.html!

Page 3: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Instant Visualization in Every Step of Analysis!

#datameer @karenhsumar @bigdata

Page 4: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

About Our Speaker!Karen Hsu @karenhsumar!With over 15 years of experience in enterprise software, Karen Hsu has co-authored 4 patents and worked in a variety of engineering, marketing and sales roles.!

!

Most recently she came from Informatica where worked with the start-ups Informatica purchased to bring data quality, master data management, B2B and data security solutions to market.  Karen has a Bachelors of Science degree in Management Science and Engineering from Stanford University. !

#datameer @karenhsumar @bigdata

Page 5: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Agenda!•  Data Scientist Challenges!•  Lean Analytics Process !•  Technology!•  Demonstration!•  Q&A!

#datameer @karenhsumar @bigdata

Page 6: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Data Scientist Challenges in Analysis Process!•  Multiple tools!•  Unable to reproduce results !•  Not business friendly!

#datameer @karenhsumar @bigdata

Page 7: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Lean Analytics Process and Metrics!

Page 8: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Data Scientist Workflow!

Integrate! Prepare! Analyze! Visualize! Deploy!Id Use Case!

#datameer @karenhsumar @bigdata

Page 9: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Lean Analytics Process !

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

!!

#datameer @karenhsumar @bigdata

Page 10: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Identify Use Case!

Funnel Optimization

Behavioral Analytics

Fraud Prevention

EDW Optimization

Customer Segmentation

#datameer @karenhsumar @bigdata

Page 11: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Codeless Data Integration Big Data Management

Integrate!

#datameer @karenhsumar @bigdata

Page 12: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Prepare!

Uniqueness!

Accuracy!

Consistency!

Completeness!

#datameer @karenhsumar @bigdata

Duplicates!

Page 13: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Data Profiling

Prepare!Transformation Enrichment

#datameer @karenhsumar @bigdata

Page 14: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Analyze!Interactive Spreadsheet Collaboration + Governance Smart Analytics

#datameer @karenhsumar @bigdata

Page 15: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

•  Freeform Visualization Visualize Anywhere

Visualize!

#datameer @karenhsumar @bigdata

Page 16: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Production Environment

Scientist’s Desktop

SAS, R, IBM SPSS, Perl,

Python

Java, .NET C, SQL

Lost in Translation

Predictive Deployment!

SAS, R, IBM SPSS …

Great for model building but not for scoring, even more

so when it comes to Hadoop

#datameer @karenhsumar @bigdata

Page 17: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

•  Security Scheduling Monitoring

Deploy!Reproducing Projects

#datameer @karenhsumar @bigdata

Page 18: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Predictive Deployment!Model Building Model Deployment

and Execution

!   Angoss

!   BigML

!   FICO Model Builder

!   IBM SPSS

!   KNIME

!   KXEN

!   Microstrategy

!   Open Data

!   Pervasive DataRush

!   RapidMiner

!   R / Rattle !   SAS

!   SAP Business Objects

!   Salford Systems

!   StatSoft STASTISTICA

!   SQL Server

!   TIBCO Spotfire

!   Custom Code, etc.

               

Universal  PMML  Plug-­‐in  (UPPI)  

PMML  (models)  

PMML  (models)  

PMML  (models)  PMML

Datameer Server

Deploy in minutes ...

Page 19: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Demonstration!

#datameer @karenhsumar @bigdata

Page 20: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Demonstration Flow!

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

!!

#datameer @karenhsumar @bigdata

Page 21: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Identify Use Case!What are the trends linking website behavior to lead activity to revenue?!!How does website behavior affect churn? !

Page 22: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Integrate!

#datameer @karenhsumar @bigdata

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

Page 23: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Prepare!

#datameer @karenhsumar @bigdata

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

Profile!

Identify Outliers!

Enrich!

Transform!

Convert!

Page 24: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Analyze!

#datameer @karenhsumar @bigdata

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

Page 25: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Visualize!

#datameer @karenhsumar @bigdata

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

Page 26: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Predictive Deployment!Model Building Model Deployment

and Execution

!   Angoss

!   BigML

!   FICO Model Builder

!   IBM SPSS

!   KNIME

!   KXEN

!   Microstrategy

!   Open Data

!   Pervasive DataRush

!   RapidMiner

!   R / Rattle !   SAS

!   SAP Business Objects

!   Salford Systems

!   StatSoft STASTISTICA

!   SQL Server

!   TIBCO Spotfire

!   Custom Code, etc.

               

Universal  PMML  Plug-­‐in  (UPPI)  

PMML  (models)  

PMML  (models)  

PMML  (models)  PMML

Datameer Server

Deploy in minutes ...

Page 27: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Deploy!

1. Integrate!

3. Analyze!

4. Visualize! 2. Prepare!Identify!

Use Case! Deploy!

!!

#datameer @karenhsumar @bigdata

Page 28: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

Addressing Data Scientist Challenges in Workflow !

Multiple tools!

Reproduce results!

Not for business!

One tool!

Collaborate + Track!

Ease of Use!

#datameer @karenhsumar @bigdata

Page 29: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

For more information!

! http://www.datameer.com/solutions/use-cases.html!

!

!   @[email protected]!

Learn more!

Contact!

#datameer @karenhsumar @bigdata

Page 30: Instant Visualizations in Every Step of Analysis

@Datameer!

Page 31: Instant Visualizations in Every Step of Analysis

© 2013 Datameer, Inc. All rights reserved.

!   PMML is an XML-based language used to define statistical and data mining models and to share these between compliant applications.

!   It is a mature standard developed by the DMG (Data Mining Group) to avoid proprietary issues and incompatibilities and to deploy models.

!   PMML eliminates need for custom model deployment and ensures reliability.

PMML defines a standard not only to represent data-mining models, but also data handling and data transformations (pre- and post-processing)

!Predictive Model Markup Language!

Models Data

Transformations

#datameer @karenhsumar @bigdata


Recommended