14
How is SAP Data Services Unique for SAP HANA Integration?

How is sap data services unique for sap hana integration

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: How is sap data services unique for sap hana integration

How is SAP Data Services Unique

for SAP HANA Integration?

Page 2: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 2

SAP Data Services for SAP HANA Integration – What’s

Unique?

1. DS Workbench is a visual environment enabling unparalleled developer

productivity to migrate data into HANA as a target from a variety of sources

2. Metadata Management within SAP Information Steward can publish

information from HANA views and tables to perform Data Lineage and Data

Impact Analyses

3. Ability to push down data transformations leveraging HANA attribute,

analytical, and calculation views for faster and more efficient processes

4. Faster loads with parallel data extraction, partitioned data reads and

consolidated updates

Page 3: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 3

SAP Data Services and SAP HANA

Any Source

Data Load

Metadata

Open Hub

*SAP Data Services 4.x

In-Memory

Computing Engine

Modeler

SAP HANA

BW

Repository

Server

Designer and

Management

Console

• * Data Integrator license (for ETL only) is included with most HANA

packages. A full Data Service license is required to utilize Data Quality.

Page 4: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 4

DS Workbench for unparalleled developer productivity Design your data movement job in very simple steps

Support complex data movement with dataflow editor for transformations and cleansing

Increase dataflow development productivity • Automatic flat file formatting & data type discovery

• Automatic table joins and mappings

• Usable expression macros

Improve dataflow development quality • Design-time column-level lineage analysis

• Automatic mapping expression repair

• Automatic profiling and data analysis

Page 5: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 5

Monitor progress as job runs via DS Workbench

and view history for that job

Built-in capabilities to monitor the data loading

See load progress in real-time

Compare historic load times

Page 6: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 6

SAP Information Steward collects Metadata from HANA

Ability to collect standard relational objects and information models in HANA:

Attribute View, Analytic View, and Calculation View.

Fast searching of any metadata content such as attributes and measures in HANA

Page 7: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 7

Metadata Integration from SAP HANA Extending the number of available Objects …

Page 8: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 8

Metadata Integration from SAP HANA … allows best data lineage

1. From the Report

2. Through the BI Platform

3. Through HANA DB and Views

4. Through the DS ETL Jobs

5. To the Source Tables

Page 9: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 9

Metadata Management within BI Launchpad, WebI Trusted Information: Where does it come from AND how good is it?

Page 10: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 10

Just how accurate is my data? Even in HANA?

My data has more

issues than I thought !

Page 11: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 11

Profile operations pushed-down to HANA up to 1000x faster Understand the content and quality of your HANA data

Lightening fast insight about my

HANA data

30% of

addresses

are NULL?!

Page 12: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 12

Dataflow execution is optimized for HANA targets HANA views auto-generated, very fast execution via transformation pushdown

HANA

App

Web File

Database

End-to-end DS Modeling

Data is transferred as fast as

possible from external sources

to HANA first, any filters are

executed at the source

Rest of the transformations are

converted to HANA stored procs

using Views and SQL, and

executed completely within HANA

Page 13: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 13

Data Services supports Hadoop/Hive systems Just as other systems or applications are supported as native source, target

Same Familiar UI paradigm for design,

development

High Performance reading from and

loading into Hadoop

Extended Optimizer HIVEQL and PIG

aware

Files

Web & Others

Hadoop Databases

HANA, IQ, other

Target Systems

Data

Services Data

Services

Processing pushed down

Joins

Sorting

Filter and Projection

Aggregate functions

Executes as MapReduce job

Unstructured Text Data Processing

(Entity Extraction)

Page 14: How is sap data services unique for sap hana integration

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 14

NOUN_GROUP

FACILITY/PATH

2012 Toyota Highlander, 1G1JF27W8GJ178227. Policy

#456-788-99. $500 deductible. Insured are William Thomas Snow

and Christine W. Snow. On 1/09/13, received via text message "In

accident! Need tow truck." and "Corner of Winter & Cross Rd". Dr.

Snow slid through a stop on the snowy road and hit the stop sign.

Significant damage to front of the car. He was unhappy at tow truck

response time. Contact [email protected] or

651.772.1234. Advance Appraisals Inc. to come out at 8:30am

Monday to make further assessment.

Data Services integrates data from Unstructured Text Automatically identify the entities, facts, and feelings hidden within

VEHICLE/LAND

VEHICLE/VIN

POLICY NUMBER (CUSTOM)

CURRENCY

PERSON

SENTIMENT

WEAK NEGATIVE SENTIMENT

DATE

MAJOR PROBLEM

REQUEST

URL/EMAIL

ORGANIZATION/ COMMERCIAL

TIME

DAY

PHONE

Who, What, Where, When, How much, as well as Feelings