50
PUBLIC SAP Data Hub: Data Integration with Enterprise Applications DAT202

SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

PUBLIC

SAP Data Hub:Data Integration with Enterprise ApplicationsDAT202

Page 2: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

2PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Las VegasSeptember 24–27, 2019

Marc Hartz

BarcelonaOctober 8-10, 2019

Jens Rannacher

BangaloreNovember 13-15, 2019

Lalitendu Samantray

Speakers

Page 3: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

3PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Download the app from iPhone App Store or Google Play.

Take the session survey.We want to hear from you!

Complete the session evaluation for this session DAT202 on the SAP TechEd mobile app.

Page 4: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

4PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

The information in this presentation is confidential and proprietary to SAP and may not be disclosed without the permission of SAP. Except for your obligation to protect confidential information, this presentation is not subject to your license agreement or any other service or subscription agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or any related document, or to develop or release any functionality mentioned therein.This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms directions and functionality are all subject to change and may be changed by SAP at any time for any reason without notice. The information in this presentation is not a commitment, promise or legal obligation to deliver any material, code or functionality. This presentation is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. This presentation is for informational purposes and may not be incorporated into a contract. SAP assumes no responsibility for errors or omissions in this presentation, except if such damages were caused by SAP’s intentional or gross negligence.All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.

Disclaimer

Page 5: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

5PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub Introduction Capability Overview

Data Integration With SAP Applications With non-SAP Applications Leveraging SAP Cloud Platform

End-2-end Demo

Q&A

Agenda

Page 6: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

SAP Data Hub Introduction

Page 7: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

7PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Strategy – Deliver the Intelligent Enterprise

THE INTELLIGENT ENTERPRISE features 3 KEY COMPONENTS:

Page 8: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

8PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Digital Platform: Unlock data-driven intelligence and innovation

DataManagement Cloud

Platform

Digital Platform

SAP Data Services

Smart data access

Smart data Integration

Streaming analytics

SAP CP Big Data Services

Third party (Spark/Hadoop)

Object Store (S3, Swift…)

Data Lifecycle Management

Integration services

Meta Data and lifecycle management

Orchestration and governance

SAP HANA Engines

SAP Vora distributed engines

SAP HANA

SAP Data Hub SAP Cloud Platform

SAP API Business Hub

MarketplacePortal

API Management

Mobile Services

Big Data Services

Security Services

Integration Services

UX Services

Collaboration Services

Analytics Services

Leonardo ML Services

Leonardo IoT Services

Best-in-class digital platform for new app development, extensions, and integration

Unified data management to capture real-time value from different types of data

SAP HANA powers SAP applications as the foundation of high-performance data warehousingand analytics

Next-generation data management expands SAP HANA in-memory database to address structured and unstructured data use cases and external data

Platform for extending the business processes of the Intelligent Suite and enabling new innovations

Marketplace for ecosystem to build new innovations leveraging APIs and business services

SAP Data Hub provides data orchestration and metadata management across heterogeneous data sources

Delivering deep data and process integrations through APIs and microservices

Page 9: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

9PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub – Unified Data Integration for the Intelligent Enterprise

SAP Applications Distributed & External Data Systems

SAP Data Hub

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

3rd Party Applications

Streaming (e.g. IoT)

Public Clouds

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

REST APIs

SAP Cloud Platform

Connectors

3rd Party Connectors

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

*This is the current state of planning and may be changed by SAP at any time without notice.

Page 10: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

SAP Data HubCapabilities Overview

Page 11: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

11PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub Capabilities: Data Governance

SAP Applications Distributed & External Data Systems

SAP Data Hub

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

3rd Party Applications

Streaming (e.g. IoT)

Public Clouds

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

REST APIs

SAP Cloud Platform

Connectors

3rd Party Connectors

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Page 12: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

12PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Data Governance Metadata Management

Build up catalog to get insight into your company’s metadata

Page 13: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

13PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Discovery &Profiling Search Lineage Data

PreparationBusiness

Rules

Explore (Discover, Preview, Profile) data assets in connected systems System-wide Metadata Catalog

– Metadata Crawler: Automatic indexing und publication of metadata

– Manual Definition of metadata (datasets) Classification of data using labels (e.g. regarding

quality and sensitivity) Data Lineage provides a clear end-to-end

understanding of the data’s origins and usage Define and run Business Rules to understand the

data quality of your data Data Preparation allows business users to acquire,

enrich, and enhance data in a spreadsheet like UI Tight integration with modeling environments for Data

Pipelines and Workflows

Data GovernanceMetadata Management using the Meta Data Explorer

Metadata Crawler Manual Definition

SAP Data Hub Sources(SAP HANA, SAP BW, S3, HDFS, OData, Oracle, …)

Connected Sources

Other Repositories(SAP Information Steward, Atlas by SAP, Hive*)

Metadata Catalog

SAP Data HubMetadata Explorer

DAT162

*This is the current state of planning and may be changed by SAP at any time without notice.

Page 14: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

14PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Capabilities Prepare the data based on a sample dataset

Transform, shape, harmonize, curate, enrich the data via simple click actions

View, present and report the outcome immediately

Apply the transformations to the full dataset at any time

Main Use Cases End-to-end self-service data preparation

Improve data quality to achieve data excellence

Create new data sets based for scenario and project requirements

Data GovernanceData Preparation Self-service for Non-Technical Users

delete combine new or adjusted data set

Page 15: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

15PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub Capabilities: Data Orchestration & Monitoring

SAP Applications Distributed & External Data Systems

SAP Data Hub

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

3rd Party Applications

Streaming (e.g. IoT)

Public Clouds

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

REST APIs

SAP Cloud Platform

Connectors

3rd Party Connectors

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Page 16: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

16PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Data Orchestration and Monitoring

Connect, orchestrate and monitor processes across systems

Page 17: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

17PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Central management of all system connections– Connect to diverse systems natively and remotely– Support user access management

Data Workflows for cross-system dataorchestration, e.g.– Trigger Execution of SAP BW process chains– Transfer data from SAP BW and SAP HANA– Execute remote SAP Data Services jobs– Trigger iFlows in SAP Cloud Platform Integration– Submit Spark jobs to Hadoop clusters

Scheduling of Data Workflows

Extensive Monitoring– Support view, control, and auditing of data operation in

the connected data landscape

Data Orchestration and MonitoringConnection Management, Data Workflows, Scheduling

Page 18: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

18PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub Capabilities: Data Pipelining & Processing

SAP Applications Distributed & External Data Systems

SAP Data Hub

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

3rd Party Applications

Streaming (e.g. IoT)

Public Clouds

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

REST APIs

SAP Cloud Platform

Connectors

3rd Party Connectors

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

Page 19: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

19PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Data Pipelining & Processing

Build scalable and flexible flow-based applications to process, refine, and enrich data at the source.

Page 20: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

20PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Data Pipelines = Flow-based applications– Operators (independent computation units)– Data (messages) flows between operators Extensible

– Over 250 pre-defined operators (Connectivity, Processing, Data Quality, CV, ML, etc.)

– Custom / Partner operators– Wrap any custom code Scalable

– Containerized – Docker containers constitute the operators’ execution environments

– Distributed – Easy horizontal scaling Re-Usability

– Create complex, multistep, reusable data pipelines and operators

Data Pipelining & ProcessingBuild Flow-based Applications using the Pipeline Modeler

DAT363

Page 21: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

SAP Data HubData Integration with SAP Applications

Page 22: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

22PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub: Data Integration with SAP Applications

Distributed & External Data Systems

SAP Data HubStandard

Connectors(open & native

protocols)

Cloud Storages

Hadoop / HDFS

Databases

3rd Party Applications

Streaming (e.g. IoT)

Public Clouds

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

REST APIs

SAP Cloud Platform

Connectors

3rd Party Connectors

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

SAP Applications

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Page 23: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

23PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with ABAP-based SAP Systems

Business Suite

One model to consolidate all interaction scenarios between SAP Data Hub and an ABAP-based SAP systems directional and bi-directional

Provide ABAP METADATA to the SAP Data Hub Metadata Explorer

ABAP FUNCTIONAL EXECUTION that is triggerable as a SAP Data Hub Operator

Capabilities

Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1911, SAP NetWeaver 7.00 with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.

SAP Data Hub

Business Warehouse

SAP S/4HANA

SAP S/4HANA Cloud

ABAP DATA PROVISIONING to transfer data into SAP Data Hub

DAT108

Page 24: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

24PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with ABAP-based SAP Systems

Operator to communicate with SAP LTReplication Server (SLT). Leverage existingreplication scenarios to bring data into aSAP Data Hub pipelines.

Operator to implement your ABAP customcode that will be executed as part of apipeline in the connected ABAP system.For example to call a function module.

SLT CONNECTOR

CUSTOM ABAP OPERATOR

Operator that supports initial load and deltareplication of ABAP CDS views.

ABAP CDS READER

Good to know

ABAP CDS Views are only available in SAP S/4HANA

SAP S/4HANA cloud does not support custom code

Allows data consumption of lower SAP NetWeaver (<7.00) and S/4HANA (<1909) releases

Integration requires certain system level, planned at least SAP S/4HANA 1909, SAP S/4HANA cloud 1911, SAP NetWeaver 7.00 with DMIS 2011/2018 Q4/2019 version. Certain functionality can only be made available for certain release levels.

Page 25: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

25PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with ABAP-based SAP SystemsExample Data provisioning for SAP S/4HANA with ABAP CDS Reader

ABAP CDS is the semantically rich data model in SAP S/4 HANA and allows the consistent representation of a business object like a Business Partner

Application Tables

ABAP CDS Layer

SAP Data Hub 2.7

SAP S/4HANA 1909 SAP S/4HANA CE 1911

DB triggersLogging

table

CDC engine

ABAP Pipeline Engine

Initial Load & Inserts, Updates, Deletes

The ABAP CDS READER operator allows thereplication of SAP ABAP CDS Views and customerABAP CDS views in initial load and delta mode.

CDS replication from SAP S/4HANA to file storage

Page 26: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

26PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Main Use Cases Holistic Data Management with SAP Data Hub Building Data Warehouse Analytics with SAP BW/4HANA Advanced Analytics and Planning with SAP Analytics Cloud

Capabilities Support both full and delta requests Seamless integration of data and metadata OData v4 as communication protocol

Integration with SAP Cloud solutions

One SAP Cloud Data Integration (CDI) for integration into all SAP Cloud solutions

Cloud Data Integration API

SAP Data Hub SAP BW/4HANA

SAP Analytics Cloud

SAP Cloud Data Integration (CDI) is acore concept for integrating all SAP solutions in the

cloud using ONE API based on open standardsAvailable Today Planned for Q3/Q4 2019 Planned >= 2020

…SAP C/4HANA:- SAP Marketing Cloud- SAP Service Cloud

Page 27: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

27PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Example Cloud Data Integration scenario with SAP Fieldglass & SAP Data Hub

Integration with SAP Cloud solutions

Loading Fieldglass Work Orders into SAP Vora tables with data protection

Understanding metadata of SAP Fieldglass within the SAP Data Hub Metadata Explorer

Page 28: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

28PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Available Pipeline Operators: SAP BW Process Chain

– Trigger execution of a process chain on a SAP BW system Data Transfer (SAP BW & SAP HANA)

– Transfer data (query, infoprovider / tables, views) from SAP BW / SAP HANA into big data stores or SAP Vora tables

– Via INA interface or direct access to HANA (Calculation Views)

Typical Scenarios: Load Data from Data Lake into BW Data Tiering from BW into Data Lake

Integration with SAP Business Warehouse

Page 29: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

29PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with SAP HANA and SAP Analytics CloudSAP Data Hub integrates with SAP HANA and SAP Analytics Cloud on multiple levels

SAP Analytics Cloud

Pipeline Engine Metadata Explorer

Profiling /Discovery

MetadataCatalog

SAP Vora Engines

Relational

Files

Virtual TablesTablesViewsStory

ModelDataset

Smart Data Access

Live Connection

VORA Client

VORA Ingestor

HANA Client

HANA Table

Consumer

Smart Data Integration

HANA FlowgraphOperator

Data Transfer Operator

SAC Push Operator

SAP Data Hub

Page 30: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

SAP Data HubData Integration with Non-SAP Applications

Page 31: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

31PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub: Non-SAP Data Integration

SAP Data Hub

3rd Party Applications

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

SAP Cloud Platform

Connectors

3rd Party Connectors

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

SAP Applications

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Distributed & External Data Systems

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

Streaming (e.g. IoT)

Public Clouds

REST APIs

Page 32: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

32PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Connectivity:

Connectivity (via Flowagent): Spark / Hadoop:

Data Quality:

Non-SAP Data IntegrationBuilt-in Standard Connectors

- Azure Data Lake (ADL)

- Google Cloud Storage (GCS)

- HDFS

- Amazon S3

- Azure Storage Blob (WASB)

- Local File System (file)

- SAP Semantic Data Lake

- WebHDFS

SAP Vora:

- Spark

- Spark SQL

- PySpark

- Hive

Page 33: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

33PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Transformation Operators: Run on-the fly transformations and do event stream processing

using continous query language (CQL) on data within a pipeline

Subengines: Develop and compile new operators locally using SDK Register and run custom operators in available pipeline subengine

Process / Command Executors: Run a process within a pipeline and give contiguous stream to it Run a shell command for each arrival of a message within a pipeline

Scripting Operators: Write and run custom scripts for data manipulation within a pipeline Build re-usable operators in different programming languages

Non-SAP Data IntegrationOperators for Data Processing

*This is the current state of planning and may be changed by SAP at any time without notice.

*

Page 34: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

34PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub: Extensibility for 3rd Party Connectivity

SAP Data Hub

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

SAP Cloud Platform

Connectors

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

SAP Applications

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

Streaming (e.g. IoT)

Public Clouds

REST APIs

3rd Party Applications3rd Party Connectors

Distributed & External Data Systems

Page 35: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

35PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Extensibility for 3rd Party ConnectivitySAP Data Hub Extension Points

Connected Systems

Docker Registry

for SAP Data Hub Pipeline

Modeler

3rd party Docker Images

SAP Data Hub System Management User & Access Management

Content Lifecycle Management

Cluster Management

3rd party Docker Images

Multi-Tenancy Management

Tenant Applications managed by System Management

Pipeline Modeler

Flow-based Applications

Pipeline Templates

Custom Operators

Built-inConnectors

WorkflowOperators

Connection MgmtFlow Agent

Embedded System Application

SAP HANA(internal)

Spark on Kubernetes

Database Tools

Metadata Explorer

Profiling /Discovery

MetadataCatalog

RepositoryRepository

SAP Vora Engines

Relational

Files

SAPApplications

SAP CloudApplications(API-driven)

Databases

3rd Party / Open Source

Public Clouds

Custom Conn. Type

vSolutionArchive

Export Import

Page 36: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

36PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Connecting data sources with SAP Data HubThree ways of connecting systems, engines and repositories

Custom operators can be created based on SAP provided base operators like JavaScript, Python, Spark, RestAPI, etc. Those are very powerful, and allow integration with a wide range of systems, applications, and data stores. They require an engineering skillset.

• How to build custom operators is described in this blog series.

Additional systems can be accessed within the pipeline modeler via specific operators, e.g. Kafka.

• All currently supported standard operators can be found here.

Available in the SAP Data Hub launchpad, these are the richest and most integrated connectors, providing metadata and governance services, profiling, source crawlers, etc.

• Includes connectors to ETL tools like SAP Data Services and SAP HANA SDI, where SAP Data Hub leverages brokered connections through an intermediary, allowing connection with many additional systems.

• All currently supported connectors can be found here.

01 Managed system connectors 02 Standard

pipeline operators 03 Customoperators

Page 37: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

37PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP internal Lead-to-Cash Scenario: Understand internal process inefficiencies all the way from demand management to maintaining a deal through process mining in Celonis leveraging SAP Data Hub Involved Steps

1. Collect purchase related activities in ERP system (SAP S/4HANA)2. Anonymize personal data, transform activities into required event log structure to do process mining and

upload event log to Celonis Intelligent Business Cloud (SAP Data Hub + 3rd Party Adapter from Celonis)3. Run Process Mining (Celonis Intelligent Business Cloud)

Extensibility for 3rd Party ConnectivityExample with Celonis Intelligent Business Cloud

SAP Data Hub

CelonisIntelligent Business

Cloud

1 32

Data UploadData

Ingestion

Triggers thePipeline andprovides SQL SELECT for HANA

Creates Push Job in IBC for giveninput

Executes SQL queryand produces dataoutput in batches

Pushes the datachunk by chunk tothe created datapush job andsubmits the dataafter the last chunk

Stops the pipelineonce the last chunkwas pushed

De-identification ofpersonal data

Data PipelineERP

CRM

BW

Page 38: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

38PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub Content Marketplace: Planned Marketplace and Delivery

channel for SAP Data Hub Partner Content via SAP API Business Hubin combination with SAP App Centerfor monetization

A win-win partnership: Partners can reach more customers

with their services, while SAP Datahub Hub expands its reach with relevant content Our partners understand the customer

use cases and can better support with domain-specific content by generalizing the specific issue with a broad solution

Data Hub Content Delivery Custom Data Hub Content can be

packed into a SAP Data Hub Solution Archive SAP Data Hub Solutions can be

defined, exported and imported via– SAP Data Hub System Management UI– vCTL Command Line Tool*

SAP Data Hub Solution Structure:

Data Hub‘s Extensibility OptionsPartners and customers can add own content based on different layers: Pipelines Templates:

– Parameterizable scenario templates– (Sub)graphs called in other graphs

Operators:– Extend pre-defined base operators using

powerful runtimes, e.g. Python, Go, Javascript, and R

– Develop new operators with own runtimes, e.g. Process Executor

Dockerfiles:– Provide execution environments for

operators– Incorporate 3rd party libraries and

executables

Extensibility for 3rd Party ConnectivityOpen for Partner and Customer Content Delivery

Page 39: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

39PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP API Business Hub: Search, discover and consume content packages with pre-packaged integrations and sample applications from SAP and partners

SAP Data Hub Content DeliveryPublishing Content via SAP API Business Hub

Digital Content (Integration)

With your developer ecosystem

Via App Center, or by OEM-ing with SAP

MonetizeList Engage

Page 40: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

40PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Publish SAP Data Hub content tobe monetized on SAP App Center in 3 easy steps: Become an SAP Partner Submit for SAP Data Hub

Readiness Check Publish and begin Transacting

SAP Data Hub Content DeliveryPublishing Content via SAP App Center

Page 41: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

SAP Data HubIntegration with SAP Cloud Platform

Page 42: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

42PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

SAP Data Hub: Integration with SAP Cloud Platform

SAP Data Hub

Data GovernanceData Discovery / Data Profiling / Metadata Cataloging

Data Orchestration & MonitoringConnection Management / Workflows / Scheduling

Data Pipelining & ProcessingData ingestion / Data Processing / Data Enrichment

SAP Applications

SAP HANA Integration

Cloud Data Integration*

ABAP Integration

WorkflowsBW Process

ChainsData Services

JobsHANA

Flowgraphs

SAP C/4HANA

SAP NetWeaver + DMIS Addon

BWIntegration

SAC Push API

SAP BWSAP BW/4 HANA

SAP Analytics Cloud

(on-premise, cloud, multi cloud)

Standard Connectors

(open & native protocols)

Cloud Storages

Hadoop / HDFS

Databases

Streaming (e.g. IoT)

Public Clouds

REST APIs

3rd Party Applications3rd Party Connectors

Distributed & External Data Systems

SCI for process integration

SAP Open Connectors

SAP APIBusiness Hub

SAP Cloud Platform

Connectors

Page 43: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

43PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with SAP Cloud PlatformOrchestration of SAP Cloud Platform integration to interact with processes

SAP Cloud Platform Integration

process an image file (boarding pass)

rebook flight via iFlow

Enrichment of existing SAP Cloud Platform Integration scenarios with SAP Data Hub Modeler functionality

iFlow

Main Use Cases

• Enable SAP Cloud Platform Integration – Process Integration customers with the ability to reuse existing assets (iFlow)

• Broaden scenarios by blend in complementing capabilities for example machine learning or image processing

Capabilities

Pre-defined operator for triggering iFlows

Smooth connection via HTTP Basic authentication

OAUTH V2 is planned for future release

Page 44: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

44PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Integration with SAP Cloud PlatformLeveraging SAP Cloud Platform Open Connectors to consume external sources

Open Connectors

SAP Cloud Platform

Main Use Cases

• Seamless integration to over 150 non-SAP cloud application

• Embed external application and data into your process to broaden the scenario

• Develop and map canonical data model to extend pre-build connectors

Capabilities

Easy connection through one API connector to reduce cost of third-party integration

Normalized authentication, error handling, search, pagination, bulk support

Support metadata extraction and data preview

Accelerate integration with external applications via SAP CP Open Connectors

Extract any data of the 150+ external applications

Find all supported connectors here

Page 45: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

DemoEnd-2-End Demo of SAP Data Hub Integration with SAP and non-SAP leveraging SAP Cloud Platform connectivity and adding value using SAP Data Hub’s processing and machine learning capabilities.

Page 46: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

46PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Access SAP TechEd Learning Journeys

Discover related learning content

Watch webinars of SAP TechEd lectures

Learn about SAP’s latest innovations with openSAP

Collaborate with SAP experts

Self-test your knowledge

Earn a SAP TechEd knowledge badge

Continue your SAP TechEd 2019 Learning Experience Join the digital SAP TechEd Learning Room 2019 in SAP Learning Hub

Page 47: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

47PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Access replays Keynotes Live interviews Select lecture sessionshttp://sapteched.com/online

Continue the conversation Read and reply to blog posts Ask questions Join discussionssap.com/community

Check out the latest blogs See all SAP TechEd blog posts Learn from peers and experts

SAP TechEd blog posts

Engage with the SAP TechEd Community Access replays and continue your SAP TechEd discussion after the event within the SAP Community

Page 48: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

48PUBLIC© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

More information

Related SAP TechEd Learning Journeys AIN2 – Transform your business processes with intelligent technologies DAT3 – Tame data challenges

Related SAP TechEd sessions DAT302 – Introduction to SAP Data Intelligence and SAP Data Hub DAT103 – The Data Management Strategy from SAP DAT363 – Create and Manage End-to-End Data Pipelines with SAP Data Hub DAT162 – Metadata Exploration and Self-Service Data Preparation with SAP Data Hub DAT108 – Integrating SAP S/4HANA into SAP Data Hub: Overview and Use Cases

Public SAP Web sites SAP Community: www.sap.com/community SAP products: www.sap.com/products

Page 49: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

Feedback Contact for further topic inquiriesPlease complete your session evaluation for DAT202.

SAP Data HubProduct [email protected]

Thanks for attending this session.

Page 50: SAP Data Hub: Data Integration with Enterprise Applications · This presentation, or any related document and SAP's strategy and possible future developments, products and or platforms

© 2019 SAP SE or an SAP affiliate company. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission ofSAP SE or an SAP affiliate company.

The information contained herein may be changed without prior notice. Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors. National product specifications may vary.

These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation orwarranty of any kind, and SAP or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.

In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platforms, directions, andfunctionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, and they should not be relied upon in making purchasing decisions.

SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. All other product and service names mentioned are the trademarks of their respective companies.

See www.sap.com/copyright for additional trademark information and notices.

www.sap.com/contactsap

Follow us