Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Transformation Area:Database Application Optimisation & Archiving mit Structured Data ManagerMatthias Binder, Technical Consultant Hewlett Packard Enterprise Software
Agenda
Introduction
Structured Data Manager – use case overview
SDM components
Case Studies & Summary
Enterprise Application Management
• How to apply data retention policies to existing applications• All data offered the same service level
Control Costs
Information Lifecycle
Maintain Service Levels
• Data volumes are getting larger increasing both hardware expenditure and operational costs.
• Legacy application are taking up space and budget
• Application response time and batch processing performance• Full backups becoming longer
Keys to application management Challenges
Information Security • Legislation is forcing protection of Personally Identifiable Information (PII)• Offshore development and testing needs data.
Performance and Availability Issues
5
Diminishing service levels• Application performance degradation• Higher operational costs• Lengthening backup and recovery windows • Increased downtime requirements for upgrades• Escalating infrastructure requirements• Multiplied by additional copies• …
Active and inactive data replicated in full for backups, disaster recovery, as well as test, development, and Q/A clones• 3-25+ copies not unusual
Total Data Volum
e
Growth
Performance
Production Database
BKUP
TEST
TRAIN
DEV
PREPROD
UAT
HPE Structured Data ManagerEnterprise Management for Structured Data
7
Performance Optimization• Reduce data footprint &
storage costs• Maintain application
performance• Improve backup & recovery
Application Retirement• Decommission redundant
applications• Preserve access to retired
data
Test Data Extraction• Extract subsets of data for
use in application development
• Mask sensitive data
Search & eDiscovery• Index application data for free
text search across silos• Identify and extract relevant
sets of data for legal
Apply Information Lifecycle PoliciesPerformance Optimization
– Move inactive data from production databases to stabilize performance
– Provide application access to inactive data
– Can Retire records to a “compliance” store as 3rd Tier of Archiving
– Provide access to file based archive via SQL reporting tools
8
Growth
Performance
Predictable, stable performance band
Growth
Performance
“Standard” reporting tools
Archive Database Retired Records
“Archive”
Business Application
Production Database
Expedite backup performance
– Minimize the backup image required by reducing the volume of data to be backed up
– Lower the risk of long disruptions and accelerate disaster recovery
9
Business Application
Production
Weekly full Recovery
Backups
Business Application
Static, compressed
Weekly full Recovery
Backup
Monthly full
Monthly Archive
Backups
Production Archive
Recovery
Retire outdated applications
– Automate the process of extracting, validating, and deleting data from applications
– Lower database maintenance costs
11
DBApplication
Manual steps
Man
ual
Non
-Co
mpl
iant
ManualValidation
ManualValidationWeeks
Auto
mat
ed
Def
ensi
ble Application
retirement accelerator Archive
HoursDefensiblyDisposed
Active Data<20%
Historical Data>80%
Legacy Application
Selectively retire Data
Selectively extract Data
Capture Application Logic from Application
Experts, Reports, Queries, etc.
SQL-Queries:select *from ORDER_HEADER OH, ORDER_LINE OL, CUSTOMER Cwhere OH.ORDERID=OL.ORDERID and OH.CUSTOMERID=C.CUSTOMERID;
Manage Retention, Legal Hold and defensible Deletion Ensure Compliance by providing Authenticity, Reliability, Integrity and Usability of archived data
XML
Find, retrieve and query Business Records from Archive
Migrate Data
Active Data
Active Application
XMLLoad into temporary database and transform
Documentation of Application Logic
Query Server or XML-Query tool
Application and Information Retirement process
Application and Information Retirement process
SQL-Queries:select *from ORDER_HEADER OH, ORDER_LINE OL, CUSTOMER Cwhere OH.ORDERID=OL.ORDERID and OH.CUSTOMERID=C.CUSTOMERID;
Manage Retention, Legal Hold and defensible Deletion Ensure Compliance by providing Authenticity, Reliability, Integrity and Usability of archived data
XML
Find, retrieve and query Business Records from Archive
Active Data
Active Application
Documentation of Application Logic
Query Server or XML-Query tool
• “Retired application” content long-term readable• Potentially reduced licensing cost (no DB
required)• Application developers working on current online
applications not on the “retired dataset“
Test data extraction/Data Masking
–Data Masking routines can be added to any source object at design time
–Can be applied to archiving and/or subsetting–Data is masked using native DB routines or
scripted functions.–Supports both pre-supplied, custom developed
and third-party routines–Data is masked during the movement process
before writing to the source to ensure data security
Source Database containing PII & other sensitive
data
MaskedData
Archive or Subset Files
Archive or Subset Databases
Improve search and eDiscovery
• Achieve better visibility into, and proactively consolidate, previous difficult-to-access data
• Lower costs of eDiscovery and investigations, and increase end-user productivity
Enterprise Archiving for Structured DataProduct Overview
HP Structured Data Manager provides– Flexible policy based structured data management– Centralized multi-system management – Repeatable automated process definition– Easy to use Design tools – Archive to Database or file– “Index” structured data for text search across silos– Access to archived data via simple reporting interface– Documented processes
Supports– Out of the box support for Oracle, MS SQL, Sybase, DB2– Self certification for JDBC Connectors for other database types– Predefined integration modules for Oracle EBS and Peoplesoft
Management ConsoleProduct Overview
– Browser based management console– Role base security– Manage Multiple Environments– Define, Configure, Schedule and Execute – Monitor progress– View eligibility analytics
– Application Retirement “Wizard”
– Reporting Interface for Archived Data
– Free Text Search
– Custom Interfaces (Extensions)
20
DesignerProduct Overview
– Visual modeling environment to define business transactions
– Edit and Enhance pre-packaged modules
– Create Modules for:– Data Movement– Data Extraction– Data Indexing– Reporting
– Build bespoke modules to integrate into almost any application
– Define tasks as part of a workflow
– Produce process documentation
21
Ready-to-run Archive Modules Product Overview
– Structured Data Manager ready-to-run modules for Oracle E-Business Suite– Including: Human Resource Management, Financials, Manufacturing, Supply
Chain Management, Sub-Ledger Accounting, CRM
– Pre-defined relationships among all tables comprising each business transaction
– Complete business rule definitions to determine data eligibility and status
– Installable run-time modules ready-to-run in Oracle environments
– Project file definitions for import into Designer to perform data analysis, customizations, and testing
– Oracle Validated Integration with E-Business Suite.– https://solutions.oracle.com/scwar/sc/Solution/SCSP-FGKBJVUX.html
22
Archive AccessProduct Overview
File extraction– SDM Query Server Cache provides SQL Access to “Retired” Data
– Ad-hoc queries using SQL– Any Database Compliant tool – e.g.. Business Objects, Crystal Reports, Excel etc.– HP SDM Data Access Reports
– Migrate any existing reports to new platform
– Accessible from databases (Linked Server, OHS etc.)
24Archive Storage Location
SDM
Production Database
Structured Files
Cache Database
SQL Queri
es
27
– Gartner SDAAR Magic Quadrant 2014
“HP offers HP Structured Data Manager for database archiving and application retirement. The product is mature, due to its long history in this market dating back to 1998…. Customer support, responsiveness, knowledge and product flexibility are positive attributes, particularly compared with competitive offerings.”
Customer Examples
Procter & Gamble – World‘s largest consumer products company
– HP SDM & RM archive for application retirement
– Oracle, DB2, SQL Server & Mainframe applications
– 12 Applications retired including billing, distribution and HR data
MKK – Turkish central securities depository
– Capture all Trading data in Oracle
– Archived 22 TB of data by 2015
– Less than 12 month ROI
EFG Eurobank - third largest bank in Greece
– Finance applications
– Cost reduction, performance and compliance
– Oracle, SQL Server & DB2 applications
HP
– Management of 100+ Applications
– 57 Billion Records archived at last count
– Performance and Record Management
28
© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.29
Next Steps
• Visit the SDM Product pages for data sheets, case studies and more
– www.hp.com/go/sdmanager
– www.autonomy.com/products/structured-data-manager
– www.youtube.com/watch?v=1GQPi9fmvSo
• Application Analysis & Deep Dive
Summary
HP Structured Data Manager provides:
– Enterprise level archiving for structured data
– Performance Optimization
– Compliance Archiving & Application Retirement
– Data Subsetting & Masking for test environments
Proven benefits in:
– Application performance
– End user satisfaction
– Storage & backup management
– Application upgrades
– Application Retirement
32