Upload
tess98
View
703
Download
9
Embed Size (px)
Citation preview
Copyright © 2003, SAS Institute Inc. All rights reserved.
New Features in SAS® ETL Studio 3.2Peter Cullen14 April 2005
Copyright © 2003, SAS Institute Inc. All rights reserved. 2
ETL Designer Administrationenhanced to provide capabilities to terminate
in process jobs, copy/paste capabilities, session and table information
Full functional data viewer to provide better control and more
functionality when viewing source/target contents
Extended EFI capabilities allow greater reach to external files
including delimited, fixed/variable length, FTP/URL, VSAM and COBOL
SAS® ETL Studio3.2 Enhancements
Impact Analysis enhancementsthat now provides impact reports into OLAP
Cubes, Look-up tables and Information Maps
Copyright © 2003, SAS Institute Inc. All rights reserved. 3
SAS® ETL Studio3.2 Enhancements
New and Enhanced Transformationto integrate SAS High Performance
Forecasting, improved performance and functionality
More robust Transformation Generator
to more easily build repeatable and reusable processes
Additional Source Designersadded for SPD Server, OLE DB, Excel and
MySQL
Copyright © 2003, SAS Institute Inc. All rights reserved. 4
SAS® ETL StudioExtended EFI Functionality
Definitions can be modified
Definitions can be re-used
Definitions can be imported from COBOL Copybooks and CSV files
Flat files now behave like tables, they can be viewed and added to a Job using drag-and-drop
Flat files can be used for both input and output
User-written code is now supported
Copyright © 2003, SAS Institute Inc. All rights reserved. 5
SAS® ETL StudioExtended EFI Functionality
Copyright © 2003, SAS Institute Inc. All rights reserved. 12
SAS® ETL StudioFull Functional Data Viewer
Column Viewing Options
Column type identification (Character
or Numeric)
Record scrolling by page, to scroll through all
observations
Copyright © 2003, SAS Institute Inc. All rights reserved. 13
SAS® ETL StudioETL Designer Administration – Session Information
Metadata Connection Profile
Copyright © 2003, SAS Institute Inc. All rights reserved. 14
SAS® ETL StudioETL Designer Administration – Copy/Paste
You can copy and paste the metadata objects for jobs, tables, external files, notes, and documents
You can also select multiple objects and a mixture of objects
Works both in the Inventory and Custom Tree
You can copy from the Inventory to the Custom Tree and vice versa
Copyright © 2003, SAS Institute Inc. All rights reserved. 15
Original Job
Pasted Job
Transformation icons have been copied. New metadata objects have been created and all
properties have been copied.
Table icons have not been modified. They point to the exact
same metadata object.
SAS® ETL StudioETL Designer Administration – Copy/Paste
Copyright © 2003, SAS Institute Inc. All rights reserved. 16
SAS® ETL StudioETL Designer Administration – Job Termination
• Cancel a submitted job (appserver session remains)
• Kill a submitted job (appserver session closed)
Copyright © 2003, SAS Institute Inc. All rights reserved. 17
SAS® ETL StudioETL Designer Administration – Job Completion Status
Copyright © 2003, SAS Institute Inc. All rights reserved. 18
SAS® ETL StudioETL Designer Administration – Job Status Manager
Shows an overview of all interactively
submitted jobs
You can double-click here in the status bar to activate the Job
Status Manager
Copyright © 2003, SAS Institute Inc. All rights reserved. 19
SAS® ETL StudioETL Designer Administration – View Table Information
Copyright © 2003, SAS Institute Inc. All rights reserved. 20
SAS® ETL StudioImpact Analysis Enhancements
OLAP Cubes
Tables
New
Information Maps
Copyright © 2003, SAS Institute Inc. All rights reserved. 21
SAS® ETL StudioImpact Analysis Enhancements
New
Look-up Tables
Transformations
Copyright © 2003, SAS Institute Inc. All rights reserved. 22
This transformations provides a quick and automatic way to generate forecasts for many sets of time-series or transactional data. It is using the HPF procedure.
An example would be that you extend time-series based data in an existing SAS pricing information data set, to generate a detailed forecast that includes tabular data and graphical plots.
This transformations provides a quick and automatic way to generate forecasts for many sets of time-series or transactional data. It is using the HPF procedure.
An example would be that you extend time-series based data in an existing SAS pricing information data set, to generate a detailed forecast that includes tabular data and graphical plots.
SAS® ETL StudioHigh Performance Forecasting Transformation
Copyright © 2003, SAS Institute Inc. All rights reserved. 23
Macro’s are now part of generated code, no longer using autocall macros
Performance enhancements• Input data is read fewer times
• Less sorting
• In case of DBMS load, temporary work tables are stored in temporary DBMS location
50% faster in ETL Studio 3.2 compared to 9.1.3 for initial loads
80% faster in ETL Studio 3.2 compared to 9.1.3 for updates
50% faster in ETL Studio 3.2 compared to 9.1.3 for initial loads
80% faster in ETL Studio 3.2 compared to 9.1.3 for updates
SAS® ETL StudioSCD Type II Loader – Performance enhancements
Copyright © 2003, SAS Institute Inc. All rights reserved. 25
SAS® ETL StudioLoader Transformation Enhancements
Loaders now support derived
mappings
Copyright © 2003, SAS Institute Inc. All rights reserved. 26
SAS® ETL StudioTransformation Generator Enhancements
Copyright © 2003, SAS Institute Inc. All rights reserved. 27
SAS® ETL StudioTransformation Generator Enhancements
Copyright © 2003, SAS Institute Inc. All rights reserved. 28
SAS® ETL StudioTransformation Generator Enhancements - Summary
Support for Modification of Properties
Support for Multiple Inputs/Outputs
Support for more Metadata-Driven Parameters
Specify Text for Placeholder
Move to another Group
Impact Analysis (where used)
You can use all of the power of the underlying SAS system and still make it metadata driven and re-usable by non-programmers.
No JAVA knowledge required to accomplish this!
Copyright © 2003, SAS Institute Inc. All rights reserved. 29
SAS® ETL StudioAdditional Source Designers
Extensive list of Source/Target data types. Wizard driven interface to define metadata about all data sources/targets.
Copyright © 2003, SAS Institute Inc. All rights reserved. 30
SAS® ETL StudioMiscellaneous enhancements - Details
Add Input and Outputs to Transformations
Newly created objects get unique name
Impact Analysis now also supports the Overview Window
Flat files can also be used for output
Calculated Members Definition Window (for OLAP)
Enhanced validation for generated code
Codegen Updates
Copyright © 2003, SAS Institute Inc. All rights reserved. 31
SAS® ETL StudioCodegen Updates
Block comments for better readability• Job header
• Pre-/Post-processing header
• Includes text from Notes entries (for both Job as Individual Transformations)
Lines are now split if they are too long
Job steps
Error messages when column mappings are not defined
Sections in larger steps (like loader)
Copyright © 2003, SAS Institute Inc. All rights reserved. 32
/****************************************************************************** * Job: Job 1: Purchase Records-Valid & Invalid A5OOLY72.B900025Y * * Description: * * * * Repository: Foundation A0000001.A5OOLY72 * * Server: SASMain A5OOLY72.AQ000001 * * * * Source Table: Customer Purchase data - l_sdata.Xactionm A5OOLY72.B10000XM * * Target Tables: Purchase Detail Table - l_wdata.Product A5OOLY72.B10000XE * * Invalid Purchase Records - l_wdata.InvPur A5OOLY72.B10000XU * * * * Generated on: Mon Dec 13 16:26:29 CET 2004 * * Generated by: NLSSTRWIH\sasdemo * * Version: 9.1.20041201.4043 * ****************************************************************************** * Notes: * * Note_123 * * This note is to explain that this job is now support by developer * * XYZ * ******************************************************************************/…
Notes that were defined for the Job are shown here.
Copyright © 2003, SAS Institute Inc. All rights reserved. 33
SAS® ETL Studio3.2 Enhancements
More information on SAS ETL Studio 3.2
What’s New section in Online HelpHelp Contents from within ETL Studio
SAS ETL Studio Users Guidehttp://support.sas.com/documentation/onlinedoc/etls/index.html
Copyright © 2003, SAS Institute Inc. All rights reserved. 34Copyright © 2003, SAS Institute Inc. All rights reserved. 34