Different Versions

DATASTAGE 8.5 ENHANCEMENTS

Datastage 8.5 Enhacements

It was more faster than before versiobs.All the tasks become faster than previous version 8.1 .

Tasks are like save, renaming, compiling etc.

The run time of the jobs has been improved.

In Datastage transformer Stage is one of the important stage.

In Datastage 8.5 , just got better than before version..

Transformer looping has been included in the transformer stage by I.B.M

There are two types of looping available here.

Where we can output multiple O/P( Output ) links for single I/P( Input Link) Link.

For Example:

Input:

Marketing_person City-1 city-2 city-3

James Bond Washington Newyork Newjersey

Output will be

Marketing_person City

James Bond WashingtonJames Bond New YorkJames Bond New Jersey

This achieved with the new system variable @ ITERATION

System Variables:

@ ITERATION : used in the looping mechanism

LastRow(): Indicated the last row in the job

LastRowInGroup(): will return the last rown in the group based on the key.

WHAT ARE THE CLIENT COMPONENTS IN DATASTAGE 7.5X2 VERSION

In Datastage 7.5X2 Version, they are 4 client Components. They are

1) Datastage Designer2) Datastage Director3) Datastage Manager4) Datastage Admin

In Datastage Designer, WeCreate the JobsCompile the JobsRun the Jobs

In Director, We canView the JobsView the LogsBatch JobsUnlock JobsScheduling JobsMonitor the JOBSMessage Handling

In Manager , We canImport & Export the JobsNode Configuration

And by using Admin , We canCreate the ProjectsOrganize the ProjectsDelete the Projects

DataStage 8.1 to DataStage 8.5

1. DataStage Designer performance improvement By changing the Metadata algorythm, copy/delete/save jobs got faster about 30-40%.2. Parallel Engine Performance and Resource improvements Resource usage is about 5% smaller than 8.1, for T-Sort, Windows desktop heap size has been decreased 94%.3. Transformer enhancements Key break supportLastRowInGroup() function is added. This will return true for the last record of the group.LastRow() will return the last record of input.Output looping :: Allows multiple output records to be created per single input record.Input looping :: Allows aggregation of input records so that aggregated data can be included with the original input data. ( like adding average column to the original input is now possible. ( 2 pass.... calculation. )New Null handling This is pretty complicate and need more verification by myself to explain clearly. But this is the description I got.Null values can now be included in any expression. -> Null values no longer need to be explicitly handled. A null value in an expression will return a null value result. As long as the target column is nullable, records will not be dropped. Stage variables are now always nullable.

APT_TRANSFORM_COMPILE_OLD_NULL_HANDLING is prepared to support backward compatibility.

New Transformer FunctionsCreate/offset a time, date or timestamp from component argumentsDateFromComponents(int32 years, int32 months, int32 dayofmonth)DateOffsetByComponents(date basedate, int32 yearoffset, int32 monthoffset, int32 dayoffset) DateOffsetByDays(date basedate, int32 offset)TimeFromComponents(int32 hours, int32 minutes, int32 seconds, int32 microseconds) TimeOffsetByComponents(time basetime, int32 houroffset, int32 minuteoffset, dfloat secondoffset) TimeOffsetBySeconds(time basetime, dfloat secondoffset)TimestampOffsetByComponents(timestamp basetimestamp, int32 yearoffset, int32 monthoffset, int32 dayoffset, int32 houroffset, int32 minuteoffset, dfloat secondoffset)TimestampOffsetBySeconds(timestamp basetimestamp, dfloat secondoffset)

Various packed decimal conversionsDecimalToDate(decimal basedecimal [,string format] )DecimalToTime(decimal basedecimal [,string format] )DecimalToTimestamp(decimal basedecimal [,string format] )DateToDecimal(date basedate [,string format] )TimeToDecimal(time basetime [,string format] )TimestampToDecimal(timestamp basetimestamp [,string format] )

4. DataStage Function enhancements New Client \ Domain Compatibility Check Before/after routines now mask encrypted params Copy project permissions from existing project when creating new project Environment variable enhancements: creation during import Add PX Stage Reset Support Enhancement to Parallel Data Set Stage Multiple Null Field Values on Import Enhancements to improve Multi-Client Manager support5. DataStage Serviceability enhancements New Audit Tracing Enhanced Exception Dialog ISA Lite Enhancements for DataStage Enhanced Project Creation Failure Details6. ParallelPivot - Adding Vertical Pivoting7. CVS (Code Version Control Integration) Information Server Manager was created on Eclipse from 8.1 Now the CVS or Subversion plugins to Eclipse are available for DataStage components.DIFFERENCE BETWEEN DATASTAGE 7.5X2 AND DATASTAGE 8.0.1 VERSIONS

Difference between Datastage 7.5X2 and Datastage 8.0.1 Versions

1) In Datastage 7.5X2, there are 4 client components. They area) Datastage Designb) Datastage Directorc Datastage Managerd) Datastage AdminAnd in2) Datastage 8.0.1 Version, there are 5 components. They area) Datastage Designb) Datastage Directorc) Datastage Admind) Web Consolee) Information Analyzer

Here Datastage Manager will be integrated with the Datastage Design option.

2) Datastage 7.X.2 Version is OS Dependent. That is OS users are Datastage Users.

and in 8.0.12)This is OS Independent . That is User can be created at Datastage, but one time dependant.

3) Datastage 7.X.2 version is File based Repository ( Folder).3) Datastage 8.0.1 Version is Datastage Repository.

4) No Web based Administration here.4) Web Based Administration.

5) There are 2 Architecture Components here. They area) Serverb) Client5) There are 5 Architecture Components. They area) Common user Interface.b) Common Repository.c) Common Engine.d) Common Connectivity.e) Common Shared Services.

6) P-3 and P-4 can be performed here.P-3 is Data Transformation.P-4 is Metadata Management

6) P-1,P-2,P3,P4 can be performed here.P-1 is Data ProfilingP-2 is Data QualityP-3 is Data TransformationP-4 is Metadata Management

7) Server is IIS

7) Sever is Websphere

8) No Web based Admin

8) Web based Admin.

DataStage 8.1 to DataStage 8.5

1. DataStage Designer performance improvement By changing the Metadata algorythm, copy/delete/save jobs got faster about 30-40%.2. Parallel Engine Performance and Resource improvements Resource usage is about 5% smaller than 8.1, for T-Sort, Windows desktop heap size has been decreased 94%.3. Transformer enhancements Key break supportLastRowInGroup() function is added. This will return true for the last record of the group.LastRow() will return the last record of input.Output looping :: Allows multiple output records to be created per single input record.Input looping :: Allows aggregation of input records so that aggregated data can be included with the original input data. ( like adding average column to the original input is now possible. ( 2 pass.... calculation. )New Null handling This is pretty complicate and need more verification by myself to explain clearly. But this is the description I got.Null values can now be included in any expression. -> Null values no longer need to be explicitly handled. A null value in an expression will return a null value result. As long as the target column is nullable, records will not be dropped. Stage variables are now always nullable.

APT_TRANSFORM_COMPILE_OLD_NULL_HANDLING is prepared to support backward compatibility.

New Transformer FunctionsCreate/offset a time, date or timestamp from component argumentsDateFromComponents(int32 years, int32 months, int32 dayofmonth)DateOffsetByComponents(date basedate, int32 yearoffset, int32 monthoffset, int32 dayoffset) DateOffsetByDays(date basedate, int32 offset)TimeFromComponents(int32 hours, int32 minutes, int32 seconds, int32 microseconds) TimeOffsetByComponents(time basetime, int32 houroffset, int32 minuteoffset, dfloat secondoffset) TimeOffsetBySeconds(time basetime, dfloat secondoffset)TimestampOffsetByComponents(timestamp basetimestamp, int32 yearoffset, int32 monthoffset, int32 dayoffset, int32 houroffset, int32 minuteoffset, dfloat secondoffset)TimestampOffsetBySeconds(timestamp basetimestamp, dfloat secondoffset)

Various packed decimal conversionsDecimalToDate(decimal basedecimal [,string format] )DecimalToTime(decimal basedecimal [,string format] )DecimalToTimestamp(decimal basedecimal [,string format] )DateToDecimal(date basedate [,string format] )TimeToDecimal(time basetime [,string format] )TimestampToDecimal(timestamp basetimestamp [,string format] )

4. DataStage Function enhancements New Client \ Domain Compatibility Check Before/after routines now mask encrypted params Copy project permissions from existing project when creating new project Environment variable enhancements: creation during import Add PX Stage Reset Support Enhancement to Parallel Data Set Stage Multiple Null Field Values on Import Enhancements to improve Multi-Client Manager support5. DataStage Serviceability enhancements New Audit Tracing Enhanced Exception Dialog ISA Lite Enhancements for DataStage Enhanced Project Creation Failure Details6. ParallelPivot - Adding Vertical Pivoting7. CVS (Code Version Control Integration) Information Server Manager was created on Eclipse from 8.1 Now the CVS or Subversion plugins to Eclipse are available for DataStage components.