QS320_ LabExercises_v7_20040810

8/9/2019 QS320_ LabExercises_v7_20040810

1/95

QualityStage Essentials 7.0

QualityStage Essentials(QS320)

Lab Exercises

Contact:Learning Services

Ascential Software0 !as"ington Street

!estboro# $A 0%&%%'&&&'&'*3 x33

E+Services,AscentialSoftware-co.

i


2/95


This document and the software described herein are the property of Ascential Software Corporationand its licensors and contain confidential trade secrets. All rights to this publication are reserved. Nopart of this document may be reproduced, transmitted, transcribed, stored in a retrieval system ortranslated into any language, in any form or by any means, without prior permission from AscentialSoftware Corporation.

© 2! Ascential Software Corporation.

Ascential Software Corporation reserves the right to ma"e changes to this document and the softwaredescribed herein at any time without any notice. No warranty is e#pressed or implied other than anycontained in the terms and conditions of sale.

Ascential Software Corporation$ %ashington Street

%estboro, &A '$(')'2' *SA+hone -$( /00)/(((

1a# -$( /00)/00

Ascential is a trademar" of Ascential Software Corporation Any other product or company namesmentioned are used for identification purposes only, and may be trademar"s or service mar"s of theirrespective owners.

&ay 20, 2! 345..'

ii


3/95


Table of Contents

AUDIENCE............................................................................................................................................................1

PREREQUISITES.................................................................................................................................................1

STRUCTURE OF THIS COURSE......................................................................................................................1

FILE LOCATIONS..................................................................................................................................................2

MODULE 1: DATA QUALITY............................................................................................................................4

EXERCISE 1-1 COURSE PROJECT.........................................................................................................................4

MODULE 2: INTRODUCTION TO QUALITYSTAGE..................................................................................8

EXERCISE 2-1 CONFIGURING QUALITYSTAGE.....................................................................................................8

MODULE 3: DEVELOPMENT BASICS.........................................................................................................11

EXERCISE 3-1 DEPLOY & R UN..........................................................................................................................11

EXERCISE 3-2 DEFINE A PROJECT.....................................................................................................................13

EXERCISE 3-3 DEFINE A DATA FILE..................................................................................................................14EXERCISE 3-4 DEFINE DATAFIELD DEFINITIONS...............................................................................................15

EXERCISE 3-5: COPY AUTOHOE DATA FILE AND FIELD DEFINITIONS TO CREATE LIFE DATA FILE AND

FIELD DEFINITIONS............................................................................................................................................1!

MODULE 4: INVESTIGATE............................................................................................................................17

EXERCISE 4-1: CHARACTER DISCRETE TYPE C " AUTOHOE POLICIES...................................................1#

LA$ 4-1: CHARACTER DISCRETE TYPE T " AUTOHOE POLICIES..............................................................21

EXERCISE 4-2: CHARACTER CONCATENATE I N%ESTIGATE................................................................................25

LA$ 4-2: CHARACTER DISCRETE TYPE C & T " LIFE POLICIES.....................................................................28

EXERCISE 4-3: ORD I N%ESTIGATION - NAE " AUTOHOE POLICIES...................................................2'

LA$ 4-3: ORD I N%ESTIGATION " ADDRESS & AREA " AUTOHOE POLICIES...............................................32

MODULE 5: ADDING A UNIQUE EY..........................................................................................................33

EXERCISE 5-1: TRANSFER STAGE " ADD R ECORD ( EY TO AUTOHOE......................................................33

MODULE !: STANDARDI"E...........................................................................................................................37

EXERCISE !-1 COUNTRY STANDARDI)E............................................................................................................3#

EXERCISE !-2: SELECT STAGE: SPLIT US DATA FRO NON-US DATA............................................................4*

EXERCISE !-3: STANDARDI)E: DOAIN PRE-PROCESSING................................................................................43

EXERCISE !-4: STANDARDI)E US NAE+ ADDRESS AND AREA DATA..............................................................45

EXERCISE !-5: I N%ESTIGATE U NHANDLED NAE PATTERNS........................................................................48

LA$ !-!: I N%ESTIGATE U NHANDLED ADDRESS AND AREA PATTERNS............................................................51

MODULE 7: RULE SET OVERRIDES............................................................................................................52

EXERCISE #-1: USNAE R ULE SET O%ERRIDES..............................................................................................52

LA$ #-1: US ADDRESS R ULE SET O%ERRIDES.................................................................................................5'

MODULE 8: MATCHING.................................................................................................................................!#

EXERCISE 8-1: U NDUPLICATION ATCH........................................................................................................!*

EXERCISE 8-2: CUSTO ATCH EXTRACT....................................................................................................!3

EXERCISE 8-3: IPRO%E ATCH PASS 1: SET CRITICAL %ARTYPES.............................................................!!

EXERCISE 8-4: SET ATCH CUTOFFS............................................................................................................!8

EXERCISE 8-5: ATCH PASS 2.......................................................................................................................!'

MODULE $: SURVIVORSHIP..........................................................................................................................7#

EXERCISE '-1: SUR%I%E ,$EST OF $REED CUSTOER R ECORD.................................................................#*

iii


4/95


APPENDI% A: COURSE APPLICATION DESIGN.......................................................................................72

APPENDI% B: FILE LAYOUTS.......................................................................................................................73

iv


5/95

QualityStage Essentials 7.0 Course Introduction

%elcome to the 6ualityStage 7ssentials course8

Ascential Software presents this 6ualityStage 7ssentials curriculum to provide youwith "nowledge about 6ualityStage software and data 9uality methods. This courseis designed to teach participants about how to use 6ualityStage, how to build a

custom application, how to view and interpret results, and how to approach variousproblems using the e#amples illustrated in this Student :uide. +articipation in groupdiscussions, hands)on labs, and practice e#ercises will prepare you for the real)world application of 6ualityStage and data 9uality methods. This wor"boo" can beused as either a self)paced study guide or as a comprehensive tutorial with AscentialSoftware instructors.

Throughout this course, you use "nown data sets with "nown problems andsolutions. To add value to your training e#perience, the instructor may opt toperform similar e#ercises with a sample of your pro;ect data.

Au+ience Ascential Software customers currently using or preparing to use 6ualityStage orstarting data 9uality and data integration initiatives.

/rereuisitesThis course is intended for system3data analysts, developers, and business analystswor"ing or beginning wor" on a data integration pro;ect. 1amiliarity with %indows,the operating system -eview of concepts learned

'


6/95


File Locations

=n this course the 6ualityStage ?esigner and Server are installed locally on your +C.6ualityStage uses the master pro;ects directory to store pro;ect libraries and theresults of ;obs that you e#ecute. The location of the master pro;ects directory is on

the server. =n this course, the location of the &aster +ro;ects directory isC:1/roects.

Note: The sub-folder projectname under the Master Projects directory refersto the project that you are currently working on in uality!tage" #ou mayha$e multiple projects and% conse&uently% will ha$e multiple project sub- folders under the Master Projects directory

/A4 5SA6E C78E8S

C:1ASCE89AL1Q5AL9SA6E;ES968E*7S directory

• • *SNA&7

• CAA>7A

• :B+>7+

C:1 ASCE89AL 1Q5AL9SA6E;ES968E


7/95


/A4 5SA6E C78E8S

C:1/ECS1P'()*+TN,M* 1SCun ogs

C:1/ECS1 projectname 1C78eports

• .&AT files

/


8/95

QualityStage Essentials 7.0 Module 1: Data Quality

$o+ule %: ;ata Quality

*ercise .-. +ourse Project

6oal: =ntroduce the customer consolidation3initial load course pro;ect

as?s:'. >eview the business case and pro;ect design

Course @usiness Case: !988 9nsurance C


9/95


%=NN has already identified some data 9uality issues within their e#isting systems. =naddition, they have identified several re9uirements for establishing their Customer=nformation -C=1 system. These issues are a serious concern of the management and theywould li"e to see a comprehensive plan for addressing these problems and re9uirements.

*S records should be split from international address records There is customer name and address information spread across free)form te#t fields.

They would li"e to see this organiDed into specified fields.

They want to match records across all sources

They want to remove all duplicate customer recordsE

They have inconsistent naming conventions across their systems. They would li"e to see

the name fields separate rather than in freeform te#t fields.

They need to standardiDe their address formats.

They want to establish a uni9ue customer profile

They have found blan" entries in their account fields

They want to maintain a cross)reference file to the legacy systems

Existing Syste.s

Source Syste. ;escrition L7@B7erational unction

A*T


10/95


0


11/95


5


12/95


$o+ule 2: 9ntro+uction to QualityStage

(


13/95


*ercise /-. +onfiguring uality!tage

6oal: 1amiliariDe yourself with 6ualityStage ?esigner and configure the?esigner to communicate with the 6ualityStage server

as?s:2. un +rofile


14/95


- Select L7CAL !98;7!S# and clic? 7

- +rofile $ L7CAL/C

- ost Type !98;7!S L7CAL

=- ost Server +ath C:1ASCE89AL1Q5AL9SA6ESE


15/95


!"en co.leting a run rofile for a re.ote server you will nee+ t"efollowing infor.ation:

'. ost name or =+ address of the host where the 6ualityStage server isinstalled.

2. ?irectory location of 6ualityStage server e#ecutables./. Name and location of the master pro;ects directory on the server.

!. ogin =? and password for the host where the 6ualityStage server isinstalled.

$. +ort that the 6ualityStage server is using -this port is chosen when youstart the 6ualityStage server. %hen running locally on your +C, you donot need to start the 6ualityStage server.

0. ocal location for 6ualityStage temporary report files.

+lease refer to the appropriate Server *ser :uide for additional details.

Alternate ocale =f you are processing data files that contain information in alanguage that is different from the server you are running on, you can use the

Alternate ocale field for pointing to location with the correct parameters.

''


16/95

QualityStage Essentials 7.0 Module 3: Deelo!"ent #asics

$o+ule 3: ;evelo.ent @asics


17/95


*ercise 0-. 1eploy 2 'un

6oal: earn how to e#ecute a ;ob and find the resulting pro;ect libraries on theserver

Exercise stes:

%- Select the demo Q5AL9 pro;ect, and e#pand the pro;ect -left pane

2- 7#pand the >7@S folder

3- Select ;E$7% ;ob -left pane

- Select the


18/95


*-


19/95


*ercise 0-/ 1efine a Project

6oal: ?efine the course pro;ect in 6ualityStage ?esigner

Exercise stes:

%- 1rom the ?esigner main window, on the left pane, select the folder/ECS

2- Select the 8ew button on the toolbar, and highlight /EC

3- =n the Add a New +ro;ect window, type in the following

Name !988C


20/95


*ercise 0-0 1efine a 1ata File

6oal: Create a file definition for the source data file A5747$E-

Exercise stes:

%- 1rom the ?esigner main window, on the left pane select the ;AA9LE ;E989978 folder under the !988C


21/95


*ercise 0-3 1efine 1atafield 1efinitions

6oal: ?efine the A*T


22/95


*ercise 0-5: +opy ,4T(6(M* 1ata File and Field 1efinitions to +reate L7F*1ata File and Field 1efinitions

6oal: +ractice copying data files and fields

Lab infor.ation:

Source file name is L9E, it contains =17 =nsurance +olicy

=t is a flat file with fi#ed record length

L9E source file has the same layout as A5747$E

%- 1rom the ?esigner main window, on the left pane, e#pand the ;AA9LE ;E989978 folder under the %innC>& pro;ect folder

2- ight)clic" on the =17 file and choose $7;9

=- *pdate the description to reflect life insurance policy information.


23/95

QualityStage Essentials 7.0 Module $: Inestigate

$o+ule : 9nvestigate


24/95


*8*'+7!* 3-.: +haracter 1iscrete Type + 9 ,4T(6(M* Policies

6oal: Assess the data 9uality issues in the single domain fields of the A5747$E source data file

Exercise 9nfor.ation:The =nvestigate stage output files are reports

>eports are pre)formatted te#t files and do not re9uire a file definition in6ualityStage

=nvestigate stages must be the only stage within a ;ob

Advanced settings

eave the sample siDe e9ual to '

The fre9uency should also be set to '

Name the =nvestigate stage: 9A4S;C -=nvestigate A*T


25/95


Name =AS?C

?escription Char ?isc I C All Single ?omain fields


26/95


''. >epeat steps 5)' for all fields

'2.Choose 989S4

'/.7@S folder

'!.>ight)clic" on the right pane and add a New Job

'$.Name the ;ob 9A4S;C# ?escription J C4A7@S folder

'(.


27/95


as? 3: $ove t"e Source ;ata

Exercise stes:

'. +lace the Student C? in the C? drive

2. 1rom the EHE


28/95



29/95


L, 3-.: +haracter 1iscrete Type T 9 ,4T(6(M* Policies

6oal: Assess the data 9uality issues in the single domain fields of the A5747$E source data file




Advanced settings

eave the sample siDe e9ual to '


Name the =nvestigate stage: 9A4S; -=nvestigate A*T


30/95


$. Complete the 6ualityStage =nvestigate Stage %iDard as follows

Name =AS?T

?escription Char ?isc I T All Single ?omain fields


31/95


'0. Select 7

'5.7#pand the >7@S folder

'(.un button on the toolbar

/. 1rom the Job >un


32/95


as? 3:


33/95


*ercise 3-/: +haracter +oncatenate 7n$estigate

6oal: Assess the correlation of the data in the ?


34/95


0. Clic" 8EH

5. Select the fields, one at a time

Choose A;; 7 SELEC 9EL;S

7<CL9C A8; ;epeat steps 5)' for all fields

'2.Choose 989S4

'/.7@S folder

'!.>ight)clic" on the right pane and add a New Job

'$.Name the ;ob 9A4;AES# ?escription J C4A7@S folder

'(.


35/95


as? 2: un button on the toolbar

/. 1rom the Job >un


36/95


L, 3-/: +haracter 1iscrete Type + 2 T 9 L7F* Policies

+erform similar character discrete investigations on the =17 datafile using both C

and T mas"s as you did on the A*T


37/95


*8*'+7!* 3-0: ;ord 7n$estigation - Name 9 ,4T(6(M* Policies

6oal: Assess the data 9uality issues in the Name field of the A5747$E sourcedata file




Name the =nvestigate stage: 9A48A$E -=nvestigate A*T


38/95


5. Select the rules set *SNA&7

(. Select the NA&7 field and drag to the Standard 1ields bo# on the right of thescreen

. Choose A;;


39/95


'$.>ight)clic" on the right pane and add a New Job

'0.?rag the stage into the Job

as? 2: un button on the toolbar

/. 1rom the Job >un


40/95


L, 3-0: ;ord 7n$estigation 9 ,ddress 2 ,rea 9 ,utohome Policies

6oal: Assess the data 9uality issues in the Address and City, State and Gip fieldsthe A5747$E source data file




Name the ;ob the same as the stage

*se the *SA??> F *SA>7A rule sets

as?s:

'. Build two separate =nvestigate %ord Stages and Jobs A??>7SS

a. *se *SA??> rule set

b. ?rag over Address' and Address 2

c. =nclude *nclassified Alphas in %ord 1re9uency 1iles

A>7A

a. *se *SA>7A rule set

b. ?rag over City, State and Gip

c. =nclude *nclassified Alphas in %ord 1re9uency 1iles

2. >un the Job/. >eview the results

!. SummariDe the results


41/95

QualityStage Essentials 7.0 Module %: &dding a 'ni(ue )ey

$o+ule : A++ing a 5niue ey

*ercise 5-.: Transfer !tage 9 ,dd 'ecord ecord Mey to the A5747$E and L9E data files

Exercise 9nfor.ation:The Transfer stage reads in one input file and write out one output file

The output file and output fields must be defined in the 6ualityStage?esigner

The input and output files have a similar structure so we will start by

copy the A*T


42/95


0. esults 1ile: C7$@98E


43/95


2. Assignment command ASS968

=n the 9EL; ASS968$E8 bo# type in A4 -A*T


44/95


45/95

QualityStage Essentials 7.0 Module *: Standardi+e

$o+ule : Stan+ar+iKe

*ercise =-. +ountry !tandardi>e

6oal: Assign a two byte =S< Country code the records so that we can then splitthe *S ?ata from the N


46/95


8EH

Choose the rule set C758


47/95


ChoosE 989S4

as? 3:


48/95


*ercise =-/: !elect !tage: !plit 4! 1ata From Non-4! 1ata

6oal: Separate the *S data records from the non)us data records. %e willcontinue processing the *S data and set aside the international data

Exercise 9nfor.ation:The Select stage reads in one input file and writes out up to two outputfile-s

The output file-s have the same structure as the input file

Copy the input ?atafile ?efinition, C8


49/95


8EHChoose the field to split the data, the two byte =S< country codeCCC758

8EH

7nter the value# 5S# to select the records with an =S< country C7;E 7 *S and re;ect the records that do not have *S as their =S< country code

989S4

Add the S+=T stage to the STAN Job

as? 3:


50/95


as? :


51/95


*ercise =-0: !tandardi>e: 1omain Pre-processing

6oal: Apply the *S+>7+ rule set to filter name components from address fields,and area components from address fields.

Exercise 9nfor.ation:The *S ?ata is the input to the *S+>7+ rule set

?efine the output file /


52/95


Add the field 8A$E

Add meta data label QA;;


53/95


*ercise =-3: !tandardi>e 4! Name% ,ddress and ,rea 1ata

6oal: StandardiDe the NA&7, A??>7SS, and A>7A -City, State and Gip fields

Exercise 9nfor.ation:The StandardiDe stage reads in one input file and writes out one output file

The output file must be defined in the 6ualityStage ?esigner. No outputfields need to be defined. The dictionary file of the rule set-s will populatethe output field definitions

?efine the output file and name it SA875

StandardiDe stages can be added to Jobs with other stages -e#cept=nvestigate

Name the StandardiDe stage SA8ALL

Add this stage to the Job SA8

as?s:'. ?efine the output file

2. ?efine the Stage

/. Add the Stage to the Job!. >un the Job

$. >eview >esults

as? %: ;efine t"e 7utut ile

Exercise stes:

'. Create a ?atafile ?efinition for the file SA875

!


54/95


as? 2: ;efine t"e Stage

Exercise stes:

'. Create a new StandardiDe stage named SA8ALL

?ata 1ile /esults 1ile: SA875


55/95


as? 3:


56/95


*8*'+7!* =-5: 7n$estigate 4nhandled Name Patterns

6oal: *se the =nvestigate Stage to review the results of the Name standardiDation




Advanced settings

=ncrease the sample siDe to $


Name the =nvestigate stage: 985/8$ -=nvestigate *nhandled +atterns for Name data


as?s:'. Build an =nvestigate Character Concatenate stage to investigate the data in

the following fields

5/5S8A$E ) *nhandled Name +atterns

5;5S8A$E I *nhandled ?ata

9/5S8A$E I =nput +attern Name

8A$E I un the Job

$. >eview the results

as? %: @uil+ t"e Stage an+ ;esign t"e >ob

Exercise stes:

%- Add the =nvestigate stage

2- Complete the 6ualityStage =nvestigate Stage %iDard as follows

Name 985/8$?escription Char Concat I C *nhandled Name +atterns


57/95


- Select the 5/5S8A$E field

The 1ield &as" Selection screen will pop)up

Choose the ALL C @578

- Clic" 7

- Select the remaining fields, one at a time

*?*SNA&7

=+*SNA&7

NA&7

The 1ield &as" Selection screen will pop)up

Choose the ALL H @578

=- Choose A;DA8CE; 7/978S

&- =ncrease the Sample SiDe to

*- Choose 7

%0-Choose 989S4

$/


58/95


%%- ?esign the Job, name it =N*+N&

%2- Add the stage to the Job

as? 2:


59/95


L, =-=: 7n$estigate 4nhandled ,ddress and ,rea Patterns

6oal: Assess the standardiDe results by investigating the 584A8;LE; A;;


60/95

QualityStage Essentials 7.0 Module 7: ,ule Set -errides

$o+ule =: emember =nvestigate stages cannot be added to Jobs with other stages

as?s:'. >eview =nvestigate results of *nhandled Name +atterns

2. Add *ser ules AnalyDer to test the override

!. Apply all overrides

$. >e)run SA8 ;ob to apply the overrides to the results file

0. >eview >esults

as? %:


61/95


The data appears to have been classified correctly so a classification override

won@t process this data correctly

Notice that the input pattern is identical to the unhandled pattern. This is an

indication that the pattern did not match any patterns in the pattern action file andan 98/5 /AEules from the menu bar, and thenchoose SA8;A


62/95


epeat the process for the remaining to"ens using the following settings

7E8

?ictionary 1ield 8'9


63/95


- See how the pattern is now correctly processed by the rule set

- Test all the names for this pattern

- Select EH9

584A8;LE; /AE


64/95


%- 1rom the 6ualityStage main menu select >ules from the menu bar, thenchoose SA8;A75@98

$A


65/95


Applying the override to the unhandled pattern will allow us to add one override.

=f we had chosen the input pattern override then we would need to add anoverride for each pattern.

This is an indication that the pattern did not match any patterns in the pattern

action file and an 584A8;LE; /AE


66/95


?ictionary 1ields $8'$9;;LE 8A$E

&ove Current


67/95


Lab ?-.: 4! ,ddress 'ule !et ($errides

6oal: Apply *ser eview the file 985/A;;emember =nvestigate stages cannot be added to Jobs with other stages

as?s:

'. >eview =nvestigate results of *nhandled Address +atterns2. Add *ser ules AnalyDer to test the override

!. Apply all overrides

$. >e)run SA8 ;ob to apply the overrides to the results file

0. >eview >esults

0/


68/95

QualityStage Essentials 7.0 Module : Matc/ing

$o+ule &: $atc"ing

0!


69/95


*8*'+7!* @-.: 4nduplication Match

6oal: 1ind duplicate customers from the policy data

Exercise 9nfor.ation:Business rule for identifying uni9ue customers are

Same 1ederal =?

Same +rimary Name at the same address

Same 1irst Name at the same address

The &atch stage can output up to three files

&atch 7#tract

&atch >eport

&atch Statistics 1ile

The &atch 7#tract file re9uires a file definition, the &atch report F &atchStatistics file do not need a file definition

Name the &atch stage: $AC4


as?s:'. ?efine the &atch 7#tract file -*ndup output file

2. Build the &atch stage Add +ass '

as? %: ;efine t"e $atc" Extract ile

'. 1rom the 6ualityStage main window, on the left pane select the ?atafile?efinition Stanout.

2. Select the Copy icon from the tool bar, select the folder ?atafile ?efinitions,select the +aste icon on the toolbar. Name the new ?atafile ?efinition *ndup

/. Select the *ndup ?atafile ?efinition, on the right pane right)clic" and add thefollowing fields

9EL; ;ESC


70/95


%- Add &atch Stage

Name $AC4

?escription 9;E89 ;5/L9CAE C5S7$E


71/95


- Add the following fields for match comparison

9EL;SA )

S*SA?? 0'5 ouse Suffi# CA> )

+?*SA?? 025 +re)direction CA> )

SN*SA?? 0$ Street name *NC7>T (

S?*SA?? 0($ Suffi# ?irectional CA> )

>4*SA?? 0' >ural >oute 4alue CA> )

B4*SA?? 5( Bo# 4alue CA> )

BN*SA?? 50/ Building Name *NC7>T (

GC*SA>7 '$$ Gip code CNTQ?=11 '

17?=? 2! 1ederal =? CNTQ?=11 2

- Clic" 7

05


72/95


*8*'+7!* @-/: +ustom Match *tract

6oal: Create a customer &atch e#tract specification for the match *ndup

Exercise 9nfor.ation:The &atch stage can output up to three files

&atch 7#tract

&atch >eport

&atch Statistics 1ile

The &atch 7#tract file re9uires a file definition, the &atch report F&atch Statistics file do not need a file definition

as?s:'. ?efine the Custom 7#tract

2. >un the &atch ;ob and review results

as? %: ;efine Custo. $atc" Extract

'. 1rom the &atch %iDard I &atch Specification screen choose the EH


73/95


!. &atch 7#tract Specification

SAE$E8 /E A


74/95


- Chec" the


75/95


*8*'+7!* @-0: 7mpro$e Match Pass .: !et +ritical Aartypes

6oal: =mprove &atch results by ma"ing the 17?=? field a critical field. =f the

17?=?s are populated and do not match e#actly then the records may not cometogether.

as?s:'. &odify the &atch stage and add a 4arType

2. >e)run the match

as? %: $o+ify $atc" Stage

%-


76/95


- Select the E;9; field

- Clic" the arrow button the right of the 1ed=? field

=- Select Add 4artype

&- Select 7

*- Clic" 989S4

%0-7@


77/95


*8*'+7!* @-3: !et Match +utoffs

6oal: Set cutoffs for &atch pass '

as?s:'. &odify the &atch stage and add match cutoffs

2. >e)run the match

as? %: $o+ify $atc" Stage

%-


78/95


*8*'+7!* @-5: Match Pass /

6oal: Add a second &atch +ass

as?s:'. &odify the &atch stage and add second match pass

2. >e)run the match

as? %: $o+ify $atc" Stage an+ a++ $atc" /ass 2

%-


79/95

QualityStage Essentials 7.0 Module : Suriors/i!

$o+ule *: Survivors"i

*8*'+7!* B-.: !ur$i$e Cest of reedD +ustomer 'ecord

6oal: Survive one customer record for load into %inn@s new C>& system

as?s:'. Add field overlay definitions to the input file - *N?*+

2. Copy *N?*+ ?atafile ?efinition to S*>4un Survive ;ob and review results

as? %: A++ iel+ 7verlay ;efinitions to t"e 9nut ile (58;5/)

%-


80/95

QualityStage Essentials 7.0 Module : Suriors/i!

- ules ?efinition screen add the following rules

A4>7C TH+7 76*AS A

NA&7C NA&7C&ost 1re9uent -Non)blan"

A??>C A??>C&ost 1re9uent -Non)blan"

A>7AC A>7AC&ost 1re9uent -Non)blan"

S*>4>7C TH+7 76*AS >A

- Clic" EH9

as? : A++ Stage to >ob#


81/95

QualityStage Essentials 7.0 &!!endi &: Course &!!lication Design

Aen+ix A: Course Alication ;esign

55


82/95


83/95

QualityStage Essentials 7.0 &!!endi #: 2ile ayouts

L7F* - Life Policies

Name 1escription 1ataType4seType

Missing

!tar t

*nd

Lengt h

SHSS>C Source System =? A+AN*& S S ' '+' Address ' A+AN*& S S 0 /$

A??>2 Address 2 A+AN*& S S $ /$

C=TH City Name A+AN*& S S '/ /$

STAT7 State A+AN*& S S '0$ $

G=+C


84/95


+NT'#(4T - 1ata with ,ppended 7!( +ountry +ode


Missing

!tar t

*nd

Lengt h

CCC7CN*& Se9uential >ecord Number A+AN*& S S (

SHSS>C Source System =? A+AN*& S S '( '

+


85/95


P'*P(4T - Pre-processed 4! 1ata


Missing

!tar t

*nd

Lengt h

NA*S+>7 Name?omain A+AN*& S S ' ' A?*S+>7 Address?omain A+AN*& S S '' '

A>*S+>7 Area?omain A+AN*& S S 2' '

+'*S+>7 1ield'+attern A+AN*& S S /' 2

+2*S+>7 1ield2+attern A+AN*& S S /2' 2

+/*S+>7 1ield/+attern A+AN*& S S /!' 2

+!*S+>7 1ield!+attern A+AN*& S S /0' 2

+$*S+>7 1ield$+attern A+AN*& S S /(' 2

+0*S+>7 1ield0+attern A+AN*& S S !' 2

=+*S+>7 =nput+attern A+AN*& S S !2' ((

7 7CN*& Se9uential >ecord Number A+AN*& S S 0(

SHSS>C Source System =? A+AN*& S S 0'( '

+


86/95


!T,N(4T - !tandardi>ed Name% ,ddress 2 ,rea


Missing

!tar t

*nd

Lengt h

NT*SNA& NameType A+AN*& S S ' ':C*SNA& :enderCode A+AN*& S S 2 '

N+*SNA& Name+refi# A+AN*& S S / 2

1N*SNA& 1irstName A+AN*& S S 2/ 2$

&N*SNA& &iddleName A+AN*& S S !( 2$

N*SNA& +rimaryName A+AN*& S S 5/ $

N:*SNA& Name:eneration A+AN*& S S '2/ '

NS*SNA& NameSuffi# A+AN*& S S '// 2

AN*SNA& AdditionalName=nformation A+AN*& S S '$/ $

&1*SNA& &atch1irstName A+AN*& S S 2/ 2$

N1*SNA& NHS==Sof&atch1irstName A+AN*& S 22( (

S1*SNA& >Sounde#of&atch1irstName A+AN*& S G 2/0 !

&*SNA& &atch+rimaryName A+AN*& S S 2! $M*SNA& ashMeyof&atch+rimaryName A+AN*& S S 2 '

+M*SNA& +ac"edMeyof&atch+rimaryName A+AN*& S S / 2

N%*SNA& Numberof&atch+rimary%ords A+AN*& S S /2 '

%'*SNA& &atch+rimary%ord' A+AN*& S S /2' '$

%2*SNA& &atch+rimary%ord2 A+AN*& S S //0 '$

%/*SNA& &atch+rimary%ord/ A+AN*& S S /$' '$

%!*SNA& &atch+rimary%ord! A+AN*& S S /00 '$

%$*SNA& &atch+rimary%ord$ A+AN*& S S /(' '$

N'*SNA& NHS==Sof&atch+rimary%ord' A+AN*& S /0 (

S'*SNA& >Sounde#of&atch+rimary%ord' A+AN*& S G !! !

N2*SNA& NHS==Sof&atch+rimary%ord2 A+AN*& S !( (

S2*SNA& >Sounde#of&atch+rimary%ord2 A+AN*& S G !'0 !*+*SNA& *nhandled+attern A+AN*& S S !2 /

*?*SNA& *nhandled?ata A+AN*& S S !$ '

=+*SNA& =nput+attern A+AN*& S S $$ /

7?*SNA& 7#ception?ata A+AN*& S S $( 2$

*


87/95


&T*SA?? &ulti*nitType A+AN*& S S 5!( $

&4*SA?? &ulti*nit4alue A+AN*& S S 5$/ '

BN*SA?? BuildingName A+AN*& S S 50/ /

AA*SA?? AdditionalAddress=nformation A+AN*& S S 5/ $

AT*SA?? AddressType A+AN*& S S (!/ '

NS*SA?? NHS==SofStreetName A+AN*& S (!! (

SS*SA?? >everseSounde#ofStreetName A+AN*& S G ($2 !

*+*SA?? *nhandled+attern A+AN*& S S ($0 /

*?*SA?? *nhandled?ata A+AN*& S S ((0 $

=+*SA?? =nput+attern A+AN*& S S /0 /

7?*SA?? 7#ception?ata A+AN*& S S 00 $

*7 GipCode A+AN*& S S '$$ $

G=+/ 1irst three bytes of Dip code A+AN*& S S '$$ /

G!*SA>7 Gip!AddonCode A+AN*& S S '0 !

CC*SA>7 CountryCode A+AN*& S S '0! 2

NC*SA>7 CityNHS==S A+AN*& S '00 (

SC*SA>7 City>everseSounde# A+AN*& S G '5! !

*+*SA>7 *nhandled+attern A+AN*& S S '5( /

*?*SA>7 *nhandled?ata A+AN*& S S ''( $

=+*SA>7 =nput+attern A+AN*& S S ''$( /

7?*SA>7 7#ception?ata A+AN*& S S ''(( $

*7 *ser7 1ield'+attern A+AN*& S S '$!! 2

+2*S+>7 1ield2+attern A+AN*& S S '$0! 2

+/*S+>7 1ield/+attern A+AN*& S S '$(! 2

+!*S+>7 1ield!+attern A+AN*& S S '0! 2

+$*S+>7 1ield$+attern A+AN*& S S '02! 2

+0*S+>7 1ield0+attern A+AN*& S S '0!! 2

=+*S+>7 =nput+attern A+AN*& S S '00! ((

7 7 Custom1lag A+AN*& S S '(!2 2

CCC7CM7H *ni9ue >ecord Mey A+AN*& S S '(! '2

1=7=? Source 1ile =ndicator A+AN*& S S '(! 2

>7CN*& Se9uential >ecord Number A+AN*& S S '($'

SHSS>C Source System =? A+AN*& S S '(0' '

+2 Address 2 A+AN*& S S '$$ /$

C=TH City Name A+AN*& S S ' /$

STAT7 State Abbreviation A+AN*& S S 22$ $

G=+ Gip Code A+AN*& S S 2/ '

17?=? 1ederal =? A+AN*& S S 2! '

(/


88/95


?


89/95


4N14P - 7dentify duplicate records


Missing !tart

*nd

Lengt h

T7&+ Temporary shift field A+AN*& S S ' 22S7T=? &atch Set Number A+AN*& S S '

S*>4>7C Best of Breed Customer ?ata A+AN*& S S ' '25

+ASS &atch +ass Number A+AN*& S S '' 2

TH+7 &atch >ecord Type A+AN*& S S '/ '

%7=:T&atch Composite %eight -&atchScore A+AN*& S S '$ 5

NT*SNA& NameType A+AN*& S S 2/ '

:C*SNA& :enderCode A+AN*& S S 2! '

N+*SNA& Name+refi# A+AN*& S S 2$ 2

NA&7C name fields to survive A+AN*& S S 2$ '$

1N*SNA& 1irstName A+AN*& S S !$ 2$

&N*SNA& &iddleName A+AN*& S S 5 2$

N*SNA& +rimaryName A+AN*& S S $ $

N:*SNA& Name:eneration A+AN*& S S '!$ '

NS*SNA& NameSuffi# A+AN*& S S '$$ 2

AN*SNA& AdditionalName=nformation A+AN*& S S '5$ $

&1*SNA& &atch1irstName A+AN*& S S 22$ 2$

N1*SNA& NHS==Sof&atch1irstName A+AN*& S 2$ (

S1*SNA& >Sounde#of&atch1irstName A+AN*& S G 2$( !

&*SNA& &atch+rimaryName A+AN*& S S 202 $

M*SNA& ashMeyof&atch+rimaryName A+AN*& S S /'2 '

+M*SNA& +ac"edMeyof&atch+rimaryName A+AN*& S S /22 2

N%*SNA& Numberof&atch+rimary%ords A+AN*& S S /!2 '

%'*SNA& &atch+rimary%ord' A+AN*& S S /!/ '$

%2*SNA& &atch+rimary%ord2 A+AN*& S S /$( '$

%/*SNA& &atch+rimary%ord/ A+AN*& S S /5/ '$

%!*SNA& &atch+rimary%ord! A+AN*& S S /(( '$

%$*SNA& &atch+rimary%ord$ A+AN*& S S !/ '$

N'*SNA& NHS==Sof&atch+rimary%ord' A+AN*& S !'( (

S'*SNA& >Sounde#of&atch+rimary%ord' A+AN*& S G !20 !

N2*SNA& NHS==Sof&atch+rimary%ord2 A+AN*& S !/ (

S2*SNA& >Sounde#of&atch+rimary%ord2 A+AN*& S G !/( !

*+*SNA& *nhandled+attern A+AN*& S S !!2 /

*?*SNA& *nhandled?ata A+AN*& S S !52 '

=+*SNA& =nput+attern A+AN*& S S $52 /

7?*SNA& 7#ception?ata A+AN*& S S 02 2$

*


90/95


>T*SA?? >ural>outeType A+AN*& S S 5' /

>4*SA?? >ural>oute4alue A+AN*& S S 5'/ '

BT*SA?? Bo#Type A+AN*& S S 52/ 5

B4*SA?? Bo#4alue A+AN*& S S 5/ '

1T*SA?? 1loorType A+AN*& S S 5! $

14*SA?? 1loor4alue A+AN*& S S 5!$ '

*T*SA?? *nitType A+AN*& S S 5$$ $

*4*SA?? *nit4alue A+AN*& S S 50 '

&T*SA?? &ulti*nitType A+AN*& S S 55 $

&4*SA?? &ulti*nit4alue A+AN*& S S 55$ '

BN*SA?? BuildingName A+AN*& S S 5($ /

AA*SA?? AdditionalAddress=nformation A+AN*& S S ('$ $

AT*SA?? AddressType A+AN*& S S (0$ '

NS*SA?? NHS==SofStreetName A+AN*& S (00 (

SS*SA?? >everseSounde#ofStreetName A+AN*& S G (5! !

*+*SA?? *nhandled+attern A+AN*& S S (5( /

*?*SA?? *nhandled?ata A+AN*& S S ( $

=+*SA?? =nput+attern A+AN*& S S $( /

7?*SA?? 7#ception?ata A+AN*& S S (( $

*7AC area fields to survive A+AN*& S S '!! !!

SA*SA>7 StateAbbreviation A+AN*& S S '5! /

GC*SA>7 GipCode A+AN*& S S '55 $

G!*SA>7 Gip!AddonCode A+AN*& S S '(2 !

CC*SA>7 CountryCode A+AN*& S S '(0 2

NC*SA>7 CityNHS==S A+AN*& S '(( (

SC*SA>7 City>everseSounde# A+AN*& S G '0 !

*+*SA>7 *nhandled+attern A+AN*& S S '' /

*?*SA>7 *nhandled?ata A+AN*& S S ''/ $

=+*SA>7 =nput+attern A+AN*& S S ''( /

7?*SA>7 7#ception?ata A+AN*& S S '2' $

*7 *ser7 1ield'+attern A+AN*& S S '$00 2

+2*S+>7 1ield2+attern A+AN*& S S '$(0 2

+/*S+>7 1ield/+attern A+AN*& S S '00 2

+!*S+>7 1ield!+attern A+AN*& S S '020 2

+$*S+>7 1ield$+attern A+AN*& S S '0!0 2

+0*S+>7 1ield0+attern A+AN*& S S '000 2

=+*S+>7 =nput+attern A+AN*& S S '0(0 ((

7 7 Custom1lag A+AN*& S S '(0! 2

CCC7CM7H *ni9ue >ecord Mey A+AN*& S S '(5' '2

1=7=? Source 1ile =ndicator A+AN*& S S '(5' 2

>7CN*& Se9uential >ecord Number A+AN*& S S '(5/

SHSS>C Source System =? A+AN*& S S '((/ '

(0


91/95


+2 Address 2 A+AN*& S S '55 /$

C=TH City Name A+AN*& S S 2'2 /$

STAT7 State Abbreviation A+AN*& S S 2!5 $

G=+ Gip Code A+AN*& S S 2$2 '

17?=? 1ederal =? A+AN*& S S 202 '

?


92/95


!4'A(4T - !ur$i$ed est of reed +ustomer 'ecords


Missing

!tar t *nd

Lengt h

T7&+ Temporary shift field A+AN*& S S ' 22S7T=? &atch Set Number A+AN*& S S '

S*>4>7C Best of Breed Customer ?ata A+AN*& S S ' '25

+ASS &atch +ass Number A+AN*& S S '' 2

TH+7 &atch >ecord Type A+AN*& S S '/ '

%7=:T&atch Composite %eight -&atchScore A+AN*& S S '$ 5

NT*SNA& NameType A+AN*& S S 2/ '

:C*SNA& :enderCode A+AN*& S S 2! '

N+*SNA& Name+refi# A+AN*& S S 2$ 2

NA&7C name fields to survive A+AN*& S S 2$ '$

1N*SNA& 1irstName A+AN*& S S !$ 2$

&N*SNA& &iddleName A+AN*& S S 5 2$

N*SNA& +rimaryName A+AN*& S S $ $

N:*SNA& Name:eneration A+AN*& S S '!$ '

NS*SNA& NameSuffi# A+AN*& S S '$$ 2

AN*SNA& AdditionalName=nformation A+AN*& S S '5$ $

&1*SNA& &atch1irstName A+AN*& S S 22$ 2$

N1*SNA& NHS==Sof&atch1irstName A+AN*& S 2$ (

S1*SNA& >Sounde#of&atch1irstName A+AN*& S G 2$( !

&*SNA& &atch+rimaryName A+AN*& S S 202 $

M*SNA& ashMeyof&atch+rimaryName A+AN*& S S /'2 '

+M*SNA& +ac"edMeyof&atch+rimaryName A+AN*& S S /22 2

N%*SNA& Numberof&atch+rimary%ords A+AN*& S S /!2 '

%'*SNA& &atch+rimary%ord' A+AN*& S S /!/ '$

%2*SNA& &atch+rimary%ord2 A+AN*& S S /$( '$

%/*SNA& &atch+rimary%ord/ A+AN*& S S /5/ '$

%!*SNA& &atch+rimary%ord! A+AN*& S S /(( '$

%$*SNA& &atch+rimary%ord$ A+AN*& S S !/ '$

N'*SNA& NHS==Sof&atch+rimary%ord' A+AN*& S !'( (

S'*SNA& >Sounde#of&atch+rimary%ord' A+AN*& S G !20 !

N2*SNA& NHS==Sof&atch+rimary%ord2 A+AN*& S !/ (

S2*SNA& >Sounde#of&atch+rimary%ord2 A+AN*& S G !/( !

*+*SNA& *nhandled+attern A+AN*& S S !!2 /

*?*SNA& *nhandled?ata A+AN*& S S !52 '

=+*SNA& =nput+attern A+AN*& S S $52 /

7?*SNA& 7#ception?ata A+AN*& S S 02 2$

*


93/95


>T*SA?? >ural>outeType A+AN*& S S 5' /

>4*SA?? >ural>oute4alue A+AN*& S S 5'/ '

BT*SA?? Bo#Type A+AN*& S S 52/ 5

B4*SA?? Bo#4alue A+AN*& S S 5/ '

1T*SA?? 1loorType A+AN*& S S 5! $

14*SA?? 1loor4alue A+AN*& S S 5!$ '

*T*SA?? *nitType A+AN*& S S 5$$ $

*4*SA?? *nit4alue A+AN*& S S 50 '

&T*SA?? &ulti*nitType A+AN*& S S 55 $

&4*SA?? &ulti*nit4alue A+AN*& S S 55$ '

BN*SA?? BuildingName A+AN*& S S 5($ /

AA*SA?? AdditionalAddress=nformation A+AN*& S S ('$ $

AT*SA?? AddressType A+AN*& S S (0$ '

NS*SA?? NHS==SofStreetName A+AN*& S (00 (

SS*SA?? >everseSounde#ofStreetName A+AN*& S G (5! !

*+*SA?? *nhandled+attern A+AN*& S S (5( /

*?*SA?? *nhandled?ata A+AN*& S S ( $

=+*SA?? =nput+attern A+AN*& S S $( /

7?*SA?? 7#ception?ata A+AN*& S S (( $

*7AC area fields to survive A+AN*& S S '!! !!

SA*SA>7 StateAbbreviation A+AN*& S S '5! /

GC*SA>7 GipCode A+AN*& S S '55 $

G!*SA>7 Gip!AddonCode A+AN*& S S '(2 !

CC*SA>7 CountryCode A+AN*& S S '(0 2

NC*SA>7 CityNHS==S A+AN*& S '(( (

SC*SA>7 City>everseSounde# A+AN*& S G '0 !

*+*SA>7 *nhandled+attern A+AN*& S S '' /

*?*SA>7 *nhandled?ata A+AN*& S S ''/ $

=+*SA>7 =nput+attern A+AN*& S S ''( /

7?*SA>7 7#ception?ata A+AN*& S S '2' $

*7 *ser7 1ield'+attern A+AN*& S S '$00 2

+2*S+>7 1ield2+attern A+AN*& S S '$(0 2

+/*S+>7 1ield/+attern A+AN*& S S '00 2

+!*S+>7 1ield!+attern A+AN*& S S '020 2

+$*S+>7 1ield$+attern A+AN*& S S '0!0 2

+0*S+>7 1ield0+attern A+AN*& S S '000 2

=+*S+>7 =nput+attern A+AN*& S S '0(0 ((

7 7 Custom1lag A+AN*& S S '(0! 2

CCC7CM7H *ni9ue >ecord Mey A+AN*& S S '(5' '2

1=7=? Source 1ile =ndicator A+AN*& S S '(5' 2

>7CN*& Se9uential >ecord Number A+AN*& S S '(5/

SHSS>C Source System =? A+AN*& S S '((/ '

(


94/95


+2 Address 2 A+AN*& S S '55 /$

C=TH City Name A+AN*& S S 2'2 /$

STAT7 State Abbreviation A+AN*& S S 2!5 $

G=+ Gip Code A+AN*& S S 2$2 '

17?=? 1ederal =? A+AN*& S S 202 '

?


95/95

Documents

QS320_ LabExercises_v7_20040810