ETL Testing Tools

8/18/2019 ETL Testing Tools

1/6


2/6

ETL Testing Process:

ETL Testing Process is similar to other testing processes that includes following stages&

• #dentifying business re)uirements

• Test Planning

• esigning test cases and test data

• Test execution and bug reporting

• ummari$ing reports

• Test closure

Types of ETL Testing

ETL Testing can be categori$ed into following categories according testing process been

followed&

1) Production Validation Testing: #t is also called Table balancing or product

reconciliation. #t is performed on data before or as it is being moved into production system

in correct order

2) Source To Target Testing: This type of ETL Testing is performed to validate data

values after data transformation

) !pplication "pgrade: #t is used to chec- whether the data is extracted from older

application or new application or repository

4) ata Transformation Testing: Multiple !L )ueries are re)uired to be run for each

and every row to verify data transformation standards$) ata %ompleteness Testing: Performed to verify that the expected data should be

loaded at destination as per predefined standards

# would also li-e to compare ETL Testing with atabase Testing but before that let us have a

loo- towards types of ETL Testing with respect to database testing&

1) %onstraint Testing: Testers should test whether data is mapped accurately from source

to destination, while chec-ing for it testers need to focus on -ey chec-s constraints/ such

as&

• 01T 02LL

•

20#!2E• Primary 3ey

• +oreign 3ey

• (hec-

• 02LL

• efault


3/6

2) uplicate %&ec' Testing4 ource and target tables contains huge amount of data with

fre)uently repeated values, in such case testers follow some database )ueries to find such

duplication.

) (aigation Testing: 0avigation concerns with 52# of the application. 2ser finds

application friendly when he gets easy and relevant navigation throughout entire system.

Tester must focus on avoiding irrelevant navigation through user point of view.

4) *nitiali+ation Testing: #nitiali$ation Testing is performed to chec- combination of

hardware and software re)uirements along with platform it is installed

$) !ttri,ute %&ec' Testing: This testing is used to perform for verifying all attributes of

source and target system that should be same

+rom above listing one may consider that ETL Testing is )uite similar to atabase Testing

but the fact is ETL Testing is concerned with ata *arehouse Testing and not atabase

Testing.

There are several other facts due to which ETL Testing differs from atabase Testing, let6s

have )uic- loo- towards it one by one.

1) The primar- goal of atabase Testing is to chec- if the data follows the rules and

standards of data model where on the other hand ETL Testing chec-s if data is moved or

mapped as expected

2) atabase Testing focuses on maintaining primar- 'e-.foreign 'e- relations&ip while

ETL Testing verifies for data transformationas per re)uirement or expectation and same

at source and target

) atabase Testing recogni$es missing data where as ETL Testing determines duplicate

data

4) atabase Testing is used for data integration and ETL Testing forenterprise ,usiness

intelligence reporting

These are some ma7or differences which ma-es ETL Testing different from atabase Testing.

ETL bugs are also of several types such as/

T-pe of ,ug escription

(alculation Bugs +inal output wrong due to mathematical

error

#nput8output Bugs %ccepts invalid values and re7ects valid

values

98* bugs evice is not responding due to hardware

issues

2ser #nterface 'elated to 52# of an application


4/6

T-pe of ,ug escription

bugs

Load condition

bugs

enies multiple users

How to create test cases in ETL Testing:

The primary goal of ETL testing is to assure whether the extracted and transformed data is

loaded accurately from source to the destination. ETL testing includes two documents&

#1) ETL 0apping S&eets: This document contains information of source and destination

tables and their references. Mapping sheet provides help to create big !L )ueries while

performing ETL Testing.

#2) ata,ase sc&ema for Source and estination ta,le: #t should be -ept updated in

mapping sheet with database schema to perform data validation.

Best ETL Testing Tools List:

Li-e automation testing ETL Testing can be also automated. %utomated ETL Testing reduces

time consumption during the testing process and helps to maintain accuracy.

5iven below are some ETL Testing %utomation Tools that are used to perform ETL Testing

more effectively and rapidly.

#1) Informatica Data Validation

• #nformatica ata :alidation provides complete solution for data validation along with

data integrity

• 'educes programming efforts and business ris-s due to intuitive user interface and

built"in operators

• #dentifies and prevents data )uality issues and provides greater business productivity• %llows ;;= paid service that reduces time and cost re)uired for

data validation

fficial Lin'4 #nformatica ata :alidation

#2)QuerySurge from RTTS

https://www.informatica.com/etl-testing.html#fbid=H5RWy28Phxmhttps://www.informatica.com/etl-testing.html#fbid=H5RWy28Phxm


5/6

• !ueryurge is an automated testing tool specifically used for data warehouse testing

• :erifies, converts and upgrades data through the ETL process

• 'educes testing time and schedules tests for specific time

• Builds test scenario and test suits along with configurable reports

• (ommercial tool connects source and target data and also supports real time

progress of test scenarios

fficial Lin'4 !ueryurge from 'TT

#3) iCEDQ

• i(E! is designed for ETL Testing, ata Migration Testing and ata !uality

:erification

• #dentifies data integration errors without any custom code

• upports rule engine for ETL process, collaborative efforts and organi$ed !% process

• (ommercial tool with >? days trial provides custom reports with alerts and

notifications

fficial Lin'4 i(E!

#4) Datagaps ETL Validator

• ETL :alidator is data testing tool specifically for automated data warehouse testing

• ETL :alidator is used to chec- ata :alidity, ata %ccuracy and also used to perform

Metadata Testing

• (hec-s 'eferential #ntegrity, ata #ntegrity, ata (ompleteness and ata

Transformation

• (ommercial tool with >? days re)uires $ero custom programming and improves

business productivityfficial Lin'4 atagaps ETL :alidator

*hile performing ETL testing several things to be -ept in mind by testers, some of them are

listed below&

• %pply suitable business transformation logic

• Execute bac-end data"driven tests

http://www.querysurge.com/compare-trial-optionshttp://icedq.com/solutions/etl-testinghttp://www.datagaps.com/etl-validatorhttp://www.querysurge.com/compare-trial-optionshttp://icedq.com/solutions/etl-testinghttp://www.datagaps.com/etl-validator


6/6

• (reate and execute absolute test cases, test plans and test harness

• %ssure accuracy of data transformation, scalability and performance

• Ma-e sure ETL application reports invalid values

• 2nit tests should be created as targeted standards

Conclusion

ETL Testing is not only tester6s duty but it also involves developers, business analyst,

database administrators B%/ and even users. ETL Testing process became vital because it

is re)uired to ma-e strategic decisions at regular time intervals.

ETL Testing is being considered as Enterprise Testing though it re)uires good -nowledge of

L(, !L )ueries, ETL procedures etc.

Documents

ETL Testing Tools