SeETLSeETL

Demonstration 03Demonstration 03

Using the Runtime Using the Runtime EngineEngine

1/3/20121/3/2012

www.InstantBI.cowww.InstantBI.comm

Introduction

History of the SeETL EngineHistory of the SeETL Engine The innovation to C GenerationThe innovation to C Generation The innovation to C++/ODBCThe innovation to C++/ODBC Demonstration of C++/ODBC engineDemonstration of C++/ODBC engine SummarySummary

History of the SeETL Engine 1995 – Cobol templates created, customised by 1995 – Cobol templates created, customised by

handhand 1997 – Cobol templates parameterised and cobol 1997 – Cobol templates parameterised and cobol

programs generatedprograms generated 1998-2002 – No activity1998-2002 – No activity 2002 – C Data Warehouse Generator created2002 – C Data Warehouse Generator created

Generated C code rather than cobol codeGenerated C code rather than cobol code

2003 – Migration from C and embedded SQL to C+2003 – Migration from C and embedded SQL to C++ and ODBC 3.5.1+ and ODBC 3.5.1

2004 SeETL Design Time to generate views needed2004 SeETL Design Time to generate views needed 2008 – SQL Generation version invented2008 – SQL Generation version invented 2009 – A major client asks us to massively expand 2009 – A major client asks us to massively expand

the coverage of the dictionary.the coverage of the dictionary.

Innovation to C Generation In 2002 Ralph Kimball suggested I write and In 2002 Ralph Kimball suggested I write and

article on what good ETL engines would have in article on what good ETL engines would have in themthem

Ralph moved on and the article was not printedRalph moved on and the article was not printed The list of features made compelling readingThe list of features made compelling reading Cobol was dead by this time so a migration to C Cobol was dead by this time so a migration to C

with embedded SQL that emulated the cobol was with embedded SQL that emulated the cobol was attemptedattempted

It was successful and I learned a great deal about It was successful and I learned a great deal about writing C with embedded SQLwriting C with embedded SQL

The C data warehouse generator was released in The C data warehouse generator was released in 20022002 Interest was very mild and no sales ensuedInterest was very mild and no sales ensued

Innovation to C++/ODBC Engine In 2002 MSFT announced it would remove embedded In 2002 MSFT announced it would remove embedded

SQL in C from SQL Server 2005 forwardsSQL in C from SQL Server 2005 forwards After 2005 ODBC was the ONLY interface solution for After 2005 ODBC was the ONLY interface solution for

ETLETL The article for Ralph was still on my mindThe article for Ralph was still on my mind Question Question

““Could I write the ETL tool I wanted?”Could I write the ETL tool I wanted?”

In late 2002 the answer was “yes” In late 2002 the answer was “yes” I had developed the base classes that would be I had developed the base classes that would be

necessary to develop the remainder of the C++ necessary to develop the remainder of the C++ engine engine

Version 1.0 was released in 2003 to warm responseVersion 1.0 was released in 2003 to warm response Three good sales ensued over the next year or twoThree good sales ensued over the next year or two The C++ engine was used and further developed on projectsThe C++ engine was used and further developed on projects It is very stable and robustIt is very stable and robust

Demo of C++/ODBC Engine

We will show you just a simple set of ETL We will show you just a simple set of ETL generationgeneration

Summary

History of the SeETL EngineHistory of the SeETL Engine The innovation to SQL GenerationThe innovation to SQL Generation Demonstration of SQL GenerationDemonstration of SQL Generation SummarySummary