Embed Size (px)
Citation preview
Information Services
Migration and Source Control of SAS Business Intelligence objects in an ITIL environment
• David Waters – Griffith University
• Title: Business Intelligence Systems Analyst
• Actual: Data Architect/Data Modeller/ETL Developer
Information Services
ITIL - Information Technology Infrastructure Library
• The Information Technology Infrastructure Library (ITIL) is a set of concepts and policies for managing information technology (IT) infrastructure, development and operations. http://en.wikipedia.org/wiki/ITIL
• The goal of Change Management is to ensure that standardised methods and procedures are used for efficient handling of all changes http://en.wikipedia.org/wiki/ITIL#Change_Management
Information Services
The Most Boring Topic Imaginable
• Source Control is Boring
• Migration is Boring
• Releasing software into Production is Boring
3
Information Services
Unless
• Unless you have to rollback to an old version that you no longer have
• Unless you migrate the wrong thing
• Unless the software you release crashes the CEOs Browser Window
4
Information Services
About Griffith• 37,786 Students (Fulltime and Part-time)• 3,563 Staff (Full Time Equivalent) • 5 Campuses (Nathan, Gold Coast, Mt Gravatt, Logan, South Bank)
• 8,847 International Students from 119 countries• 38 Research Centres• 268 Undergraduate Programs• 382 Postgraduate Programs• 104 Research Programs
5
Information Services
Technology in Use at Griffith
• SAS – BI Suite
– DI - Data Integration Studio
– BI - Info Maps, Web Report Studio, Office Add In etc
6
Information Services
Technology in Use at Griffith
• SAS – SPM (Strategic Performance Management)
– DI Studio, BMF Load for Data Loads
– SPM Scorecards and WRS for User Experience
7
Information Services
Technology in Use at Griffith
• Oracle RDBMS
• PeopleSoft, Finance, HR, Campus Solutions
• Blackboard, Evaluations@Griffith etc
8
Information Services
Design Methodology
• Kimball Method (Data Warehousing Design Patterns)
• Star Schemas (in Oracle RDBMS)
• Cubes (SAS)
9
Information Services
Design Methodology
• Web Delivery – SAS Information Delivery Portal
• SAS Information Maps for exposing data
• Web Report Studio
• Java Cube Viewer
10
Information Services
Design Methodology
• Business Intelligence Initiatives of less than 12 weeks and preferably less than 8 weeks– Lots of client engagement by the Business Analysts– Early and iterative user testing
• Fast delivery cycles, Agile (Scrum) etc
• Separate Development, Test and Production
11
Information Services
Development/Release Methodology
• ETL Jobs, Info Maps, Cubes go through full development, test, production life cycle
• WRS reports built on existing Maps/Cubes can be fast tracked
12
Information Services
Development/Release Methodology
13
Information Services
Source Control
• Work units exported from ETL Studio, Management Console or OLAP Cube Studio
• Imported into SVN (File source control)
14
Information Services
Exporting MetadataDI Studio
15
Information Services
Exporting MetadataDI Studio
16
Information Services
Exporting MetadataOLAP Cube Studio
17
Information Services
Exporting Metadata OLAP Cube Studio
18
Information Services
Exporting Metadata
19
Information Services
Exporting Metadata
20
Information Services
Exporting Metadata
21
Information Services
DI Studio
22
Information Services
Tortoise SVN
23
Information Services
SVN
• Subversion (SVN) is a version control system, it's intended as a successor to Concurrent Versions System (CVS).
• Open Source
24
Information Services
SVN
• Does have locking but generally:– A server stores the current version(s) of a project and clients connect to the server and "check
out" a complete copy, work on the copy and later "check in" their changes;– If two developers make a change to a file only changes made to the latest version are
acceptable;– If both changes are made to the latest version then manual intervention may be required (pretty
rare);
• Developers can update from the server repository; and
• Developers can commit their changes
25
Information Services
Tortoise SVN
26
Information Services
Tortoise
SVN
27
Information Services
Tortoise
SVN
28
Information Services
Tortoise
SVN
29
Information Services
Tortoise SVN
30
Information Services
Some Process Details – ETL Jobs
31
• Migrate Tables first (before Jobs)
• File Loaders lose their mappings
– Keep them simple so we can automagically remap them
• Lookups lose their mappings
– Use SQL nodes instead
Information Services
e.g
32
Information Services
Some Process Details – OLAP
33
• Indexes created by OLAP cube studio don’t migrate
– OLAP Cube Studio Wizard needs to be rerun
Information Services
Some Process Details – Info Maps
34
• Have to manually edit the SAS Library details in the XML of the Map
– Database Schemas are different on each environment
– Edit the XML in the Info Map and change the Database Schema – we have a procedure on doing this
Information Services
Questions?
35
• Contact Details– Telephone (07) 373 54052– Mobile 0408 074 082
– Griffith Location Community Centre (N66) 1.21B– Campus Address Nathan Campus, Griffith University– 170 Kessels Road, Nathan, QLD, 4111
– Email Address [email protected]
