30
DBMS Migration Case Study of the Total Information System (TIS) for Seoul National University of Science & Technology (SeoulTech) Mar 25, 2015 © 2015 TmaxSoft Co., Ltd. All Rights Reserved.

DBMS Migration Case Study of the Total Information System … · 4 /27 Current Status of SeoulTech SeoulTech, a national university located in Seoul with 105 years of history, plans

Embed Size (px)

Citation preview

DBMS Migration Case Study of the Total

Information System (TIS) for Seoul

National University of Science & Technology

(SeoulTech) Mar 25, 2015

© 2015 TmaxSoft Co., Ltd. All Rights Reserved.

TIS DBMS Migration Background and Review of Tibero Ⅱ

TIS DBMS Migration Ⅲ

Introduction to SeoulTech Ⅰ

2015 First-Semester Class Registration Result Ⅳ

Conclusion Ⅴ

Ⅰ Introduction to SeoulTech

3/27

Introduction to SeoulTech

Established as Vocational Supplementary School by Emperor

Gojong’s royal decree

Reorganized as Gyeonggi Technical College and relocated to the current location

Renamed as Seoul National Industrial University

Renamed as Seoul National University of Science & Technology (SeoulTech) in

celebration of the 100th anniversary of

the school’s foundation

Transitioned to a comprehensive university

1910

1980

1988

2010

2012

“Striving for the Future” SeoulTech

Your Future, Our Vision

Progressing with Korea’s scientific and technological development for over 100 years

4/27

Current Status of SeoulTech

SeoulTech, a national university located in Seoul with 105 years of history, plans to raise its university

ranking to top 10 in Korea and top 50 in Asia by 2020.

• Ranked 2nd among national universities in Korea by

JoongAng Daily

• Ranked 2nd in Korea (42nd in Asia) in 2014 QS

University Rankings among specialized universities

• Ranked 1st by National Research Foundation of

Korea in 2014 for the number of research papers

published per professor

• Ranked 2nd in employment rate at 62.5% in Korea

for schools with between 2,000 and 3,000

graduating students

• National university located in Seoul

• Total number of people: 13,324 ( as of March 2015)

- Undergraduates: 10,958, Graduates: 1,630

- Instructors: 384, Staff: 267, TAs: 85

TIS DBMS Migration Background and

Review of Tibero

• TIS DBMS Migration Background

• Tibero Verification for DBMS Migration

6/27

TIS DBMS Migration Background

SeoulTech’s Total Information System was originally built with Oracle. The school decided to migrate its

system to Tibero due to additional costs incurred from changes to Oracle’s license policy, and the

Korean government’s push towards use of domestic software.

DBMS Migration Overview

Korean Software Adoption Policy

Ministry of Science, ICT and Future Planning report to the President in April, 2014 - The main priority of the ICT policy is to develop core software technologies.

Oracle Tibero

3-1. Fostering software, the language of the 21st century, as a core industry [statute 11] Secure the world’s best software competitiveness through the advancement of software industry support system, and by finding, developing, and nurturing promising software companies. 1. Lead the way for fair pricing enforcement of domestic software through policy advancement starting with the public sector. - Strengthen monitoring of distributors for adhering to new laws such as restrictions on participation of large companies in public software projects, enforced by the Software Industry Promotion Act passed in May, 2012. - Increase software purchases by supporting distributors, promotion of excellent commercial software, and improving user recognition. -Expand growth capacity of companies through proper recognition of Korean software value. - Support fair software trade practices and improve quality by changing the hierarchical relationship between large, small and mid-sized companies to a mutual relationship.

7/27

Tibero Verification for DBMS Migration

Past Tibero case studies were reviewed before migration, and adaptability was confirmed through

Tibero training. Product reliability was also verified through a PoC test with the class registration

system.

Tibero Review

Training for Administrators & Developers

• National Education Training Institute’s

Integrated Training System

- Provides online/offline training to 700,000

teachers and staff in elementary, middle, and high

schools

- Maximum concurrent access: 25,000 users

- Daily average access: 90,000

• Hankyong National University Administrative

System

- Oracle license issues rose during development of

the administrative system

- Rapidly migrated the system from Oracle to

Tibero

- Some initial issues were completely resolved

• Training for Administrators

- Training process for Tibero DBAs

- Theoretical and practical training

- Duration: 2 days (10 hours)

• Training for Developers

- Training process for Tibero developers

- Theoretical and practical training

- Duration: 1 day (5 hours)

• Tibero POC Test

- Conducted in advance to verify Tibero’s

reliability

- Performed POC with the class registration

system

- Formed a TFT consisting of TmaxSoft

personnel and information & computing

center personnel

• DBMS Tuning

- Performed DBMS tuning to provide

optimized performance for business unit

systems

Ⅲ TIS DBMS Migration

• Migration Steps

- Pre-Analysis

- Execute Migration

- Verify Migration

- Complete Migration

9/27

TIS DBMS Migration - Migration Steps

Migration was carried out in pre-analysis, execution, verification, and completion steps.

Migration Steps of the TIS DBMS

Pre-analysis

• Analyze HW Environment

- Server system

- Integration system

• Analyze Oracle Environment

- Data size (in bytes)

- Number of objects, and programs

• Analyze Application

- Languages and number of

applications

- Functions, and procedures

•Analyze 3rd Party Solutions

- Analyze DBMS Integration

solutions

• Develop/Confirm Migration Plan

- Select migration targets and set

schedule

- Assign technical support

personnel

Execute Migration Verify Migration Complete Migration

• Migrate DBMS

- Configure test migration

environment

- Migrate Oracle objects

- Migrate Oracle data

• Migrate Applications

- Change JDBC/ODBC drivers

- Change some functions and SQL

- SQL tuning

• Migrate 3rd Party Solutions

- Change JDBC/ODBC drivers

- Change options

- Performance tuning

• Migrate Operation

- Migrate operational data

- Application integration

- 3rd party integration

• Monitor System

- Monitor system and perform

tuning

• Stabilization and Training

- Technical support

- Training support

- Maintenance

• Test Application Units

- Test application screens

- Test application functions

- Test application performance and

perform tuning

• Test System Integration

- Class registration system BMT

- Test compatibility with other

integrated systems in the school

- Measure performance and

perform tuning for the entire total

information system

10/27

TIS DBMS Migration – Pre-Analysis (Selecting Target Systems to Migrate)

Systems, excluding ERP, that use Oracle such as the total information system, electronic approval

system, and archives have been migrated to Tibero.

Target Operations for Migration

Before Current

TIS

(Including Academic System)

Archives

Electronic Approval System

DW (Statistics)

ERP (Administrative

Information System)

Systems that use Oracle DBMS

TIS

(Including Academic System)

Archives

New Homepage New Portal

Electronic Approval System

DW (Statistics)

ERP (Administrative

Information System)

Migration to Tibero DBMS

To be discontinued after completing development of the Ministry of

Education’s Resource Management System

11/27

TIS DBMS Migration – Pre-Analysis (Migration Schedule)

Starting from September 2014, it took 3 months to successfully migrate DBMS, applications, and 3rd

party solutions of the target system according to the following schedule.

Migration Schedule

Type September October November December

DBMS Migration

DBMS Verification

Compatibility Verification

Performance Verification

Operation Migration

12/27

SeoulTech’s information & computing center in collaboration with TmaxSoft, who has abundant

experience in Oracle migration, successfully migrated the university’s TIS.

Migration Type

Objects and Applications Migration Method Conducted By

DBMS Migration

Table, view, synonym,

trigger, etc.

Automatically migrate using tbMigrator

(domain index, user defined-types need

to be migrated after modifications are

made)

TmaxSoft

Procedures, functions Automatic migration using tbMigrator TmaxSoft

Data Migration Migrate using Table Migrator TmaxSoft

Application Migration

JAVA Modify queries and sources after

reconfiguring JDBC

• Functional and compatibility test: Information & computing center

• Source modification and performance verification:

Information & computing center

• SQL performance tuning: TmaxSoft

3rd Party Solutions Modify DBMS connection configuration

and perform integration test

• DBMS connection configuration: 3rd party solution engineers

• Integration Test: 3rd party solution engineers

TIS DBMS Migration – Execution

13/27

TIS DBMS Migration – Execution (DBMS Migration)

A DBMS for test purposes was developed to migrate DBMS and for compatibility test. A copy of the

operational data was used to avoid interfering with application operation and data, and a free

automatic migration tool was provided by Tmax to migrate Oracle objects and data.

Development of Test Purpose DBMS

Disk

Oracle DBMS

Oracle data & object

copies

Disk

Oracle DBMS

Oracle operational data & objects

Tibero DBMS

Tibero data & objects

for testing

Operation Administrator

① Generate a copy of the operational data

②Migrate Oracle objects

Test Engineer

In operation

Testing

Production Server Test Server

Need Tibero storage space

tbMigrator

Table Migrator

Parallel Process ③ Migrate Oracle data

14/27

TIS DBMS Migration – Execution (DBMS Migration Result)

The DBMS migration result showed a successful DBMS migration of TIS from Oracle to Tibero.

Operation Migration Result

System Obejct Oracle Tibero System Obejct Oracle Tibero

Total Information

System

TABLE 2040 ▶ 2040

Electronic Approval

TABLE 184 ▶ 184

INDEX 2071 ▶ 1909 INDEX 270 ▶ 270

VIEW 576 ▶ 576 VIEW 7 ▶ 7

MVIEW 17 ▶ 17 TRIGGER 35 ▶ 35

SYNONYM 176 ▶ 176 FUNCTION 54 ▶ 54

TRIGGER 1154 ▶ 1154 SEQUENCE 17 ▶ 17

FUNCTION 759 ▶ 759 PROCEDURE 8 ▶ 8

SEQUENCE 204 ▶ 204 PACKAGE 18 ▶ 18

PROCEDURE 253 ▶ 253

Archives

TABLE 143 ▶ 143

DW

TABLE 1240 ▶ 1240 INDEX 160 ▶ 160

INDEX 1091 ▶ 1091 SYNONYM 33 ▶ 33

VIEW 233 ▶ 233 TRIGGER 8 ▶ 8

MVIEW 175 ▶ 175 FUNCTION 4 ▶ 4

FUNCTION 47 ▶ 47 SEQUENCE 4 ▶ 4

PROCEDURE 241 ▶ 241

※ For TIS, the domain index used in the encrypted solution was not included in the migration.

15/27

TIS DBMS Migration – Execution (Application Migration)

Since Tibero supports most embedded functions and SQL supported in Oracle, applications running on

Oracle DB can be migrated simply by changing the JDBC driver without source modification.

Application Migration

Key SQL Key Embedded Functions

Type Supported Functions

Group AVG, COUNT, MAX, MIN, STDDEV, SUM, VARIANCE

Number

ABS, ACOS, ASIN, ATAN, CEIL, COS, EXP, FLOOR, TAN,

GREATEST, LEAST, LN, LOG, MOD, POWER, SIGN, SIN,

SQRT, TTRUNC

Character

ASCII, CHR, CONCAT, INITCAP, INSTR, INSTRB, LPAD,

LENGTH, LOWER, LTRIM, NLS_LOWER, NLS_UPPER,

NLSSORT, AREPLACE, RPAD, RTRIM, SUBSTR, SUBSTRB,

TRANSLATE, TRIM, UPPER

Date ADD_MONTH, EXTRACT, LAST_DAY, NEXT_DAY, ROUND,

SYSDATE, +, -

Other ROLLUP , DECODE, DUMP, NVL, NVL2, ROWNUM, RANK,

LEAD/LAG, ROW_NUMBER, PIVOT, CUBE

Type Supported SQL

Join Equi, anti, wemi, self, cartesian, inner, outer, (+)

Sub Query In-line view, nested query

Condition ANY, SOME, ALL, BETWEEN, EXISTS, IN, NULL, LIKE,

REGEXP_LIKE

Consistency Read committed, select for update, serializable

Other

Hierarchical queries (Start with ~ Connect by ~)

Parallel DML (Insert into ~ Select ~)

Dual table, CALL, merge, create table as select

PL/SQL

Basic blocks : BEGIN ~ END, DECLARE

Exception handling : EXCEPTION

Conditionals : IF THEN ELSE, ELSE IF, CASE ~ WHEN

Loops : FOR LOOP, WHILE LOOP, EXIT

Others: PROCEDURE, FUNCTION, PACKAGE, TRIGGER

Excellent Compatibility Proven in Migrating Applications from Oracle to Tibero

16/27

TIS DBMS Migration – Execution (Migrating 3rd Party Solutions)

The following table shows the integration status of SeoulTech’s 3rd party solutions. Although some

solutions had issues during the integration process, they were all resolved through Tmax’s proactive

technical support.

Solution Product Integration Key Issue Resolution

Data Encryption CubeOne Complete Cannot encrypt/decrypt • incorrect ODBC driver

Replaced the ODBC driver

WAS WebLogic 8.1 Complete Unnecessary DBMS locking with

Java applications

• missing Java application session disable routine.

Added resource cleanup routine

DW IBM Cognos 10.1.1 Complete

Cannot connect to Tibero • incorrect ODBC driver

Replaced the ODBC driver

Broken Korean characters • Missing the Cognos character set unicode configuration

Added unicode setting

ETL Tools BTL Data

Integrator Server 3.8 Complete

Cannot integrate with Tibero as the product is outdated

• Modified JDBC

Web Accelerator A10 networks

AX1000 Complete

- -

Electronic Approval/ Archives

Hi-Express V3.1 Complete Cannot integrate 3rd party

solution • Resolved with the help of the solution vendor

Homepage Search

XTEN v3.0 EE Complete Cannot integrate 3rd party

solution • Resolved with the help of the solution vendor

17/27

TIS DBMS Migration – Verification (Integration with Other Systems)

After migration, Tibero’s DB Link was used to successfully integrate TIS with other systems.

Integration with Other Systems via DB Link

Gateway Convert and send queries of the target DBMS

Convert results into Tibero data types Return converted data

Remote Database

Industry-Academic Cooperation

Library

Client

Standard Interface

Tibero

Send queries

Tibero to Oracle

Gateway Tibero gateway for Oracle

Gateway Method Local or listener method

Supported Language C, JAVA

Query support O

DML support O

JOIN support O

global tx support O (Oracle OCI)

Oracle

Heterogeneous Service

Oracle Gateway for ODBC Agent

Oracle 10g

HSODBC

Oracle 11g

DG4ODBC

Tibero ODBC Driver

Tibero

Client

1. Binaries are provided for each version

- 10g : HSODBC, 11g : DG4ODBC

2. Only supports local method

- General gateway must be installed on Oracle DBMS server

3. Distributed transaction(2PC) is not supported

4. BLOB/CLOB are not supported

Limitations of Oracle DB Link

18/27

TIS DBMS Migration – Verification (Class Registration Performance Test)

Using SeoulTech’s class registration system, approximately 5,000 students concurrently registered for

classes by dividing the school’s 11,000 students into two groups including 1st and 4th year students,

and 2nd and 3rd year students. The test was performed based on the maximum concurrent access of

1,000.

Item Description

Performance Test Tool WebLOAD (Web program performance test tool from Israel’s RadView)

Test Method Used 7,200 student IDs, each student registered 5 classes for 5 minutes.

Test Scenarios

Scenario 1

Scenario 2

Test Environment

Class Registration Test Server

Oracle DBMS

Tibero DBMS

WEB/ WAS

4 Load Generators

Test Server Specifications

DBMS Tibero 5 Oracle 9i

Server IBM P6 570 IBM P6 570

OS AIX 5.3 64 bit AIX 5.3 64 bit

CPU 3.5GHz 6-core 3.5GHz 6-core

Memory 23 GB 23 GB

Data Size 58 GB 65 GB

Login Class Registration

Menu Register Classes

View Registration History

Repeated 5 Times

Login Class Registration

Menu Register Classes

View Registration History

Repeated 5 times

19/27

TIS DBMS Migration – Verification (Class Registration Performance Test)

The class registration performance test result showed that Tibero displayed superior performance than

Oracle in average response time, and total number of class registrations for both test scenarios.

Test Result

Item Tibero Oracle

Avg. Response Time 0.83 sec 0.85 sec

Max. Number of Class Registrations Per Minute

21,257 sec 19,158 sec

Total Number of Class Registrations

31,222 sec 30,975 sec

Class Registration Performance Comparison for Scenario 1

Item Tibero Oracle

Avg. Response Time 0.78 sec 0.82 sec

Max. Number of Class Registrations Per Minute

17,664 sec 16,159 sec

Total Number of Class Registrations

31,187 sec 31,007 sec

Class Registration Performance Comparison for Scenario 2

Tibero Oracle Tibero Oracle

Max. Number of Class Registrations per Minute

Max. Number of Class Registrations per Minute

Total Number of Class Registrations

Total Number of Class Registrations

20/27

TIS DBMS Migration – Completion (Operation Migration)

After migrating DBMS, applications, and 3rd party solutions and conducting performance and

compatibility tests, DBMS operation migration was performed with consideration for down-time.

Operation Migration

Disk

Oracle DBMS

Oracle Data & Objects

Before Migration

Disk

Oracle DBMS

Oracle Data & Objects

Migrating Operations

Tibero DBMS

Tibero Data & Objects

Migrate Operations

After Migration

Disk

Tibero DBMS

Tibero Data & Objects

Install Tibero

Need Tibero Storage Space

• Installed Tibero on the server where Oracle DBMS is installed.

• Uninstalled Oracle after completing DBMS migration.

21/27

TIS DBMS Migration - Completion (Customer Appreciation Letter)

I would like to express my gratitude to Ms. Hyeji Jang who has done an amazing job in the Tibero migration project, and to recommend her for employee of the month. I believe that her friendly smiles and hard work were essential to a very successful database migration project. In fact, our staff gave Ms. Jang a nickname, the Tibero mascot. Moreover, all Tmax employees who were assigned to this project did an excellent job, and we would like to thank all of them. Through successful migration of SeoulTech’s database, I hope that many other universities will consider migrating to Tibero. I will be more than happy to promote Tibero. Please include me as a PR ambassador for Tibero.

Ⅳ 2015 First-Semester Class Registration Result

23/27

2015 First-Semester Class Registration Result

SeoulTech’s class registration system for the first semester of 2015 was performed in two groups,

including 1st and 4th year students, and 2nd and 3rd year students.

Item Description

Class Registration Period

January 19, 2015 ~ January 22, 2015

- Class Registration Phase 1: Performed class registration for 1st and 4th year students.

- Class Registration Phase 2: Performed class registration for 2nd and 3rd year students.

Class Registration

Users

Specifications for Class

Registration Servers

Comparison of Class Registration Server Specifications

Category 2015 First Semester 2014 First Semester

DBMS Tibero 5 Oracle 9i

Server IBM P6 570 IBM P6 570

OS AIX 5.3 64 bit AIX 5.3 64 bit

CPU 3.5GHz 12-core 3.5GHz 12-core

Memory 46 GB 46 GB

Comparison of Number of Class Registrations

Category 2015 First Semester 2014 First Semester

1st & 4th year students 4,516 4,893

2nd & 3rd year students 5,605 5,477

Total 10,121 10,370

24/27

2015 First-Semester Class Registration Result (Compared with First Semester of 2014)

Compared to class registrations during the first semester of 2014, class registrations in 2015 showed

faster and more reliable performance.

Class Registrations of First Semester of 2015

Number of Class Registrations Processed per Minute for 1st and 4th Year Students

Number of Class Registrations Processed per Minute for 2nd and 3rd Year Students

Superior Processing Performance Compared to Oracle Superior Stability Compared to Oracle

Processed more registrations compared to Oracle

during the 1st minute of class registration

Maintained lower number of transactions compared to

Oracle after the 1st minute of starting class registration

2015 1st Semester (Tibero)

2014 1st Semester (Oracle)

1st Semester, 2015 (Tibero)

1st Semester, 2014 (Oracle)

Ⅴ Conclusion

26/27

Benefits

SeoulTech’s TIS DBMS migration to Tibero helped break its dependence on foreign DBMS product and

diversify the DBMS market in Korea, while achieving enhanced system performance and TCO savings.

Benefits of Adopting Tibero

• Huge TCO reduction

compared to other vendors.

• More TCO savings through

continuous use of Tibero.

• Reliable operation of the

academic information

system.

• Reliable operation of major

systems, such as the

homepage and electronic

approval, after DBMS

migration.

• Complete integration with

other academic systems.

• Migrated the information

system built with Oracle to

a domestic DBMS.

• On-site support by technical

personnel during projects.

• Fast and efficient technical

support during failure.

27/27

Conclusion

Standard of excellence!

A new model for national universities in the 21st century, Seoul National University of Science & Technology

“Higher Expectations”

The only national comprehensive university in Seoul - Seoul National University of Science & Technology We aspire to develop future talents through comprehensive education in science, technology, and social sciences, and are different from a countless number of universities that focus on just theory or hands-on learning. We take pride in turning ideas into reality. Seoul National University of

Science & Technology

Pride

28/27

Total enterprise solution provider, TmaxSoft

Q & A

29/27

Total enterprise solution provider, TmaxSoft

Thank you!