„Building Mission Critical IT systems‟ · PDF fileIIT Bombay Presentation at ... - IBM...

„Building Mission-Critical IT systems‟

an Exciting and Fulfilling Journey

Dr Deepak B Phatak, Umesh Bellur, Om Damani

Kanwal Rekhi Building

Department of Computer Science and Engineering

IIT Bombay

Presentation at Institute award lecture series

IRCC, 17 August 2011

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 2

Mission Critical Systems

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 3

Must function …

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 4

Correctly

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 5

Continuously

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 6

- Disaster Recovery

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 7

Effectively

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 8

- Response time

- Throughput

- Cost per transaction

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 9

Some Characteristics

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 10

LoC: 1 Million +

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 11

Typical life - 20 Years

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 12

- Change is the way of life

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 13

- Software changes are

“special”

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 14

- Growth in Volumes

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 15

- Number of transactions

- Number of users

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 16

- Technology obsolescence

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 17

Depository System

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 18

Trading in Stocks (shares)

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 19

Settlement

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 20

Transfers

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 21

Reconciliation

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 22

Processing Window

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 23

- Daily cycle

- EoD duration

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 24

Existing System

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 25

- CICS, COBOL, DB2

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 26

- IBM Mainframe

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 27

1595 MIPS

- 3 Lakh Transactions/Hour

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 28

Projections – Tx/Hour

3rd Year - 5 L (20L/day)

5th Year - 10L (40L/day)

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 29

Projections – No of users

3rd Year - 160L

5th Year - 200L

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 30

Projections for 10th Year

- Peak Tx/Hour 40L

- No of Users 500L

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 31

Decision to rewrite

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 32

- Multi-tier Architecture

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 33

- Java, App Servers

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 34

- DBMS

- Query Parallelism

- Partitions

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 35

- Product agnostic

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 36

Expectations

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 37

- Better performance

- Superior Scaling

- Lower cost

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 38

Proof of Concept

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 39

- Rewrite sample TXs

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 40

- Run on Multiple platforms

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 41

The „Rewrite‟ Project

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 42

NSDL to manage

TCS to execute

IIT to advise

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 43

Architecture, Design

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 44

Use of „Hibernate‟

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 45

- Reviews at each stage

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 46

Development, testing

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 47

The „story‟

- after 400 person-years

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 48

Performance: Throughput

13 L Tx/Hr on 890 MIPS

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 49

13 L Tx/Hr on 890 MIPS

As against

3 L Tx/Hr on 1595 MIPS

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 50

Performance:

Typical turn-around time

2 Minutes

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 51

2 Minutes

As against

30 to 40 minutes

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 52

The people

- who „wrote‟ this story

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 53

IIT Bombay

- Om Damani

- Umesh Bellur

- Deepak Phatak

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 54

TCS

- Shekhar Shukla

- Manish Dhall

- Sunil Batra

- …

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 55

NSDL

- Rajesh Doshi

- Yatin Nerurkar

- …

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 56

The Visionary Leader

Chandrakant Bhave

Dr Deepak B Phatak, IIT Bombay Mission critical IT systems 57

And the New system

- happily lives hereafter