Upload
evan-cole
View
217
Download
0
Tags:
Embed Size (px)
Citation preview
Internal Grid experiences in Montepaschi Group
Internal Grid experiences in
Montepaschi Group
Agenda
Introduction
2001 SOA Architecture
2005 Internal Grid solution and applications
2008 Grid and Virtualization
Internal Grid experiences in Montepaschi Group
2009 Evolution
IL GRUPPO MONTEPASCHI
Up-to-date on 09.30.2008
Il Consorzio Operativo Gruppo Montepaschi
Il Consorzio Operativo è la società che svolge in accentrato per le aziende del Gruppo Montepaschi lo sviluppo e la gestione dell'Information & Communication Technology, i Servizi di Back Office ed i Servizi Ausiliari
Le Banche che costituiscono il Consorzio:
Introduction
2001 SOA Architecture
2005 Internal Grid solution and applications
2008 Grid and Virtualization
Internal Grid experiences in Montepaschi Group
2009 Evolution
Agenda
Corporate
Center
Società diprodotto
Societàdi servizio
BancheSistema
di Servizia valore aggiunto
Corporate
Center
Società diprodotto
Societàdi servizio
BancheSistema
di Servizia valore aggiunto
Corporate
Center
Società diprodotto
Societàdi servizio
BancheSistema
di Servizia valore aggiunto
Clienti
Banche esterne
Fornitori
Societàprodottoesterne
Corporate
Center
Società diprodotto
Societàdi servizio
BancheSistema
di Servizia valore aggiunto
Clienti
Banche esterne
Fornitori
Societàprodottoesterne
Group’s Information System
From Inside
To outside
Estended Multichannell Architecture
Server
Branch
Channels
CED
Mainframe
Services
ATM POS
Server
WEB Server
Call Centre
HB Internet
Autom. Branch
WAP GSM
CB Internet
ecc.
WEBServer (IIS)
Web Services
Broker
Piattaforma CICS TS 1.3 o succ.Piattaforma CICS TS 1.3 o succ.
Piattaforma CICS TS 2.2 o succ.
Piattaforma J2EE
Piattaforma Windows
Oggetti di Business COM/.NET
Oggetti di Business CICS
Client windows based
J2EE application
CICS programs
DCOM / .NET
IIOP
DPL
SOAP
JCA / IIOP
SOAP
DCOM /.NET
Oggetti di Business J2EE
IIOP
DPL
Broker Server .NET
Broker Server JCICS
Bro
ker
Se
rver
J2E
E
JCA
Layer Broker
Broker Gateway
JCA / IIOP
Batch Processing
Mainframe
• IBM Tivoli Workload Scheduler • CICS (PAF) Batch TP
• Flows Converter (BTS)
• GRID (AGA)
Introduction
2001 SOA Architecture
2005 Internal Grid solution and applications
2008 Grid and Virtualization
Internal Grid experiences in Montepaschi Group
2009 Evolution
Agenda
MPS Internal Grid
• Use idle resources for CPU intensive jobs• Interaction with heterogeneous systems (desktops,
servers, dedicated server farms or even Host) by means of standard or standards-to-be protocols.
• Evolution from Condor to a custom solution• Communication between nodes is performed using
Web Services
Accomplishments
• Current Accomplishments– Clickstream analysis (January 2005)– IAS 32-39 (August 2005)– Top Management Monitoring (January 2006)– Basel II (Algoritmics) (October 2005)– DOC1 (December 2006)– many other apps …. until today
• Next Steps– Host Batch downsizing – …….
Gartner’s vision on Grid ComputingSource Gartner Jul 2007
The GridComputing power
is everywhere,
we try to make it usable by anyone.Miron Livny
Average Mainframe usage: 80%
Average RISC Servers usage: 45%
Average Intel Servers usage: 10-15%
Average Client usage: lower than 10%
“Year 2008 will see a doubling in usage of Servers”
Source: Gartner
Server usage will further increase in the future
There’s a lot of space in the bottom
Richard P. Feynman
Server farm
• About 600 non-dedicated Windows and Linux servers• We expect to have 1.000 central servers with Windows 2003
Server• About 27.000 jobs every day (41.000 peach)
Realizations
• Clickstream analysis– In production since the start of
the year – About 50 sites– 476 instances on single servers
Job entity valued in 2-4 CPUs servers working for 8 hours
The same job requires 2 hours of our Grid infrastructure
Phase I. Open Source + Condor
Phase II. Open Source + AGA
Phase III. SQL Server (AS) + AGA
IAS 32-49
• First hypothesis on Mainframe (Cobol+ DB2)• Realization with GRID (Cobol + AGA + SQL Server)• In production since July 2005• Elapsed time less than 1 hour
Basel II
• Chosen the Algorithmics’s (Unix/Linux and Oracle) for Market Risks Analysis Job
• Supplier proposed a SUN machine or a Grid DataSynapse• Solution based on AGA.NET (on Windows Servers) with
Linux nodes (we are discussing the porting of Algoritmics on Windows), including data loading
• in production since 2005’ end
Top Management MonitoringDatawarehouse for compliance• First implementation dedicated scheduler and machines• Today Grid scheduler……
Microsoft Reporting Services• loading data with Grid
Generation of documents and account statements for Customers
• Formerly DOC1(PDF document generator) for z/OS was used• Effort estimated: 6 days of elapsed working time (of a 8.000 MIPS
machine). • Now 1 day.• Today all banks in production on GRID (6 hours on mainframe -> 2 hours
on a few Grid machines for the main bank).
Conversion of batch procedures from mainframe
• Currently testing the porting of batch procedure– Cobol– PL/1 -> rewriting
Murex Reporting
• Currently more than 150 reports on Grid
Introduction
2001 SOA Architecture
2005 Internal Grid solution and applications
2008 Grid and Virtualization
Internal Grid experiences in Montepaschi Group
2009 Evolution
Agenda
Grid and Virtualization
• Our goal is the Grid computing node virtualization
• We are experimenting both ThinApp by VMWare and Xenocode
• If the application environment is not present on the node, we download it dynamically (using streaming) with the application
• Finally we destroy the virtual environment
Task execution sketch
Real environment
Virtual environment
\\nasfi1.local\VirtualApps
How it works
Application to be executed in a virtual environment
Task execution sketch - continued
The virtualized Execution host is downloaded using streaming from the network share\\nasfi1.local\
VirtualApps
Task execution sketch - continued
\\nasfi1.local\VirtualApps Application is
downloaded from a central repository
Virtual execution environment is created and the application (also downloaded from a central repository) is executed within it
Task execution sketch - continued
\\nasfi1.local\VirtualApps Applicatiocn
When the task ends, the virtual environmment disappears with the application itself
Output
Introduction
2001 SOA Architecture
2005 Internal Grid solution and applications
2008 Grid and Virtualization
Internal Grid experiences in Montepaschi Group
2009 Evolution
Agenda
New areas
• Grid scheduling with virtualization also for real time infrastructure (using Linux Virtual Server for balancing)
• Use of eterogeneus environment (GPU, FPGA) for high intensive computing task– Es. Monte Carlo simulation in Nvidia GPU
• Grid Services• Semantic (Data, Web Services, Grid)
SOA architecture needs GRID• Business services are not only RPC calls• We need long running processes also• SOA is not only for internal use
Grid Services• Web Services allow integration of heterogeneous
systems to achieve A2A communication and for short-term transactions, involving the exchange of relatively small quantities of data.
• Grid Services will allow integration for more significant jobs, considering the CPU usage and also the quantity of data.
• GRID vision allows the network to evolve to an environment in which machines and human beings can collaborate.
Cloud Computing
• Cloud or Fog ?• Standards ?
• Information tecnology is not only support for business.• It’s changing our way of learn, exchange knowledge,
buy, work, etc.
« Croire tout découvert est une erreur profonde, c’est prendre l’horizon pour les bornes du monde ! »
Camille Flammarion
Thanks
Piero PocciantiConsorzio Operativo Gruppo MontepaschiFunzione Osservatorio Tecnologico