Service Review and Plans

Carmine CioffiDatabase Administrator and Developer

3D Workshop, Barcelona (ES),

20-21 April 2009

Guess Where?

2

Guess Where?

3

BARCELLONA POZZO DI GOTTOMessina

Outline

• Systems Overview• Oracle configurations• Hardware Specifications• Issues• Future plans

4

Systems Overview

• ATLAS: 3 nodes RAC (OGMA)– third node added last week !!!

• LHCb: 2 nodes RAC (LUGH)• ATLAS LFC: single instance• FTS: single instance• TAG: single instance

5

Oracle configuration

• OGMA and LUGH:– Oracle 10.2.0.4– Jan 09 CPU– Processes = 800– Sessions = 885– open_cursors = 300– _buffered_publisher_flow_control_threshold = 30000– _db_block_numa = 1– _enable_NUMA_optimization = FALSE– _job_queue_interval = 1– streams_pool_size = 608MB

• ATLAS LFC: – Oracle 10.2.0.3– July 08 CPU– Processes = 150– Sessions = 170

6

Oracle configuration

• FTS:– Oracle 10.2.0.3– Jan 09 CPU– Processes = 350– Sessions = 390

• TAG:– Oracle 10.2.0.4– July 08 CPU– Processes = 150– Sessions = 170

• All systems are supported 24/7

7

Hardware Specification

• OGMA and LUGH:– 32bit– Red Hat Enterprise Linux AS release 4 (Nahant Update 7)– RAM: 4GB– Single Dual core AMD Opteron 2.4GHz– Third node:

• Two dual core AMD Opteron 2.4GH• RAM 8GB even though it uses only 4.

• LFC:– 32 bit– Red Hat Enterprise Linux AS release 4 (Nahant Update 7)– RAM: 4GB– Dual core Intel(R) Xeon(TM) CPU 2.80GHz

8

Hardware Specification

• FTS:– 32 bit– Red Hat Enterprise Linux AS release 4 (Nahant Update 7)– RAM: 4GB– Dual core Intel(R) Xeon(TM) CPU 2.80GHz

• TAG:– 32bit– Red Hat Enterprise Linux AS release 4 (Nahant Update 7)– RAM: 4GB– CPU: Dual quad core  Intel(R) Xeon(TM) CPU 2.80GHz

9

Issues

• Little memory especially for LFC and FTS

• OGMA and LUGH run on old machines and are out of warranty

• No hardware redundancy: single path, single switch and single disk array

• Lost one of the TAG disk array. At the moment the database is broken

• Mix hardware (OGMA)10

Future plans

• Move to new hardware• Install Oracle 64 bit• Add more RAM• Add hardware resilience• Migrate FTS and LFC to 3 nodes RAC (6th May

09):– RAC already installed– 64 bit system– 8GB RAM– Two Dual Core AMD Opteron(tm) 2.4Gh

• Looking into offsite availability 11

Estimated dates for migration

• 3D ATLAS ~mid June• 3D LHCb ~end August• TAG ~beginning of September

12