Upload
tulia
View
31
Download
0
Tags:
Embed Size (px)
DESCRIPTION
The Mass Storage System at JLAB - Today and Tomorrow. Andy Kowalski. From CLAS DAQ. From Hall A,C DAQ. 100 mbit. 1000 mbit. FCAL (100MByte). SCSI. DST/Cache File Servers. Jefferson Lab Farm and Mass Storage Systems 2000. Tape Servers. Cache File Servers. DB Server. Work File Servers. - PowerPoint PPT Presentation
Citation preview
The Mass Storage System at JLAB - Today and Tomorrow
Andy Kowalski
Jefferson LabFarm and Mass Storage Systems
2000
FCAL (100MByte)
100 mbit1000 mbit
SCSI
From Hall A,C DAQFrom CLAS DAQ
Work File ServersWork File Servers
Cache File ServersCache File Servers
DST/Cache File ServersDST/Cache File ServersTape ServersTape Servers
Batch and Interactive FarmBatch and Interactive Farm
DB ServerDB Server
Farm
Total Batch Farm 6172.6 SPECint95 125 - Dual Processor Linux Systems4 - Dual Processor Solaris Systems
5 Interactive Farm Systems1 - Quad Processor Linux System2 – Dual Processor Linux Systems 2 – Quad Processor Solaris Systems
Disk Storage
MetaStor (Work) File Servers – Qty. 2 256MB Memory 100mbit Ethernet Ultra Wide SCSI RAID Systems RAID-5 Disk Space – 4TB
FS3/FS4 - 1TB FS5/FS6 - 3TB
Serving NFS User Managed Disk Space
Disk Storage cont.
Linux (Cache) File Servers – Qty. 9 Dual 650/700MHz Systems 512MB ECC Memory Gigabit Ethernet Mylex PCI RAID controller RAID-0 Disk Space – 5.8TB
Qty. 4 with 400GB Qty. 5 with 876GB
Linux (Red Hat 6.2) - 2.2.18pre11-va1.1smp Serving NFS Automatically Managed Disk Space
Tape Storage
StorageTek PowderHorn 9310 350 tape mounts per hour Holds 6000 tapes
Redwood Tape Drives – Qty. 8 50GB tape capacity 10MB/second
9840 Tape Drives – Qty. 10 20GB tape capacity 10MB/second
Tape Storage cont.
Open Storage Manager Computer Associates dropped support January
2000 Not distributed Two installations – mss1 and mss2
TapeServer Front-End Written in Java Makes two OSM servers act as one Stages data to/from disk from/to tape A user interface
Jefferson LabFarm and Mass Storage Systems
2001
FCAL (100MByte)
100 mbit1000 mbit
SCSI
From Hall A,C DAQFrom CLAS DAQ
Work File ServersWork File Servers
Cache File ServersCache File Servers
DST/Cache File ServersDST/Cache File Servers
Batch and Interactive FarmBatch and Interactive Farm
DB ServerDB Server
Tape ServersTape Servers
Projects
JASMineReplacement for OSMDistributed Data Movers and Cache
ManagersScalable to the needs of the experimentsSmart schedulingOff-site cache or ftp servers for data
exporting
Projects cont.
File ExportsJASMine Cache Software
GRID Aware - PPDGFTPBBFTPWEBTape
JASMine Logical Storage Organization
Store A logical entity made up of libraries, servers, data movers, and a
database.
Storage Group An object that belongs to a store and is itself a collection of
storage groups or volume sets.
Volume Set An object that belongs to a storage group and is itself a collection
of volumes.
Volume A unit of storage media.
Bitfile The copy of a file that has been copied into a store.
StorageGroup 2
Store
StorageGroup 1
VolumeSet 1
VolumeSet 2
StorageGroup 3
StorageGroup 4
StorageGroup 5
Vol
VolumeSet 3
VolumeSet 4
VolumeSet 5
Vol Vol
Vol Vol
Bitfiles Bitfiles Bitfiles
Bitfiles Bitfiles
JASMine Physical Storage Organization
Store A logical entity made up of libraries, servers, data
movers, and a database.
Library A set of volumes and drives.
Drive A media reader or writer.
Volume A unit of storage media.
JASMine Services
Request Manager Handles user requests and queries.
Scheduler Prioritizes user requests for tape access.
priority = share / ( .01 + (num_a * ACTIVE_WEIGHT) + (num_c * COMPLETED_WEIGHT) )
Log Manager Writes out log and error files and databases. Sends out notices for failures.
Library Manager Mount and dismounts tapes as well as other library
related tasks.
JASMine Services 2
Data Mover Dispatcher
Keeps track of available local resources and starts requests the local system can work on.
Cache Manager Manages a disk or disks for pre-staging data to and from
tape. Sends and receives data to and from clients.
Volume Manager Manages tapes for availability.
Drive Manager Manages tape drives for usage.
Dispatcher
CacheManager
DriveManager
DriveDisk
LibraryManager
VolumeManager
Client
RequestManager
Scheduler
Data Mover
LogManager
LibraryManager
Database
RequestManager
What to Expect in 2001
Work File ServersAdditional 5 TB Linux File Servers??
Cache File ServersAdditional 5-10TB
2001 cont.
Tape StorageJASMine Installed5-10 Data Movers10 Additional Tape Drives (9840 or 9940)
The End