A. Sim, CRD, L B N L 1SRM Collaboration, Aug. 2006

SRM implementations and SRM implementations and deployments that may affect OSG deployments that may affect OSG

in the near-termin the near-term

Alex Sim Alex Sim

Scientific Data Management GroupScientific Data Management Group

Computational Research DivisionComputational Research Division

Lawrence Berkeley National LaboratoryLawrence Berkeley National Laboratory

A. Sim, CRD, L B N L 2SRM Collaboration, Aug. 2006

GoalsGoals

• Deploy stable and reliable storage management Deploy stable and reliable storage management to OSG-SE/CE to OSG-SE/CE • Compliant to SRM specifications• Interoperate with other SRM implementations and

deployed SRMs, including SRMs deployed in Europe

A. Sim, CRD, L B N L 3SRM Collaboration, Aug. 2006

Current deployment statusCurrent deployment status

• SRM servers deployed in OSGSRM servers deployed in OSG• SRM/dCache from FNAL• SRM/DRM from LBNL

• SRM client deployed in OSGSRM client deployed in OSG• srmcp from FNAL

• SRM-TesterSRM-Tester

• All currently deployed SRM versions are All currently deployed SRM versions are compliant to SRM spec v1.1compliant to SRM spec v1.1

A. Sim, CRD, L B N L 4SRM Collaboration, Aug. 2006

SRM interop test result for v1.1SRM interop test result for v1.1(8/21/2006)(8/21/2006)

ping get put advisory delete

ARC (UIO.NO) pass pass fail fail

LCG/EGEE (CERN) pass pass pass pass

FNAL pass pass pass pass

STAR (LBL.GOV) pass pass pass pass

OSG (SDSC.EDU) pass pass pass pass

EGEE (IC.UK) pass pass pass pass

COPY/PULL caseTarget SRM

ARC (UIO.NO)

LCG/EGEE (CERN.CH)

FNAL STAR (LBL.GOV)

OSG (SDSC.EDU)

EGEE (IC.UK)

Source SRM

ARC N.A. fail fail N.A. fail

LCG/EGEE (CERN.CH) fail pass pass N.A. pass

FNAL fail N.A. pass N.A. pass

STAR (LBL.GOV) fail N.A. pass N.A. pass

OSG (SDSC.EDU) fail N.A. pass pass pass

EGEE (IC.UK) fail N.A. pass pass N.A.

http://sdm.lbl.gov/srm-tester

A. Sim, CRD, L B N L 5SRM Collaboration, Aug. 2006

new implementation statusnew implementation status

• SRM spec v2.2SRM spec v2.2

• SRM serversSRM servers• SRM/dCache from FNAL• SRM/DRM from LBNL• SRM/L-Store from Vanderbilt

• SRM clientSRM client• srm-clients package

• SRM-TesterSRM-Tester

• New implementations will begin deployed in Nov New implementations will begin deployed in Nov 2006.2006.• OSG deployment : ITB 0.6 or ITB 0.8

A. Sim, CRD, L B N L 6SRM Collaboration, Aug. 2006

What’s new in the v2.2 spec?What’s new in the v2.2 spec?

• Active space reservationActive space reservation• With negotiated sizes and time limits• Multiple space reservations for different work

• Ability to “stage” files with deferred start timeAbility to “stage” files with deferred start time• srmBringOnline

A. Sim, CRD, L B N L 7SRM Collaboration, Aug. 2006

Impacts of new deploymentsImpacts of new deployments

• All new versions will not communicate with older All new versions will not communicate with older versions.versions.• For example, old srmcp for SRM v1.1 will not be able to

communicate with new SRM v2.2 based servers.• New SRM servers cannot interoperate with older SRM

servers in copy case.• Both versions will co-exist for a while.

• Will require community-wide plans and efforts to Will require community-wide plans and efforts to update SRMs within OSGupdate SRMs within OSG• Targeted by ITB 0.8

A. Sim, CRD, L B N L 8SRM Collaboration, Aug. 2006

SRM interop test result for v2.2SRM interop test result for v2.2(8/21/2006)(8/21/2006)

MethodsCERN Castor

CERN DPM

FNAL dCache

RAL Castor

LBNL SRM

srmPing Ok Ok Exception Ok Ok

srmPrepareToPut, srmStatusToPut, srmPutDone

N.A. Ok Ok Ok Ok

srmPrepareToGet, srmStatusToGet Exception Ok Ok Failed Ok

SrmRelease N.A. Ok Ok N.A. Ok

Mkdir Ok Ok Ok Ok Ok

Rmdir Ok Ok Ok Ok Ok

SrmMv N.A. Ok Ok Ok Ok

SrmRm N.A. Ok Ok Ok Ok

SrmLs Exception Exception Ok Exception Ok

SrmReserveSpace Failed Ok Failed Failed Ok

SrmReleaseSpace N.A. Ok N.A. N.A. Ok

A. Sim, CRD, L B N L 9SRM Collaboration, Aug. 2006

SRM interop test result for v2.2SRM interop test result for v2.2(8/21/2006)(8/21/2006)

MethodsCERN Castor

CERN DPM

FNAL dCache

RAL Castor

LBNL SRM

SrmPrepareToPut, srmStatusOfPut, srmPutDone (with reserved space)

N.A. Ok N.A. N.A. Ok

SrmPrepareToGet, srmStatusOfGet (with reserved space)

N.A. Ok N.A. N.A. Ok

Methods CERN CastorCERN DPM   

FNAL dCache

RAL CastorLBNL SRM

COPY from Gridftp Source to SRM

Failed (work in progress)

N.A.   Ok Failed (work in progress)

Ok

http://sdm.lbl.gov/srm-tester

A. Sim, CRD, L B N L 10SRM Collaboration, Aug. 2006

SRM interop test result for v2.2SRM interop test result for v2.2(8/21/2006)(8/21/2006)

Copy/PULLCopy/PULL

Target SRMTarget SRM

Source SRMSource SRM CERN Castor CERN DPM    FNAL dCache RAL Castor LBNL SRM

CERN Castor N.A.   Failed N.A.   Failed

CERN DPM N.A.   Ok N.A.   Ok

FNAL dCache N.A.   N.A.   N.A.   Ok

RAL Castor N.A.   N.A.   N.A. Failed

LBNL SRM N.A.   N.A.   Failed N.A.  

Copy/PUSHCopy/PUSH

Target SRMTarget SRM

Source SRMSource SRM

CERN Castor CERN DPM    FNAL dCache RAL Castor LBNL SRM

CERN Castor N.A.   N.A.   N.A.   N.A.  

CERN DPM N.A.   N.A.   N.A.   N.A.  

FNAL dCache Failed Ok Ok Failed

RAL Castor N.A.   N.A.   N.A.   N.A.  

LBNL SRM Failed Ok Ok Failed