TeraGrid Arch Meeting RP Update: ORNL/NSTG

TeraGrid Arch MeetingRP Update: ORNL/NSTG

1 ORNL_RP_Update_080801

TeraGrid Arch MeetingRP Update: ORNL/NSTG

August 1, 2008

John W. Cobb

Outline


• NSTG Purpose• SNS Background and Status• Neutron Science Portal• Progress Report on Neutron Science Portal• TeraGrid integration with Neutron Science Portal• NSTG Cluster Operations update

NSTG Purpose


• NSTG = Neutron Science TeraGrid Gateway• Goals. Seek to build/improve

• Bridging: between SNS and TeraGrid• Facility integration (especially large science facilities)• Neutron scattering science focus area

• Instruments/ExperimentsInst/Exp was left out of new IPP, missing WBS areaswere remapped to primarily {HPC-ops, SGW, EOT} areas.

• Close association with Spallation Neutron Source (SNS)• Other interests:

• Other neutron sources (LENS, IPNS, NCNR, ISIS, J-SNS, ANSTO/OPAL, …• Other large experimental user facilities (Diamond, APS, …• Discipline based SW efforts (DANSE, …)• CI software efforts (CIMA, …

SNS Background and Status


•SNS – Spallation Neutron Source (http://neutrons.ornl.gov)• Located in Oak Ridge• Pulsed neutron source: 1.4 MW, 1.4 GeV proton beam onto a mercury target. Up to 24 beam lines. • Construction 1999-2006• Current Operations

• 6 instruments in SNS user program http://neutrons.ornl.gov/instrument_systems/sns_instruments.shtml

• Power ramping up• User days increasing http://neutrons.ornl.gov/proj_status/sns_long_schedule.shtml

• High Flux Isotope Reactor now also part of org. http://neutrons.ornl.gov/hfir/hfir_facilities.shtml

Neutron Science Portal


• Location: http://neutronsr.us/portal• Developed by SNS Software Group (ASG)• SNS-ASG is collaboration contact point for NSTG• SNS ASG highly leverages NSTG effort• NS Portal uses wide mix of back-end CI, including TG

• Instrument local computers• ASG centralized servers and storage• OIC (ORNL’s version of campus clusters)• TG via NSTG• User’s desktops and home machines (portal thick client under development via SBIR with TechX Corp, Buffalo office)

6 Cobb_TeraGrid_SC07

SNS data access via portal(Reduction, analysis, and simulation as well)

Turnkey solutions are being requestedby users and user groups

Problem SNS approach

Providing advanced tools in an easy fashion while retaining customizability

Neutron Science User Portal Totally in Java

Acknowledgement: S. Miller and SNS ASG;J. Kohl, S. Vazhkudai and ORNL/CSM division)

Function deployment order First: Data acquisition

and storage/stewardship

Then: Reduction, analysis, simulation, proposalsfor one-stop access

NS Portal architecture: (stylized)“flows from requirements”


NS Portal Identity Management


• Identity created and maintained by SNS facility• XCAMS – an external implementation of ORNL internal Unified accounts management system• “X” for External

(inadvertent, unfortunate Google search space collisions)• X - lower identity proofing, suitable for user facilities (NIST level 1)• NS portal maps identity (as needed) to access other CI resources using the “Application Manager” subsystem for execution orchestration.• For TeraGrid integration, NS portal invokes “Jimmy Neutron” Community access• Ack: Lynch, Vazhkudai, Kohl, Trater, Miller

NS Portal and TG Community Accounts


• TeraGrid jobs executed in community account• NS Portal application manager archives in DB community user “reach back” according to {SGW,SEC} WG policy• TG Community account use from NS portal

• Installed for:• McStas instrument simulation• Generic (NL2SOL) fitting service

• Future possible installation for:• Distributed data reduction• Others

• Current TG use • Increasing• Still dominated by development experimental use• SU use low, job count higher

• Ack: Lynch, Ren, Kohl, Miller

Progress Report on Neutron Science Portal Use


Ack: S. Miller & SNS ASG

Number of Portal Visits - 2008

300

400

500

600

700

800

900

1000

Jan Feb Mar Apr May Jun Jul

Number of Visits -2008

Total Number of Compute Jobs - 2008

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

Jan Feb Mar Apr May Jun Jul

Nu

mb

er o

f Jo

bs

Total Number ofCompute Jobs - 2008

Total Number of Users - 2008

100

120

140

160

180

200

220

240

260

280

DecJa

nFebM

ar AprM

ay Jun Ju

l

Months - 2008

Nu

mb

er o

f U

sers

Total Number of Users

SNS Facility Data Storage

End User Network Quality of Service (Not TG network)

Within ORNL

At LENS

From Home

From Hotel in Bloomington

Informs decision on portal versus Thick client access

Neutron Science Discipline Science Areas


• Full instrument/experiment simulation studies conducted by E. Farhi (ILL)• Emerging interest by neutron imaging instrument design team (particularly data intensive). CI requirements being solicited• Collaboration on diffused scattering data analysis project to improve software tools

Other NSTG areas


• ESG (with NCAR) working to facilitate ESG data transfer over TG network between ORNL and NCAR (2 important ESG sites)• OSG.

• NSTG cluster available as both TG and OSG resource to demonstrate feasibility.• Motivated by “Should I use TG or OSG” question from a Neutron Scattering software project. A: Either, we support both.• NSTG Status now “green” after a period of red following sys-admin transition

NSTG Cluster Operations Update


• Usage update:• Breckenridge meeting noted that NSTG cluster usage was increasing. Suspected cause was overflow from TG oversubscription.• Recent usage trends by non neutron science related users down• Suspected explanation: TeraGrid resources much larger

• Operations status : still good ( but – we lost /users due to NFS problem 2 weeks ago)• Some system Admin changeover issues still linger - thanks• Ack : Giles

Documents

TeraGrid Arch Meeting RP Update: ORNL/NSTG