Embed Size (px)
Citation preview
User Support, Campus Integration, OSG XSEDERob GardnerOSG Council MeetingJune 25, 2015
149. Present to Council 1 page document on "Enabling Campus Resource Sharingand use of remote OSG resources in 15 minutes - Rob Gardner, Frank
Enabling Campus Sharing & Use of OSG
● Clemson helping drive this development● Two track strategy to integrate Palmetto
resource and user community○ Track 1: “light, quick”
■ Sumit from Palmetto to OSG, and back■ “Quick Connect” → OSG Connect to Palmetto via
hosted Bosco service (ssh)○ Track 2: “full OSG capabilities”
■ Full HT Condor CE, OASIS+Squid, {StashCache}Working document: goo.gl/9aNkJs
Track 1: OSG Connect to Clemson-Palmetto
● Hosted service @ OSG Connect● Addressed OrangeFS + Condor file locking
Current opp limit on PalmettoCapped at 500 jobs due to PBS Pro limitation that prevents Clemson users in the general pool from (non-owners) preempting OSG users. Expect a fix in next release of PBS Pro so that OSG jobs can claim additional idle cycles on Palmetto
submitted from login.osgconnect.net
Track 1: Submit from Clemson-Palmetto
● Download Campus Connect client from github● Minutes to submission to OSG
Campus Connect Client● lightweight module to
manage submission from a campus login host
● heavy lifting done at hosted schedd
● In Year 4, extend to reach, monitor, and account:○ local campus allocation○ XD allocation○ Full integration with
campus IDM & signupEvaluating at:
Longer term: Hosted Campus CE-ssh● Discussions to establish approach for hosted
CE services on behalf of campuses short of manpower
● Quick(er) on-ramp of a campus HPC cluster without requiring local OSG expertise
● @ the campus: provide ssh access, local accounts for supported VOs
● Normal CE operations handled by OSG staff● Possible “umbrella CE” for small campuses
152. Pay attention to "Sound Bites" that communicate the scale and reach ofOSG to outside agencies/projects - Rob G, Bo, Clemmie
Open Science Grid: HTC supercomputer
● 2014 stats○ 67% size of XD, 35% BlueWaters○ 2.5 Million CPU hours/day○ 800M hours/year○ 125M/y provided opportunistic
● >1 petabyte data xfer/day● 50+ research groups● thousands of users● XD service provider for XSEDE
Rudi EigenmannProgram Director Division of
Advanced Cyberinfrastructure (ACI)NSF CISE
CASC Meeting, April 1, 2015
Lowering barriers to usability
OSG as a campus research computing cluster
★ Login host★ Job scheduler★ Software (modules)★ Storage★ Tools
Software & tools on the OSG
● Distributed software file system● Special module command
○ identical software on all clusters
● Common tools & libs● Curate on demand
continuously● HTC apps in XSEDE
campus bridging yum repo
$ switchmodules oasis
$ module avail
$ module load R
$ module load namd
$ module purge
$ switchmodules local
http://goo.gl/TlLq1M
Modules now used at most sites
All software accesses by module are monitoredcentrally for support purposes
User Tools
● $ tutorial ● $ connect
○ on login.osgconnect.net, on campus, or laptop● $ module (software, all OASIS enabled sites)● $ stash-cp (Stash to job, in development)
Education and Training assets
● Helpdesk with community forum and knowledge base
● github seen as strategy for formal management of user documentation○ Markdown tutorials → same place as code○ tutorial write-ups track code samples closely○ auto html and upload to help desk (in seconds)
● Expect to announce helpdesk support.opensciencegrid.org this week
Code and Markdown managed in Github
Content indexed, searchable
User sees personal history of supportrequests to OSG.. and can drill down to see full interaction history. Staff can make private notes, or link to a Jira issue for technical support tracking.
Of course, all available via email: [email protected]
Can DM tweet to @osgusers which generates a ticket
Uber-like feedback is collected(except we don’t rate users :)
● Software Carpentry includes a section on scientific programming using Python. IPython Notebook is used for instruction.
● SWC typically asks users to install IPython on laptops; this is a top source of delays and confusion.
● In our DHTC edition of SWC, we already have a multiuser server with login accounts that users retain indefinitely.
● Idea: use this framework to provide a shared IPython, establishing a common baseline for the toolchain.
IPython Notebooks
IPython Notebook Service
Developed a platform to launch per-user IPython Notebook servers:
➥
1. User visits http://ipython.osgconnect.net and logs in.
IPython Notebook Service
2. Server launches pre-configured IPython Docker container. Docker provides user and data isolation. Containers can be shut down and re-instantiated on demand.
3. Within moments, a newly provisioned IPython instance is available. Notebook storage is persistent and accessible via login.osgconnect.net.
Education and Training activities● Working with Tim Cartwright and Lauren Michael (ACI-REF)
to support 2015 OSG User School● UChicago-Northwestern roundtable (postponed to “Fall”)● OSG-SWC @ Duke, October 26-29 (tentative dates)
Joint Software Carpentry & Open Science Grid Workshop at Duke University
Distributed high throughput computation is concerned with using many computing resources potentially spread over large geographic distances and shared between organizations. These could be university research computing clusters, national leadership class HPC facilities, or public cloud resources. Incorporating these into science workflows can dramatically benefit your research program. However, to get the most of these systems requires some knowledge and skill in scientific computation. This workshop extends basic instruction on Linux programming from the Software Carpentry series with concepts and exercises on distributed high throughput computation. Participants will use resources of the Scalable Computing Support Center as well as the Open Science Grid, a national supercomputing-scale high throughput computing facility. There will be experts on hand to answer questions about distributed high throughput computing and whether it is a good fit for your science.
Other Campus Outreach Events
● Internet2 Technology Exchange, October 4-7, Cleveland (formal decision next week)○ Distributed High Throughput Computation: a Campus
Roundtable Discussion (Research Track)● Rocky Mountain Advanced Computing
Consortium, HPC Symposium (Aug 11-13, Boulder)○ 30 minute slot shared with XSEDE
● XSEDE15, CLUSTER15 (Campus Bridging)
OSG as XD Provider to XSEDE
OSG XD - Last 12 monthsProject Name PI Institution Field of Science Allocation Wall Hours
TG-IBN130001 Donald Krieger University of Pittsburgh Biological Sciences Research 54,881,313
TG-CHE140110 John Stubbs University of New England Chemistry Research 1,047,897
TG-DMR130036 Emanuel Gull University of Michigan Materials Science Research 563,106
TG-PHY120014 Qaisar Shafi University of Delaware Physics and astronomy Research 309,036
TG-CHE140098 Paul Siders University of Minnesota; Duluth Chemistry Research 88,047
TG-CHE130091 Paul Siders University of Minnesota; Duluth Chemistry Startup 58,086
TG-MCB140160 David Rhee Albert Einstein College of Medicine Molecular and Structural Biosciences Startup 39,517
TG-AST140088 Francis Halzen University of Wisconsin-Madison High Energy Physics Startup 30,850
TG-CHE140094 John Stubbs University of New England Chemistry Startup 27,057
TG-OCE130029 Yvonne Chan University of Hawaii; Manoa Ocean Sciences Startup 22,007
TG-IRI130016 Joseph Cohen University of Massachusetts; Boston Information Robotics and Intelligent Systems Startup 20,401
TG-DMR140072 Adrian Del Maestro University of Vermont Materials Science Startup 20,179
TG-OCE140013 Yvonne Chan University of Hawaii; Manoa Ocean Sciences Research 19,861
TG-AST150012 Gregory Snyder Space Telescope Science Institute Mathematical Sciences Startup 18,099
TG-MCB090163 Michael Hagan Brandeis University Molecular and Structural Biosciences Research 10,676
TG-DEB140008 Robert Toonen University of Hawaii; Manoa Biological Sciences Startup 4,147
TG-TRA130011 John Chrispell Indiana University of Pennsylvania Other Campus Champions 1,578
TG-MCB140232 Alan Chen SUNY at Albany Molecular Biosciences Startup 598
TG-SEE140006 Sheila Kannappan University of North Carolina; Chapel Hill Physics and astronomy Educational 46
TG-CDA100013 Mark Reed University of North Carolina; Chapel Hill Mathematical Sciences Campus Champions 6
TG-CCR120041 Luca Clementi San Diego Supercomputer Center Computer and Information Science and Engineering Startup 1
Total 57,162,509
OSG XD: June XRAC Meeting (Nashville)● OSG pledges 2M CPU-hours (SUs) per quarter● There were 199 requests for XSEDE resources, mostly for
Stampede and Comet● There were no requests for OSG resources● Post meeting, following granted:
○ 50k SU to Kettimuthu/ANL (CS: workflow modeling)○ 100k SU to Qin/Spellman (class on gene networks)○ 1.39M SU to Gull/UMich (PHYS: condensed matter)
● Many NAMD requests○ → start a MD-HTC activity with ACI-REF?
Conclusions & Outlook● “Clemson on the air”
○ Local submit to OSG validated at scale of 1500 jobs○ Joint use of campus and OSG resources in same work
environment■ Model for other campuses, ACI-REF as channel
○ Quick Connect to share resources is functional● HTC training materials now formally managed● Helping users via XSEDE
○ plan detailed studies of common application scaling properties & potential conversion to HTC workflow
