Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison

Ways to Connect to OSGTuesday afternoon, 3:00 pm

Lauren Michael <[email protected]>Research Computing Facilitator

University of Wisconsin-Madison

2015 OSG User School

Overview

• Types of OSG submit points

• OSG Virtual Organizations(members of OSG consortium)

• Other OSG submit pointsOSG ConnectOSG Connect ClientOSG via XSEDE

2


Overview




3


HTC Submit Point

Submit Node

HTCondor Pool

(or other type of Cluster)


HTC Submit Point

Submit Node

HTCondor Pool


osg-ss-submit


OSG Submit Points

6

OSG(>120 sites)

Submit Node

HTCondor Pool

(or other Cluster)

OSG entry point

specific to VO


OSG Submit Points

7

OSG(>120 sites)

Submit Node

HTCondor Pool

(or other Cluster)

Submit Node

OSG entry point


OSG Submit Points

8

OSG(>120 sites)

Submit Node

HTCondor Pool

(or other Cluster)

Submit Node

OSG entry point

osg-ss-glidein-submit


OSG Submit Points

9

OSG(>120 sites)

Submit Node

HTCondor Pool

(or other Cluster)

Submit Node

OSG entry point


Accessing an OSG Submit Point – 4 Ways

• Local Virtual Organization (VO) campus, national lab, or research organization that is

part of the OSG consortium

• OSG Connect an OSG VO for individuals without a local VO

OSG Connect Client use another cluster submit/head node as an OSG

submit point

• XSEDE collection of HPC clusters available to U.S. academics

via allocations of compute hours

10


OSG entry point

Access Methods: Local VO

11

OSG(>120 sites)

Submit Node

HTCondor Pool

Submit Node


HTCondor Pool


OSG entry point

Other Access Methods:

12

OSG(>120 sites)

Submit Node

Submit Node

OSGConnectXSEDE

ConnectClient


*not all XSEDE Campus Champions will have experience with HTC or OSG


13

Local VO OSG Connect Connect Client XSEDE

Available tousers with a

campus/org VOaffiliates of U.S. research orgs

users of cluster with Connect Client

users with XSEDE allocation

Cost unlikely FREE unlikelyNO

(but need allocation)

Limit on CPU hrs

unlikely NO NOYES

(per allocation)

Local Helpvery likely (local staff)

unlikelypossibly

(cluster staff)possibly*

(Campus Champion)

Online Guides likely YES YES limited

Submit Point Type

submit server(or direct OSG entry server)

direct OSG entry server

cluster submit node to OSG entry server

submit node to OSG entry server



• Local Virtual Organization (VO) campus, national lab, or research organization

that is part of the OSG consortium

• OSG Connect an OSG VO for individuals without local OSG support

OSG Connect Client use another cluster submit server as a submit point



14


Virtual Organization (VO)

• institution or research project that is part of the OSG consortium

• accounts and access determined by local VO administrators

• most offer user support or specialized interfaces for their specific setup and population of users

How do I determine whether my organization is/has a VO?

15


… to the real world

16



17



18

2015 OSG User School 19


Using OSG through a VO

1. Determine whether there is a local VO for your institution/organization.

2. Get an accountContact the administrators to get an account on their glidein server (or submit node tied to a glidein server).

3. Submit jobsFollow site-specific guides and/or submit jobs as you have been at the OSG School.

20









21


OSG Connect

22

• Essentially, a VO available to those without a Local VO

• Free for affiliates/partners of U.S. research institutions

• Submit from OSG Connect server or use Connect Client on another cluster

• OSG ConnectBook has online guide information and contact info for help



Details and hands-on exercises after this

coming next!







• XSEDE collection of HPC clusters available to U.S.

academics via allocations of compute hours

25


OSG via

26

• XSEDE: a consortium of HPC clusters and other computational services available to academics in the U.S.

• free accounts, but you must request an XSEDE allocation of compute hours

• limited online guides specific to OSG-XSEDE, but similar to submission via osg-ss-glidein-submit


Using OSG via

27

1. Sign up for an XSEDE account.

2. Request an OSG allocationvia the XSEDE User Portal to request a startup (or long-term) allocation of compute hours for OSG.

3. Follow XSEDE’s guides for connecting to and using the OSG submit server.

4. Submit jobs as you have been at the school, making sure to indicate your XSEDE project name (allocation code).




29



30


Overview




31


Questions?

• Feel free to contact me: [email protected]

• Next: OSG Connect and Connect Client 3:30-4:00pm, Intro by David

• Then: 4:00pm-5:00pm, Using OSG Connect and

Connect Client (hands-on) End, Day 2

32

Documents

Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison