16
globus online Globus Online: A Hosted Data Transfer Solution Rachana Ananthakrishnan Computation Institute Argonne National Laboratory & University of Chicago

globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

  • Upload
    others

  • View
    14

  • Download
    0

Embed Size (px)

Citation preview

Page 1: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

globus online

Globus Online: A Hosted Data Transfer SolutionRachana AnanthakrishnanComputation InstituteArgonne National Laboratory & University of Chicago

Page 2: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Globus Toolkit Globus OnlineUse the Grid

Reliable file transfer Software-as-a-Service

globusonline.org

Build the Grid

Components for building custom grid solutions

globustoolkit.org2

Page 3: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

GridFTP

• Protocol:– High-performance, secure data transfer protocol optimized for

high-bandwidth wide-area networks

• Implementation:– Globus Toolkit GridFTP provides a fast, secure, extensible,

standard and robust

Created by Tim Pinkawa (Northern Illinois University) using MaxMind's GeoIP technology

Page 4: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

A B

Discover endpoints, determine available protocols, negotiate firewalls, configure software, manage space, determine required credentials, configure protocols, detect and respond to

failures, determine expected performance, determine actual performance, identify diagnose and correct network misconfigurations, integrate with file systems, …

Data Movement Challenges

4

Page 5: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Globus Toolkit Globus OnlineUse the Grid

Reliable file transfer Software-as-a-Service

globusonline.org

Build the Grid

Components for building custom grid solutions

globustoolkit.org5

Page 6: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Globus Online highlights

6

Fire-and-forget data movementThird-party transfers & downloadsReliability and fault recoveryPerformance optimizationAcross multiple security domainsExpert operations and support

Web interface

Command line interfacels alcf#dtn:~scp alcf#dtn:~/myfile \

nersc#dtn:~/myfile

HTTP REST interfacePOST https://transfer.api.globusonline.org/ v0.10/transfer <transfer-doc>

GridFTP serversFTP servers

High-performancedata transfer nodes

Globus Connecton local computers

Page 7: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Salient Features

7

• Endpoint Management– Public endpoints with logical names

– Default credential service

• Transfer Management– Recursive transfers

– Levels of synchronization

– Monitoring and notification

Page 8: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Sign-up and Sign-in

8

Page 9: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

9

Select Endpoints

Page 10: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Start Transfer

10

Page 11: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Globus Connect to/from your laptop

11

No privileged account requirementWorks behind firewalls No external host certificate needed Single user server

Page 12: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Monitor

12

Page 13: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Globus Online CLI 2.0

13

Page 14: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

ESG Gateway Integration (GO REST API)

14

Work done by Neill Miller with support from NCAR team and

Argonne team

Page 15: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

• Production release with ESG Gateway• Integration with other ESGF tools• GO Transfer Features:

– HTTP protocol support– GridFTP native installers

• GO Login Features– Shibboleth Login (InCommon Federation)– OAuth based delegation

• GO for data sharing

What’s next?

15

Page 16: globus online - National Oceanic and Atmospheric ...€¦ · Globus Toolkit. Globus Online. Use the Grid. Reliable file transfer Software-as-a-Service. globusonline.org. Build the

Thank You

16

• Demo of Globus Online in the afternoon session• Try Globus Online: www.globusonline.org• GO Support: [email protected]• Contact: [email protected]