7
Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration Integrated approach for distributed application(not layered, component-based) Take networks into account(DCN) Compute resources Storage, Graphics Goal: build distributed applications that have better performance, increased capacity over non- distributed. Provide a path for future scaling

Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1

Introduction

● Grid & Visualization research @ CCT/LSU

● Enlightened project, vertical integration

● Integrated approach for distributed application(not layered, component-based)

● Take networks into account(DCN)● Compute resources● Storage, Graphics

● Goal: build distributed applications that have better performance, increased capacity over non-distributed. Provide a path for future scaling

Page 2: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 2

Application

● Distributed volume rendering/large data

● Improved I/O(distributed + networks faster than local)

● Increased rendering capacity + HQ video & interaction

Page 3: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 3

Scheduling requirements

● Application-centric view of system. Want to optimize applications, not system. System will also benefit

● Coordinated scheduling of network and other resources(compute, storage, ..)

● Atomic allocation of multiple resources at the same time(needed for interactive application)

● Need to allocate multiple network links(switched network – multiple data servers, video streaming, multiple users)

Page 4: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 4

Scheduling requirements

● Guaranteed, dedicated in-advance reservation for a given time period. Guaranteed topology desired

● Open to fair policies of handling priorities● Application optimized for DCN

● will not work on regular networks● good enough quality of video for remote

visualization● remote I/O faster than local using aggressive

UDP

Page 5: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 5

Information service requirements

● Timetable for availability of resources(allocating multiple resources)

● Bandwidth, latency of circuits for time period T(tuning of transport protocols)

● Topology information(used for network flow optimization of data transfer, overlay multicast)

● Information about connected resources(compute, graphics)

Page 6: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 6

Information service requirements

● Using all the info, application-level optimization of resource selection

● maximize data size while● Keeping the visualization system interactive(minimum

5fps)● High resolution(at least 1 megapixel)● Multiple remote users(collaborative visualization using

video)● low response time● >5Gbps I/O rate● HQ video(no artifacts, low latency)

Page 7: Introduction - Internet2 · Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 1 Introduction Grid & Visualization research @ CCT/LSU Enlightened project, vertical integration

Andrei Hutanu Internet2 Panel – Applications use of DCN / Page 7

Is application middleware?

● Ideally it should be/use middleware, not quite there yet, quite far actually. Need testbed

● Scenario● User describes priorities for one or more visualization

session parameters: data size, resolution, frame rate, interactiveness(latency), responsiveness(data I/O), start time. Can also have templates.

● Application, using information about DCN and other resources computes and optimizes a set of options with associated parameters, user selects

● Application uses middleware to allocate all required resources