7
Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future plans

Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Embed Size (px)

Citation preview

Page 1: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 1

WP7Budapest

Collaboration with Dante

Monitoring & R-GMA

GridFTP Logging

Network Cost Function

MapCenter & TopoGRID

Future plans

Page 2: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 2

Close collaboration with DANTE

• DANTE expects stress traffic from experiments and performances cross-analysis with EDG

• Since July, WP7 has PCs in 3 POPs of Geant to test purpose :

• Network QOS : Scavenger (QBSS), IP Premium• Bulk Transfers

Page 3: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 3

Monitoring & R-GMA

Tools deployed on one node o f each testbed site, accessible by Web browser

Edg-pinger, edg-iperf & edg-udpmom

Publication of network metrics in MDS is done in release1.2

Tests ongoing on publishing metrics in R-GMA (TB2)

Producer and Consumer has been set-up, Archiver is the next step

Page 4: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 4

GridFTP logging

• Get actual end-to-end network transfers performances• Logging of all file transfers (on RB, CE, SE)

• UI-RB• RB-CE• CE-SE (data access)• SE-SE (data replication)

• Publication of metrics• in MDS in release 1.3• R-GMA in release 2

• Will be used by network cost function

Page 5: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 5

Network Cost Function

• Function used by Resources brokers and Replica Managers to optimize grid resources usage

getNetworkCosts(SE1, SE2, size) = time (and confidence level)Used by GetAccessCost (RB) and GetBestFile (WN) of

WP2

• Already delivered to WP2 and testedClose collaboration on-going

• Currently compute from TCP throughput measurement (iperf), and also from GridFTP logging for next release

Page 6: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 6

MapCenter & TopoGRID (ccwp7.in2p3.fr)

MapCenter• New automatic version• Queries each night from MDS/RB• DataTAG, LBONE

TopoGRID• Compute from traceroutes• Static & automatic version

Page 7: Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future

Franck Bonnassieux- WP7- n° 7

WP7 Future Plan

• End Of September• GridFTP logging

• End of October• NetworkCost Function improvements (robustness and gridFTP logging usage)• End of RGMA Testing

• End of December • All network metrics (GridFTP included) in R-GMA.

• First quarter of 2003• NetworkCost from R-GMA• Large usage of R-GMA possibilities (MapCenter, flows matrix…)