Click here to load reader
Upload
balmanme
View
176
Download
1
Embed Size (px)
Citation preview
The Network-Aware Data Management Workshop
held in conjunction withthe IEEE/ACM International Conference for High
Performance Computing, Networking, Storage and Analysis (SC'11)
https://sites.google.com/a/lbl.gov/ndm2011/
WELCOMEThe Network-Aware Data Management
Workshop
Mehmet BalmanLawrence Berkeley National Laboratory
Surendra BynaLawrence Berkeley National Laboratory
https://sites.google.com/a/lbl.gov/ndm2011/
The Network-Aware Data Management Workshop
OpeningMehmet Balman
Lawrence Berkeley National Laboratory
https://sites.google.com/a/lbl.gov/ndm2011/
Scope The amount of data is continuously growing. Managing large amounts of data in a collaborative environment is a real challenge
Questions:– In order to deliver true exascale performance to the
application layer:
• what additional methodologies are necessary for high-bandwidth networks?
– In order to ease the burden on users to configure and tune their applications for high-performance data access over the network:
• how do we enhance data management services and make them network-aware?
Scientific Data Management
Scientific Databases, indexing and data analysis
Storage Resource Management (SRM implementation)
End-to-end resource provisioning
High-speed high-bandwidth networks connecting institutions
Middleware tools to manage scientific data across the world
(fault tolerant and high-performance transfers)
Recent research
Advance network reservation, flexible bandwidth
allocation, scheduling data movement between distributed systems
Efficient use of next-generation high-bandwidth networks for climate sciences
- Use of 100Gbps WAN (Climate 100 demo at booth 512)
Goals of the Workshop
Discuss emerging trends in use of networking for data management
Address novel abstraction techniques for data representation
New methodologies to simplify end-to-end data flow by providing:
Transparent data management services
End-to-end resource coordination
Network-aware tools for the scientific community
And, create new collaboration between network and data management communities
Agenda9:00 - 9:15 Welcome
9:15 - 10:15 Keynote Speech
10:15 - 10:30 Break
10:30 - 12:00 Paper Presentations (session I)
12:00 - 13:00 Lunch Break
13:00 - 14:50 Paper Presentations (session II)
14:50 - 15:15 Break
15:15 - 16:30 Panel Discussion
16:30 - 17:00 Best Paper Announcement
Keynote
Accelerating Data-driven Discovery by Outsourcing the Mundane
Ian Foster
Dr. Ian Foster is Director of the Computation Institute, Professor in the Department of Computer Science at the University of Chicago. He is also a Senior Scientist and Distinguished Fellow at the Argonne National Laboratory. He is well known for the Globus Project, his research and development effort addressing computational and communications problems for collaborative computing.
PapersdFtree - A Fat-tree Routing Algorithm using Dynamic
Allocation of Virtual Lanes to Alleviate Congestion in InfiniBand Networks
(best paper candidate)Presenter: Wei Lin Guay, Simula Research Laboratory, Norway
Predicting Network Throughput for Grid Applications on Network Virtualization Areas
(best paper candidate)Presenter: Chunghan Lee , Toyohashi University of Technology,
Japan
Network-Aware End-to-End Data Throughput OptimizationPresenter: Tevfik Kosar, State University of New York at Buffalo.
Network-aware Data Movement AdvisorPresenter: Patrick Brown, Southern Illinois University
Papers
Scientific Data Movement enabled by the DYNES InstrumentPresenter: Jason Zurawski, Internet 2
CernVM-FS: Delivering Scientific Software to Globally Distributed Computing Resources
Presenter: Jakob Blomer, CERN, Switzerland
A Peer-to-Peer Architecture for Data-Intensive Cycle SharingPresenter: Ian Kelley, Cardiff University, UK
An Architecture for a Data-Intensive ComputerPresenter: Edward Givelberg, Johns Hopkins University
Panel DiscussionData management in exa-scale computing
and terabit networking era
Richard CarlsonDoE Office of Advanced Scientific Computing Research
Ann ChervenakUSC Information Sciences Institute
Daniel S. Katz University of Chicago and Argonne National Laboratory
Dhabaleswar Panda Ohio State University
Brian Tierney ESnet/Lawrence Berkeley National Laboratory
* What research challenges do you expect in exa-scale data management on terabit networks?
* What applications need exa-scale computing and terabit networks?
* What is the scope of data management research on faster network?
* What are the performance problems in next-generation high-bandwidth networks?
* How do applications accommodate next generation networks?
* What are the challenges for middleware developers to adapt exa-scale data management on terabit networks?
* What are the major challenges in network management in terms of provisioning capacity and path, performance monitoring and diagnosis tools?
BEST PAPER AWARD
dFtree - A Fat-tree Routing Algorithm using Dynamic Allocation of Virtual Lanes to Alleviate Congestion in InfiniBand Networks
Presenter: Wei Lin Guay, Simula Research
Laboratory, Norway
BEST PAPER HONORABLE MENTION Predicting Network Throughput for Grid Applications on Network Virtualization Areas
Presenter: Chunghan Lee , Toyohashi University of Technology, Japan
THANK YOUThe Network-Aware Data Management
Workshop
Mehmet BalmanLawrence Berkeley National Laboratory
Surendra BynaLawrence Berkeley National Laboratory
https://sites.google.com/a/lbl.gov/ndm2011/
The Network-Aware Data Management Workshop
held in conjunction withthe IEEE/ACM International Conference for High
Performance Computing, Networking, Storage and Analysis (SC'11)
https://sites.google.com/a/lbl.gov/ndm2011/