13
SNS-P2P: A P2P APPROACH FOR THE DATA DELIVERY IN ONLINE SOCIAL NETWORK SYSTEMS Yang Chen

Yang Chen. More and more people are using online SNS to share their photos, news, … Large Amount of data from the SNS site to the end users How

Embed Size (px)

Citation preview

Page 1: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

SNS-P2P: A P2P APPROACH FOR THE DATA DELIVERY IN ONLINE SOCIAL NETWORK SYSTEMS

Yang Chen

Page 2: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

MOTIVATION

More and more people are using online SNS to share their photos, news, …

Large Amount of data from the SNS site to the end users

How to make only SNS more scalable and robust, can fit the growing requirement of capacity

Page 3: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

Single Server CDN

Still has limited capacity

Solution: P2P!

Page 4: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

GOAL

We are going to provide a win-win solution which will benefit both the SNS service provider and the end users. For the service provider

enlarge the scalability of the system a lot. fit the requirement of the fast growing of the

number of users incorporating the users into the content delivery

instead of deploying more and more CDN servers. For the end user, using P2P way,

it can achieve much fast download rate.

Page 5: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

BASIC ARCHITECTURE

Page 6: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

CHALLENGES

Overhead vs Benefit Detailed study

Compatible with existing service Without modifying the current architecture

Incentives Why people would deploy our service?

(Fast downloading, more?) Security/Privacy and Control

Page 7: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

EXPERIMENT PLAN

Basic Insights Study on PlanetLab

Final release and evaluation A new Web browser Add-on based on

Facebook API Large scale real-world deployment

Page 8: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

PEERSON

P2P Arch Focus on

Privacy Direct exchange of

data

We want a solution which can be compatible with current SNSSonja Buchegger, Doris Schiöberg, Le Hung Vu, Anwitaman Datta. PeerSoN: P2P Social Networking - Early Experiences and Insights. In Proceedings of SocialNets 2009, The 2nd Workshop on Social Network Systems, Nuernberg, Germany, March 31, 2009.

Page 9: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

APT-P2P

a peer-to-peer proxy for apt downloads

Using a DHT to track the hosts which have a certain file

Helpful for our design

C. Dale, J. Liu, "apt-p2p: A Peer-to-Peer Distribution System for Software Package Releases and Updates", IEEE INFOCOM, Rio de Janeiro, Brazil, April 19-25, 2009.

Page 10: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

THE WORK I HAVE DONE

Phoenix (Journal) Have a better version than I sent out in

late Dec. Still adjusting a little bit, but almost to ship

it out to IEEE TPDS Pancake

Two-level NC based on Phoenix Submitted to GI’10

Page 11: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

OTHER EXISTING WORKS

Bottleneck Bandwidth Prediction Predict N*N end-to-end bottleneck

bandwidth with O(N) measurements Idea: Similar to NC Collect PlanetLab data for more than 3

months (2009/9-2009/12) and evaluate our idea based on these data sets

Current prediction accuracy is good, but I am still thinking whether there is better way, and what’s the killing applications

Potential reference: Spatio-Temporal Compressive Sensing and Internet Traffic Matrices (SIGCOMM 2009)

Page 12: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

OTHER EXISTING WORKS (CONT.)

NC Implementation Written by Python Has better RTT prediction accuracy than

the widely used Pyxida [by Harvard guys, NSDI’07]

Going to release the package soon and try to involve it in some Linux distribution (or some facebook application)

Page 13: Yang Chen.  More and more people are using online SNS to share their photos, news, …  Large Amount of data from the SNS site to the end users  How

OTHER VERY OLD EXPERIENCE

P2P Streaming Implemented a Python based P2P live streaming

system and deployed it on China Education and Research Network (CERNET)

This software serves CERNET for more than one year and is used by people from more than 100,000 individual IP addresses

BitTorrent Implemented a locality-aware BT tracker and serves

CERNET for one year (fewer users than the P2P streaming system)

Experimental Study on Fairness of BitTorrent