16
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Embed Size (px)

Citation preview

Page 1: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

BOINC: Progress and Plans

David P. Anderson

Space Sciences LabUniversity of California, Berkeley

BOINC:FASTAugust 2013

Page 2: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Computing resources

PCslaptops

mobile devicesappliances

Consumer

desktop data center

Organizational

volunteer computing

desktopgridcomputing

cluster,cloud,Grid,supercomputing

BOINC

Page 3: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Why volunteer computing?

Consumer > 1 billion PCs

most w/GPU > 2 billion mobile devices Low cost to scientists

Organizational ~10 million

cluster/cloud nodes High cost

Page 4: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Volunteer computing status

Volunteers: 400K people, 600K computers > 15 PetaFLOPS, many million jobs/day > 50 science projects, e.g.

IBM World Community Grid CERN@home Einstein@home Climateprediction.net Folding@home

Page 5: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Capacity in 5 years

Participation: 50M devices? Processing

CPU: 50M * 1 TFLOPS = 50 ExaFLOPS GPU: 50M * 20 TFLOPS = 1000 ExaFLOPS

Storage: 50M * 10 TB = 500 ExaBytes

Network bandwidth 50M * 100Mbps = 5 Petabit/sec

Page 6: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

My talk

VM-based applications Remote job submission BOINC on Android Volunteer storage

Page 7: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Using VM technology

Consumer platforms: 85% Windows 7% Linux 7% Mac OS X

Developing/maintaining versions for different platforms is hard

Even making a portable Linux executable is hard

Page 8: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

BOINC VM-based applications

You supply: A VM image for your favorite environment

can use the same one for many apps An executable for that environment An XML configuration file

BOINC supplies: The VBox Wrapper

Page 9: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

How it works on the client

BOINCclient

VirtualBoxexecutive

Vboxwrapper

VM instanceshared directory:executableinput, output files

VirtualBox “snapshots” provide checkpointing

Page 10: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Remote job submission

scienceportalor PC

BOINCserver

Scientists(users)

sysadmins

job submission

file management

Page 11: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Managing multiple users

User access control User quotas Sharing limited processing resources

handle small batches first don’t starve large batches enforce user quotas long-term

Page 12: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

BOINC on Android

Available in Google, Amazon app stores 7 projects have Android/ARM apps Battery, WiFi considerations

GUI(Java)

BOINCclient

(native)

RPCapps

(native)

Page 13: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

BOINC storage architecture

Data archivalApplications

Locality scheduling

Dataset storage

BOINC storageinfrastructure

Result archival

Page 14: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Storage-related features

Client: allocating space among projects Client: support for large (multi-GB) files

efficient transfer, verification, copying Scheduler: storage policy plug-ins Example: volunteer data archival

multi-level erasure coding

Page 15: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Research opportunities

Many job scheduling issues Big-data issues Simulation tools

client emulator server emulator (Simba) storage emulator

Page 16: BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013

Thank you

Please contact me to discuss BOINC or research collaboration:

[email protected]