Lars Kurth Community Manager, Xen Project

Chairman, Xen Project Advisory Board

lars_kurth

Diamond Sponsor Silver Sponsor

Xen & KVM Hackathon

Tue 14:00 – 18:00Virginia Room, 4th floor, Union Street Tower

Joint Xen & KVM Social Event

Tue 18:30 – 21:00Shuttle Bus Stop: Union St side @ Sheraton

Garage Billiards1130 Broadway Seattle, WA 98122(15 min walk, maps are available at registration)

Discussion GroupsLead to take notes (or nominate someone to do so) and post to xen-devel@

Free slots: Come to me or use stickers

Lunch is not provided

Lots of venues nearbyMaps are available at the event registration desk

Developer Meeting

Wed 10:00 – 13:30Lunch providedSeneca, 4th floor, Union Street Tower

Sign up via wiki.xenproject.org/wiki/Developer_Meeting/Aug2015Or come and see me

Subprojects (retired, new, established)Project InitiativesStatistics

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Hypervisor Developer list traffic : Q3 2003 - now

Hypervisor team / subproject : hypervisor and tools

XAPI toolstack (used in XenServer)

PVOPS (Xen enabled Linux) Linux Kernel Dev.

XenServer.orgXCP

BSD’s, Grub, QEMU, FreeRTOS, …

Xen on ARM PV Xen on ARM non-PV

Embedded & Auto

Windows PV

Mirage OS

Libvirt, CentOS, …

AGL, Android, …

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

Hypervisor Developer list traffic : Q3 2003 - now

Hypervisor team / subproject : hypervisor and tools

XAPI toolstack (used in XenServer)

PVOPS (Xen enabled Linux) Linux Kernel Dev.

Xen on ARM non-PV

Embedded & Auto

Windows PV

Mirage OS

PVOPS & Xen on

ARM are complete

(achieved their goals)

In incubation

Mirage OS fulfills criteria for graduation

(no formal review has been conducted)

Xen on ARM PV

1 Rack at EarthLink in Marlborough, MA

More than 4 times test capacityTesting against Linux, BSDs & up/downstreams24 test machines, planning to expand with another rack

Automated performance testingEarly stages

We do have a lot more test contributions

Xen Project Rack

0

300

600

900

1200

2003 - 2012 2013 2014 2015

(Goal: group A alongside KVM)

the people/companies who drove this

Xen Project Test Lab

Lead: Ian JacksonTop Test Contributors: Ian Campbell, Wei Liu, Dario Faggioli, Roger Pau Monne, Longtao Pang, Anthony Perard

Xen Project – OpenStack CI Loop

Lead: Bob BallTeam: Anthony Perard, Antony Messerli, Jim Fehlig, Stefano Stabellini, Konrad WilkSpecial Thanks: Rackspace for donating significant hosting capacity to get this project started

0

50

100

150

200

250

2010 2011 2012 2013 2014 2015*

Developers

Employers

0

2000

4000

6000

8000

10000

12000

14000

2010 2011 2012 2013 2014 2015

CommitsContributors

*) Up to Aug 11th

24%

23%

51%

2%

Hypervisor

XAPI

Mirage OS

Win PV Drivers

Contribution Statistics(Up to Aug 11th, 2015)

DiversityProject Operations

0

500

1000

1500

2000

2500

3000

2011 2012 2013 2014 2015

Projection

Commits

Fairly stable

over the last

few years.

(contributions > 1%)

88%

1% 11%

Citrix

Suse

Linaro

Oracle

Intel

Verizon

Fujitsu

Cavium

Analog Devices

AMD

Zentific

NSA

Xilinx

Novetta

BitDefender

Other

49%

18%

8%

4%

3%

2%

1%

1%1%

1% 12%

Citrix

Suse

Linaro

Oracle

Intel

Verizon

Fujitsu

Cavium

Analog Devices

AMD

Zentific

NSA

Xilinx

Novetta

BitDefender

Other

(contributions > 1%, 2015 to Aug 11th)

2014

64%

13%

4%

4%

5%

2% 1%

4%

2015

0

5

10

15

20

25

30

35

40

2010 2011 2012 2013 2014 2015 2016

4.0 4.1 4.2 4.3 4.4 4.5

Xen 4.x Number of New Major Features

4.6

Releases Process From Soft to Hard Freeze – created some stress and pain

Security Process Allow Service Providers to Upgrade During embargoPre-disclosure list applicationMechanism for pre-disclosure members to collaborate

Contributor Training New influx of developers from China (access to Xen Project resources)Gave training in Shanghai, Nanjing and Hangzhou

Focus on Designs for complex featuresWorked generally very wellSome issues around sign-off by all stake-holders and ensuring designs are up-to-date

Formalizing Feature Maturity Lifecycle Proposal at lists.xenproject.org/archives/html/xen-devel/2015-06/msg01992.htmlImportant, because “supported features” have to be handled by security@

Started seeing issues Last YearHow are we doing Today?What Next?

(Stats up to Aug 11th, 2015)

0.00%

5.00%

10.00%

15.00%

20.00%

25.00%

30.00%

35.00%

40.00%

45.00%

50.00%

Up to 1 week 1 to 2 weeks 2 to 3 weeks 3 to 6 weeks 6 to 13 weeks 13 to 52 weeks More than 1year

July 2013 - Jan 2014

Feb 2014 - Aug 2014

Jan 2015 - Jul 2015

In 2015,

committed 1-4 year

old patches

0

10

20

30

40

50

60

2012 2013 2014 2015

<1% of reviews

1-5% of reviews

>5% of reviews

0

5000

10000

15000

20000

25000

30000

35000

2004 - 2010 2011 2012 2013 2014 2015

Replies to Patches est.

Patches Posted est.

Replies to Patches

Patches Posted

This reflects

a huge growth

jump in 1 year

While the

number of reviewers

has remained fixed

Aug 11thOn average

2.1 replies per patch

per patch revision

0

1

2

3

4

5

2012 2013 2014 2015

Qemu

Xen

Patches posted & re-posted

(without review comments)

divided by patches gone into xen.git

Increasing number of contributions

Not enough review capacity to support growth; we know that review capacity has remained stable

Increasing back-log (aka ongoing reviews on xendevel@)

Increasing number of review cycles per patch/patch set

Note: we know that the average number of review comments per patch version is stable

More disagreements amongst maintainers, reviewers & contributorsLower quality contributions, requiring more review cyclesMore complex contributions, requiring more review cyclesIncreasing standards required to get code up-streamed (aka quality)

Should be able to see patterns in review data

A combination of all/some of the above

We have an issue, but we do not understand exactly whereThe 4 weeks before the 4.6 code freeze was the most stressful freeze in yearsThe Advisory Board is funding development of analysis tools for our review processInsufficient research on what is normal/optimal

If you are planning larger contributions You may want to help out with code reviews elsewhere

If you are planning to consistently contribute over several yearsYou may want to work towards ”building” Xen maintainersBUT: this is no short term fix

Buying timeWe may be able to buy us time through process changesDiscussion: search for “[xen 4.6 retrospective]” on xen-devel@BoF: Xen 4.6 Retrospective Surgery & Developer Meeting

Events, Social Media, Press Coverage Security Vulnerability Coverage

Average monthly web visitsgrew by 37%

Social Media following

grew by 92%

0

200

400

600

800

1000

1200

1400

Q1 '13 Q2' 13 Q3' 13 Q4' 13 Q1 '14 Q2 '14 Q3 '14 Q4' 14 Q1' 15 Q2' 15

Security stories are “hot”

Xen is widely used, thus security stories “sell”

It’s too easy for reporters to write a story

Reporters just have to check our page,

and know when the next story comes

Pro-active coverage of Xen stories (besides releases)

We discuss PR on publicity@lists.xenproject.org(for our blog and elsewhere)

Sign up via lists.xenproject.org

Open to all community members

Avoid accidental creation of a damaging news story

New MembersPlease welcome Alibaba / Aliyun

Changes in FocusFrom Operational/Reactive to StrategicCommunity Support

Images used in this presentation are from

– Lars Kurth

– Xen Project and other Screen Shots

– 123RF.com & Shutterstock.com

– Peter Dedina @ flickr (page 17)

– Wajahat Mahmood @ flickr (page 33)