40
8,100 hackers + Your apps = ??? SourceCONF Boston 2014

8,100 hackers + Your apps = ???

Embed Size (px)

DESCRIPTION

There's an asymmetry in the way we approach security today... The threat takes the form of lots of hackers, with lots of different skill-sets and diverse motivations - And the majority of them aren't being paid by the hour to attack your stuff. Contrast this with the paid by the hour consultants and in-house resources. It's not that the good guys aren't smart, it's that the model is fundamentally disadvantaged. Crowdsourcing security testing through bug bounty programs engages a crowd of "good guys who think like bad guys" and economically incentivizes them the same way the bad guys are. Casey likes solving problems. He's the Founder and CEO of Bugcrowd, a company which provides a platform to manage bug bounty programs. He's also an Aussie who has difficulty with words that end with "er".

Citation preview

Page 1: 8,100 hackers + Your apps = ???

8,100 hackers + Your apps = ???SourceCONF Boston 2014

Page 2: 8,100 hackers + Your apps = ???

Why are we here?

Page 3: 8,100 hackers + Your apps = ???

About me@caseyjohnellis

JABAH (Just Another Blonde Aussie Hacker)

Recovering pentester turned solution architect turned entrepreneur

Wife and two kids now living in San Francisco

Founder and CEO of Bugcrowd

Page 4: 8,100 hackers + Your apps = ???

What’s a bug bounty program?

Page 5: 8,100 hackers + Your apps = ???

History

0

125

250

375

500

1995 2000 2005 2010 2015

Page 6: 8,100 hackers + Your apps = ???

It’s not just about being cheap, or loud…

Page 7: 8,100 hackers + Your apps = ???

It’s about levelling the playing field.

Page 8: 8,100 hackers + Your apps = ???

Black/gray hat economics !

Goal: Exploit the bug and keep it alive Resources: Many hackers/skill-sets/motivations/time

Incentive: Paid for results

Page 9: 8,100 hackers + Your apps = ???

White hat economics !

Goal: Find the bug and kill it Resources: Single sets of eyes

Incentive: Paid for effort

Page 10: 8,100 hackers + Your apps = ???

Bug bounty economics !

A white hat goal with black/gray market economics and resourcing.

Page 11: 8,100 hackers + Your apps = ???

Reward pool: $10,000 2 weeks elapsed

CASE STUDY

Wordpress Sprint Bounty + 5 Plugins

$2,500

1st $1,000

2nd $500

3rd $250

All Others

or the remainder divided by number of valid unique

bugs… Which ever is lower)

Page 12: 8,100 hackers + Your apps = ???

CASE STUDY

Wordpress Sprint Bounty + 5 Plugins

349 researchers participated.

243 security submissions from 23 countries.

7 unauth’d to full privilege 0-day vulnerabilities.

Page 13: 8,100 hackers + Your apps = ???

CASE STUDY

Wordpress Sprint Bounty + 5 Plugins

67 rewardable Issues

$142.86 deduplicated cost per issue

16 active security researchers in first hour

8 hours effort in first elapsed hour

Page 14: 8,100 hackers + Your apps = ???

CASE STUDY

Wordpress Sprint Bounty + 5 Plugins

$10,000

5 days of effort in the first 8 hours of the

bounty… Across 349 separate sets of eyes

5 days of effort

VS

Page 15: 8,100 hackers + Your apps = ???

With many eyes all bugs are shallow

- Linus’ Law“

Page 16: 8,100 hackers + Your apps = ???

Really?

Credit: Veracode

GnuTLS goto fail Credit: Veracode Heartbleed

Page 17: 8,100 hackers + Your apps = ???

Linus was (a little bit) wrong.

Page 18: 8,100 hackers + Your apps = ???

Developer Incentive

Make it work.

Page 19: 8,100 hackers + Your apps = ???

Security Incentive

“…but what if nothing happens?”

Page 20: 8,100 hackers + Your apps = ???

Who is doing this well right now?

Page 21: 8,100 hackers + Your apps = ???

With many eyes and the right incentive all bugs are shallow

- Linus’ Amended Law

Page 22: 8,100 hackers + Your apps = ???

Sound familiar?

Page 23: 8,100 hackers + Your apps = ???

Bug bounties repurpose the economics of offense to the defensive side.

Page 24: 8,100 hackers + Your apps = ???

So how do you get more eyes on security bugs?

Cash Soft Incentives Kudos

Swag, challenge coins, points systems,

exclusive opportunities

Hall of Fame, job prospects, contract

prospects, community kudos, general swagger

Page 25: 8,100 hackers + Your apps = ???

Ready to start?

Page 26: 8,100 hackers + Your apps = ???

Bug bounties are awesome…

Page 27: 8,100 hackers + Your apps = ???

…but hard.

Page 28: 8,100 hackers + Your apps = ???

Tips from the trenches

Page 29: 8,100 hackers + Your apps = ???

The mistake *everyone* makes:

!

VULNERABILITY DATA PEOPLE

Page 30: 8,100 hackers + Your apps = ???

The Golden Rule:

Respect the researcher

Page 31: 8,100 hackers + Your apps = ???

If you touch the code, pay the researcher

Page 32: 8,100 hackers + Your apps = ???

Be upfront and clear about what you will and won’t

pay

Page 33: 8,100 hackers + Your apps = ???

Be transparent about duplicate and won’t fix

issues

Page 34: 8,100 hackers + Your apps = ???

Fix quick, pay quick.

Page 35: 8,100 hackers + Your apps = ???

Expect front loading

Page 36: 8,100 hackers + Your apps = ???

Controlled incidents improve your dev team

Page 37: 8,100 hackers + Your apps = ???

Remember that bounty hunting is casual (vs

committed)

Page 38: 8,100 hackers + Your apps = ???

Conclusion• Bug bounties are cost effective, and highly

marketable… but that’s not the full story…

• …this shift in strategy is necessary to address the fundamental asymmetries in the way we do things today.

• Go start one.

• More tips and tricks at https://blog.bugcrowd.com

Page 39: 8,100 hackers + Your apps = ???

Questions?

Page 40: 8,100 hackers + Your apps = ???

@caseyjohnellis

https://bugcrowd.com

[email protected]

!

Greets to Chris, Rob and SourceCONF crew, builditsecure.ly, Rapid7, iamthecavalry.com, @treyford, @k8em0, @codesoda and the

@bugcrowd team.