47
Pixelating Geo- Diversity David Rodriguez, Jingchuan Chen, Dhia Mahjoub

Pixelating Geo- Diversity - HITB

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Pixelating Geo- Diversity - HITB

Pixelating Geo-DiversityDavid Rodriguez, Jingchuan Chen, Dhia Mahjoub

Page 2: Pixelating Geo- Diversity - HITB

Before we start:https://github.com/DavidRdgz/hitbsec-notebook

Page 3: Pixelating Geo- Diversity - HITB

Why us:● We are maintaining a domain risk-score API used by our customers

● Last year we’ve been deploying tensorflow models into production

● GLMs

● Convolutional Neural Networks

● 500 Jobs a day in Complex Workflows (Hadoop Based)

Page 4: Pixelating Geo- Diversity - HITB

Section 1Introduce Requester Geo-Popularity Data

Section 2Introduce Exponential Moving Averages (EMAs)

Section 3Convolutional Neural Networks

Page 5: Pixelating Geo- Diversity - HITB

Section 1Introduce Requester Geo-Popularity Data

+ Intuitions for modeling requests

+ Modeling requests at scale

Page 6: Pixelating Geo- Diversity - HITB

Countries+Requests

Page 7: Pixelating Geo- Diversity - HITB

USNGDEUA

Carding sites

Page 8: Pixelating Geo- Diversity - HITB

US, IT, GB, CA, UA, NG, RUAltcoins sites

Page 9: Pixelating Geo- Diversity - HITB
Page 10: Pixelating Geo- Diversity - HITB
Page 11: Pixelating Geo- Diversity - HITB
Page 12: Pixelating Geo- Diversity - HITB
Page 13: Pixelating Geo- Diversity - HITB

Countries+Counts

Page 14: Pixelating Geo- Diversity - HITB
Page 15: Pixelating Geo- Diversity - HITB
Page 16: Pixelating Geo- Diversity - HITB

Counts+Time

Page 17: Pixelating Geo- Diversity - HITB

Section 2Introduce Exponential Moving Averages (EMAs)

Page 18: Pixelating Geo- Diversity - HITB
Page 19: Pixelating Geo- Diversity - HITB
Page 20: Pixelating Geo- Diversity - HITB
Page 21: Pixelating Geo- Diversity - HITB
Page 22: Pixelating Geo- Diversity - HITB
Page 23: Pixelating Geo- Diversity - HITB

Current

Page 24: Pixelating Geo- Diversity - HITB

The Max

Page 25: Pixelating Geo- Diversity - HITB

3 Day Avg

Page 26: Pixelating Geo- Diversity - HITB

6 Day Avg

Page 27: Pixelating Geo- Diversity - HITB
Page 28: Pixelating Geo- Diversity - HITB
Page 29: Pixelating Geo- Diversity - HITB

Optional

Exponential Moving Average

Page 30: Pixelating Geo- Diversity - HITB

ConvolutionalNetworks

Page 31: Pixelating Geo- Diversity - HITB

Section 2

+ Why these models?

+ Inputs and Layers

Convolutional Neural Networks

Page 32: Pixelating Geo- Diversity - HITB

Zhang, Wei (1988). "Shift-invariant pattern recognition neural network and its optical architecture". Proceedings of annual conference of the Japan Society of Applied Physics.

Zhang, Wei (1990). "Parallel distributed processing model with local space-invariant interconnections and its optical architecture". Applied Optics. 29 (32): 4790–7. Bibcode:1990ApOpt..29.4790Z. doi:10.1364/AO.29.004790. PMID 20577468.

Page 33: Pixelating Geo- Diversity - HITB
Page 34: Pixelating Geo- Diversity - HITB
Page 35: Pixelating Geo- Diversity - HITB
Page 36: Pixelating Geo- Diversity - HITB
Page 37: Pixelating Geo- Diversity - HITB
Page 38: Pixelating Geo- Diversity - HITB

Input Layer

Page 39: Pixelating Geo- Diversity - HITB

Input Layer

Hidden Layer 1

Hidden Layer 2

Example of non-convolution net

Page 40: Pixelating Geo- Diversity - HITB

Input Layer

4 by 4

Convolution

Page 41: Pixelating Geo- Diversity - HITB

Input Layer

Convolution

Stride by 2

Page 42: Pixelating Geo- Diversity - HITB

Convolution Output

Sort of 4 outputs

Page 43: Pixelating Geo- Diversity - HITB

Max by Pool

2 by 2 Pool

The max

Page 44: Pixelating Geo- Diversity - HITB

Fully Connected Layer

2 by 2 Pool

2 by 2 Pool

2 by 2 Pool

2 by 2 Pool

Page 45: Pixelating Geo- Diversity - HITB
Page 46: Pixelating Geo- Diversity - HITB

Conclusion● Introduce Requester Geo-Popularity Data● Introduce Exponential Moving Averages (EMAs)● Convolutional Neural Networks on Geo-Popularity

Page 47: Pixelating Geo- Diversity - HITB

Questions?