35
Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

  • Upload
    others

  • View
    20

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Deep Learning forRecommender Systems

Justin Basilico & Yves RaimondMarch 28, 2018GPU Technology Conference

@JustinBasilico @moustaki

Page 2: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

The value of recommendations● A few seconds to find something

great to watch…

● Can only show a few titles

● Enjoyment directly impacts customer satisfaction

● Generates over $1B per year of Netflix revenue

● How? Personalize everything

Page 3: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Deep learning for recommendations: a first try

Page 4: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

0 1 0 1 0

0 0 1 1 0

1 0 0 1 1

0 1 0 0 0

0 0 0 0 1

UsersIte

ms

Traditional Recommendation Setup

Page 5: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

U≈RV

A Matrix Factorization view

Page 6: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

U

A Feed-Forward Network view

V

Page 7: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

U

A (deeper) feed-forward view

V

Mean squared loss?

Page 8: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

A quick & dirty experiment●

○○

●○

■■

○■■■■■

Page 9: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

GPU vs. CPU●

Page 10: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki
Page 11: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki
Page 12: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

What’s going on?●

●●

Page 13: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Conclusion?●

Page 14: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Breaking the ‘traditional’ recsys setup

Page 15: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Alternative data

Page 18: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

YouTube Recommendations●

Page 19: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Alternative models

Page 23: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Wide + Deep models●

[Cheng et. al., 2016]

Page 24: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Alternative framings

Page 27: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Contextual sequence data

2017-12-10 15:40:22

2017-12-23 19:32:10

2017-12-24 12:05:53

2017-12-27 22:40:22

2017-12-29 19:39:36

2017-12-30 20:42:13

Context ActionSequenceper user

?

Tim

e

Page 28: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Time-sensitive sequence prediction●

●○

■●●

■○

Page 29: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki
Page 30: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki
Page 32: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Conclusion

Page 33: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Takeaways●

Page 35: Deep Learning for Recommender Systems - NVIDIA · Deep Learning for Recommender Systems Justin Basilico & Yves Raimond March 28, 2018 GPU Technology Conference @JustinBasilico @moustaki

Thank you. @JustinBasilico @moustaki

Justin Basilico & Yves Raimond

Yes, we’re hiring...