120
Part 2 - Learned Data Structures and Algorithms Tim Kraska <[email protected]> First part can be found here: https://stratos.seas.harvard.edu/files/stratos/files/learnedselfdesignedsystemssigmod2019tutorialpart1.pdf

Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston [email protected] 80 Novick Road

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Part 2 - Learned Data Structures and AlgorithmsTim Kraska <[email protected]>

First part can be found here:https://stratos.seas.harvard.edu/files/stratos/files/learnedselfdesignedsystemssigmod2019tutorialpart1.pdf

Page 2: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

Page 3: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Fundamental Building Blocks

Sorting

B-TreeHash-Map

Scheduling

Join

PriorityQueue

BloomFilter

CachingRangeFilter

Page 4: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

B-Tree

Fundamental Algorithms & Data Structures

Tim Kraska, Alex Beutel, Ed H. Chi, Jeffrey Dean, Neoklis Polyzotis:The Case for Learned Index Structures. SIGMOD Conference 2018: 489-504

Page 5: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

A-B

B-C

C-G

AA-AL

AL-AK

AK-AP

…BA-BE

BI-BL

BL-BR

… … ... ... …

….

… … … … …. … …. …

….….… … … … …. … …. … … … … … …. … …. …

Key(e.g., spoon #1)

Page 6: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Key(e.g., spoon #1)

Model

Page 7: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How To Build Models To Predict the Locationid date first_name last_name email address zip state credit_card_nb amount

1000 2017-01-01 Hobart Spracklin [email protected] 20565 High Crossing Plaza 56372 Minnesota 4405-6975-7285-5160 611.00$ 1001 2017-01-02 Billye Binnion [email protected] 3698 Upham Point 20260 District of Columbia 3533-7150-7728-9850 244.00$ 1002 2017-01-02 Johann Brockley [email protected] 23844 Artisan Place 98516 Washington 67597-1193-7985-5100 233.00$ 1003 2017-01-03 Artie [email protected] 6276 Toban Trail 78759 Texas 3537-4829-6134-5000 210.00$ 1004 2017-01-03 Delilah O'Currigan [email protected] 86016 New Castle Avenue 72199 Arkansas 3555-2017-2226-5780 286.00$ 1005 2017-01-04 Gretta Will [email protected] 0 Dottie Circle 68524 Nebraska 503844-1984-2085-5000 870.00$ 1006 2017-01-04 Gordon Kirsopp [email protected] 64060 Scott Park 20370 District of Columbia 633332-1895-2414-5000 687.00$ 1007 2017-01-05 Bendick Fagg [email protected] 94 Florence Hill 45440 Ohio 3528-9673-1815-8420 733.00$ 1008 2017-01-05 Dimitry Boyet [email protected] 35886 Golf Plaza 30066 Georgia 3576-6991-4041-3170 382.00$ 1009 2017-01-06 Ailsun Beinke [email protected] 1 Badeau Place 46295 Indiana 56022-2011-8072-1400 854.00$ 1010 2017-01-07 Lou Hallows [email protected] 1 Twin Pines Junction 91125 California 5602-2364-4079-0250 150.00$ 1011 2017-01-09 Tiffani Mathew [email protected] 0456 Meadow Vale Lane 75260 Texas 6387-6943-8910-4580 313.00$ 1012 2017-01-09 Perl Bridie [email protected] 07 Bluestem Junction 33124 Florida 3539-8662-2397-5880 558.00$ 1013 2017-01-09 Rosabelle Blasik [email protected] 7 Fairfield Pass 79699 Texas 5602-2297-6599-8560 941.00$ 1014 2017-01-10 Meggi Belamy [email protected] 0995 Manufacturers Street 10170 New York 3557-5094-7405-8340 875.00$ 1015 2017-01-10 Tadio Balderston [email protected] 80 Novick Road 75260 Texas 60485-3728-7119-9300 954.00$ 1016 2017-01-11 Gianina Oxteby [email protected] 72674 Fuller Avenue 89505 Nevada 4-0415-9268-2397 239.00$ 1017 2017-01-12 Brendan Doody [email protected] 87414 Golden Leaf Street 11480 New York 201-6348-4121-1314 308.00$ 1018 2017-01-13 Conway Coombs [email protected] 2810 Oakridge Park 32859 Florida 3529-1514-0357-9120 60.00$ 1019 2017-01-14 Germaine Bere [email protected] 82802 Oakridge Park 20041 District of Columbia 670961-0240-4054-9000 95.00$ 1020 2017-01-15 Davide Tolcharde [email protected] 89 Continental Avenue 79165 Texas 5018-7748-4325-9510 137.00$ 1021 2017-01-16 Nigel Artharg [email protected] 31 Mcbride Point 22301 Virginia 560225-6965-2870-0000 496.00$ 1022 2017-01-17 Rickard Trenholm [email protected] 93 Hoepker Parkway 70593 Louisiana 3541-5241-5383-9970 760.00$ 1023 2017-01-18 Juditha Dwane [email protected] 7914 Eliot Lane 14276 New York 5456-4410-0914-3180 474.00$ 1024 2017-01-19 Susan Ilden [email protected] 25204 Huxley Road 21684 Maryland 3574-8586-6367-9920 83.00$ 1025 2017-01-20 Abbey Triggle [email protected] 47 Debra Pass 74184 Oklahoma 3538-6047-6315-7710 513.00$ 1026 2017-01-21 Zsazsa Dunster [email protected] 7 Gerald Alley 40576 Kentucky 3562-0325-7709-3490 952.00$ 1027 2017-01-22 Grantham Friatt [email protected] 774 Prairieview Circle 29225 South Carolina 3571-1171-9476-8780 942.00$ 1028 2017-01-22 Ross Gaudin [email protected] 3102 Loeprich Trail 68197 Nebraska 5108-7578-4665-2710 572.00$ 1029 2017-01-22 Aluino Drover [email protected] 2717 Northridge Avenue 72199 Arkansas 670999-3171-8848-0000 318.00$ 1030 2017-01-23 Shurlock Braker [email protected] 30783 Jenna Alley 80945 Colorado 6331106-1894-9878-0000 166.00$ 1031 2017-01-24 Glenda Goodbody [email protected] 720 Pierstorff Way 7522 New Jersey 36-0593-2719-1684 412.00$ 1032 2017-01-24 Rollin Reddie [email protected] 09 Gina Park 65810 Missouri 4665-9188-1324-1040 383.00$ 1033 2017-01-26 Dorry Jenks [email protected] 1 Butterfield Road 85210 Arizona 3578-9195-0297-7730 636.00$ 1034 2017-01-26 Patti Emby [email protected] 26 Hoard Drive 91210 California 3585-8243-7506-2470 957.00$ 1035 2017-01-26 Nickie Menauteau [email protected] 035 Derek Junction 92110 California 3580-5488-8443-2070 484.00$ 1036 2017-01-28 Jon Kassman [email protected] 2171 Buena Vista Lane 89125 Nevada 3576-7358-0772-1380 64.00$ 1037 2017-01-29 Pansy Pelz [email protected] 15 Buena Vista Circle 55441 Minnesota 372-3019-6895-3127 498.00$ 1038 2017-01-30 Tedd Kingsley [email protected] 65 Crest Line Terrace 19892 Delaware 633447-9874-0606-9000 574.00$ 1039 2017-01-30 Brana Barnaby [email protected] 8 Mifflin Way 35225 Alabama 4911-0899-8885-2970 296.00$ 1040 2017-01-30 Alysa Knightly [email protected] 19 Talisman Lane 45454 Ohio 6771-5993-8703-9340 713.00$ 1041 2017-01-31 Erina Emmot [email protected] 4 Monument Plaza 32255 Florida 6706465-4418-7633-0000 997.00$ 1042 2017-01-31 Georgy Locket [email protected] 0 Huxley Parkway 37605 Tennessee 30-5661-6604-8367 285.00$ 1043 2017-02-01 Kordula Dobkin [email protected] 47 Golf View Point 94121 California 30-2114-0922-1485 677.00$ 1044 2017-02-01 Clarie Josskowitz [email protected] 1 Park Meadow Lane 39236 Mississippi 3546-0315-7744-3990 363.00$ 1045 2017-02-02 Reube Eatock [email protected] 5 Ruskin Park 97211 Oregon 3584-2997-8675-0280 505.00$ 1046 2017-02-04 Joellyn Bebis [email protected] 68430 Ridgeway Park 38197 Tennessee 5602-2261-7843-1310 917.00$ 1047 2017-02-05 Mavis Frigout [email protected] 5581 Montana Street 80910 Colorado 3579-6425-2725-3150 781.00$ 1048 2017-02-05 Sadye Probetts [email protected] 93 Duke Avenue 27615 North Carolina 3530-3785-5739-3570 464.00$ 1049 2017-02-06 Alberto Deeves [email protected] 39341 Brickson Park Plaza 79940 Texas 5010-1248-9700-6870 901.00$ 1050 2017-02-06 Terrence Missenden [email protected] 36339 Kinsman Center 77060 Texas 3552-8788-4710-8910 966.00$ 1051 2017-02-06 Whitby Mowsdell [email protected] 6235 Lotheville Alley 93591 California 3546-2664-8937-4240 126.00$ 1052 2017-02-07 Everard Wedlock [email protected] 8858 Briar Crest Avenue 36134 Alabama 3583-3948-6685-7240 923.00$ 1053 2017-02-07 Karlee Dowd [email protected] 3074 Northland Hill 15255 Pennsylvania 3589-6791-1914-2140 933.00$ 1054 2017-02-08 Lynett Nial [email protected] 845 Welch Junction 20551 District of Columbia 3579-0213-7287-8220 63.00$ 1055 2017-02-08 Tedman Pledge [email protected] 20 Kensington Parkway 24014 Virginia 3546-6887-0454-7180 242.00$ 1056 2017-02-08 Kim Bambrick [email protected] 4 Towne Avenue 84170 Utah 6374-6917-5337-0770 515.00$ 1057 2017-02-09 Adaline Denholm [email protected] 6010 Browning Park 25775 West Virginia 3586-3802-3692-9110 882.00$ 1058 2017-02-10 Basile Caverhill [email protected] 1288 Rowland Center 23509 Virginia 6304-0277-2034-3630 317.00$ 1059 2017-02-10 Derril Hogsden [email protected] 07852 Pond Place 12255 New York 3555-8671-3458-7860 191.00$ 1060 2017-02-11 Curtice Noden [email protected] 7 Raven Circle 30033 Georgia 374-2885-3140-6071 384.00$ 1061 2017-02-12 Adiana Cocking [email protected] 51 Surrey Center 8619 New Jersey 3566-4963-4956-0470 577.00$ 1062 2017-02-13 Livvy Giacoboni [email protected] 37 Lien Terrace 61614 Illinois 3544-7235-0724-9800 741.00$ 1063 2017-02-13 Bob Nussen [email protected] 7136 Carberry Circle 33610 Florida 4911-5061-6903-3430 846.00$ 1064 2017-02-14 Adrien Curtois [email protected] 946 Lerdahl Crossing 77090 Texas 3557-4641-4387-7530 659.00$ 1065 2017-02-14 Sephira Corradi [email protected] 754 Commercial Park 81005 Colorado 5038713-1328-9363-0000 342.00$ 1066 2017-02-15 Drusilla Bligh [email protected] 98978 Dexter Junction 27105 North Carolina 374-6225-4978-9690 627.00$

Page 8: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How To Build Models To Predict the Locationid date first_name last_name email address zip state credit_card_nb amount

1000 2017-01-01 Hobart Spracklin [email protected] 20565 High Crossing Plaza 56372 Minnesota 4405-6975-7285-5160 611.00$ 1001 2017-01-02 Billye Binnion [email protected] 3698 Upham Point 20260 District of Columbia 3533-7150-7728-9850 244.00$ 1002 2017-01-02 Johann Brockley [email protected] 23844 Artisan Place 98516 Washington 67597-1193-7985-5100 233.00$ 1003 2017-01-03 Artie [email protected] 6276 Toban Trail 78759 Texas 3537-4829-6134-5000 210.00$ 1004 2017-01-03 Delilah O'Currigan [email protected] 86016 New Castle Avenue 72199 Arkansas 3555-2017-2226-5780 286.00$ 1005 2017-01-04 Gretta Will [email protected] 0 Dottie Circle 68524 Nebraska 503844-1984-2085-5000 870.00$ 1006 2017-01-04 Gordon Kirsopp [email protected] 64060 Scott Park 20370 District of Columbia 633332-1895-2414-5000 687.00$ 1007 2017-01-05 Bendick Fagg [email protected] 94 Florence Hill 45440 Ohio 3528-9673-1815-8420 733.00$ 1008 2017-01-05 Dimitry Boyet [email protected] 35886 Golf Plaza 30066 Georgia 3576-6991-4041-3170 382.00$ 1009 2017-01-06 Ailsun Beinke [email protected] 1 Badeau Place 46295 Indiana 56022-2011-8072-1400 854.00$ 1010 2017-01-07 Lou Hallows [email protected] 1 Twin Pines Junction 91125 California 5602-2364-4079-0250 150.00$ 1011 2017-01-09 Tiffani Mathew [email protected] 0456 Meadow Vale Lane 75260 Texas 6387-6943-8910-4580 313.00$ 1012 2017-01-09 Perl Bridie [email protected] 07 Bluestem Junction 33124 Florida 3539-8662-2397-5880 558.00$ 1013 2017-01-09 Rosabelle Blasik [email protected] 7 Fairfield Pass 79699 Texas 5602-2297-6599-8560 941.00$ 1014 2017-01-10 Meggi Belamy [email protected] 0995 Manufacturers Street 10170 New York 3557-5094-7405-8340 875.00$ 1015 2017-01-10 Tadio Balderston [email protected] 80 Novick Road 75260 Texas 60485-3728-7119-9300 954.00$ 1016 2017-01-11 Gianina Oxteby [email protected] 72674 Fuller Avenue 89505 Nevada 4-0415-9268-2397 239.00$ 1017 2017-01-12 Brendan Doody [email protected] 87414 Golden Leaf Street 11480 New York 201-6348-4121-1314 308.00$ 1018 2017-01-13 Conway Coombs [email protected] 2810 Oakridge Park 32859 Florida 3529-1514-0357-9120 60.00$ 1019 2017-01-14 Germaine Bere [email protected] 82802 Oakridge Park 20041 District of Columbia 670961-0240-4054-9000 95.00$ 1020 2017-01-15 Davide Tolcharde [email protected] 89 Continental Avenue 79165 Texas 5018-7748-4325-9510 137.00$ 1021 2017-01-16 Nigel Artharg [email protected] 31 Mcbride Point 22301 Virginia 560225-6965-2870-0000 496.00$ 1022 2017-01-17 Rickard Trenholm [email protected] 93 Hoepker Parkway 70593 Louisiana 3541-5241-5383-9970 760.00$ 1023 2017-01-18 Juditha Dwane [email protected] 7914 Eliot Lane 14276 New York 5456-4410-0914-3180 474.00$ 1024 2017-01-19 Susan Ilden [email protected] 25204 Huxley Road 21684 Maryland 3574-8586-6367-9920 83.00$ 1025 2017-01-20 Abbey Triggle [email protected] 47 Debra Pass 74184 Oklahoma 3538-6047-6315-7710 513.00$ 1026 2017-01-21 Zsazsa Dunster [email protected] 7 Gerald Alley 40576 Kentucky 3562-0325-7709-3490 952.00$ 1027 2017-01-22 Grantham Friatt [email protected] 774 Prairieview Circle 29225 South Carolina 3571-1171-9476-8780 942.00$ 1028 2017-01-22 Ross Gaudin [email protected] 3102 Loeprich Trail 68197 Nebraska 5108-7578-4665-2710 572.00$ 1029 2017-01-22 Aluino Drover [email protected] 2717 Northridge Avenue 72199 Arkansas 670999-3171-8848-0000 318.00$ 1030 2017-01-23 Shurlock Braker [email protected] 30783 Jenna Alley 80945 Colorado 6331106-1894-9878-0000 166.00$ 1031 2017-01-24 Glenda Goodbody [email protected] 720 Pierstorff Way 7522 New Jersey 36-0593-2719-1684 412.00$ 1032 2017-01-24 Rollin Reddie [email protected] 09 Gina Park 65810 Missouri 4665-9188-1324-1040 383.00$ 1033 2017-01-26 Dorry Jenks [email protected] 1 Butterfield Road 85210 Arizona 3578-9195-0297-7730 636.00$ 1034 2017-01-26 Patti Emby [email protected] 26 Hoard Drive 91210 California 3585-8243-7506-2470 957.00$ 1035 2017-01-26 Nickie Menauteau [email protected] 035 Derek Junction 92110 California 3580-5488-8443-2070 484.00$ 1036 2017-01-28 Jon Kassman [email protected] 2171 Buena Vista Lane 89125 Nevada 3576-7358-0772-1380 64.00$ 1037 2017-01-29 Pansy Pelz [email protected] 15 Buena Vista Circle 55441 Minnesota 372-3019-6895-3127 498.00$ 1038 2017-01-30 Tedd Kingsley [email protected] 65 Crest Line Terrace 19892 Delaware 633447-9874-0606-9000 574.00$ 1039 2017-01-30 Brana Barnaby [email protected] 8 Mifflin Way 35225 Alabama 4911-0899-8885-2970 296.00$ 1040 2017-01-30 Alysa Knightly [email protected] 19 Talisman Lane 45454 Ohio 6771-5993-8703-9340 713.00$ 1041 2017-01-31 Erina Emmot [email protected] 4 Monument Plaza 32255 Florida 6706465-4418-7633-0000 997.00$ 1042 2017-01-31 Georgy Locket [email protected] 0 Huxley Parkway 37605 Tennessee 30-5661-6604-8367 285.00$ 1043 2017-02-01 Kordula Dobkin [email protected] 47 Golf View Point 94121 California 30-2114-0922-1485 677.00$ 1044 2017-02-01 Clarie Josskowitz [email protected] 1 Park Meadow Lane 39236 Mississippi 3546-0315-7744-3990 363.00$ 1045 2017-02-02 Reube Eatock [email protected] 5 Ruskin Park 97211 Oregon 3584-2997-8675-0280 505.00$ 1046 2017-02-04 Joellyn Bebis [email protected] 68430 Ridgeway Park 38197 Tennessee 5602-2261-7843-1310 917.00$ 1047 2017-02-05 Mavis Frigout [email protected] 5581 Montana Street 80910 Colorado 3579-6425-2725-3150 781.00$ 1048 2017-02-05 Sadye Probetts [email protected] 93 Duke Avenue 27615 North Carolina 3530-3785-5739-3570 464.00$ 1049 2017-02-06 Alberto Deeves [email protected] 39341 Brickson Park Plaza 79940 Texas 5010-1248-9700-6870 901.00$ 1050 2017-02-06 Terrence Missenden [email protected] 36339 Kinsman Center 77060 Texas 3552-8788-4710-8910 966.00$ 1051 2017-02-06 Whitby Mowsdell [email protected] 6235 Lotheville Alley 93591 California 3546-2664-8937-4240 126.00$ 1052 2017-02-07 Everard Wedlock [email protected] 8858 Briar Crest Avenue 36134 Alabama 3583-3948-6685-7240 923.00$ 1053 2017-02-07 Karlee Dowd [email protected] 3074 Northland Hill 15255 Pennsylvania 3589-6791-1914-2140 933.00$ 1054 2017-02-08 Lynett Nial [email protected] 845 Welch Junction 20551 District of Columbia 3579-0213-7287-8220 63.00$ 1055 2017-02-08 Tedman Pledge [email protected] 20 Kensington Parkway 24014 Virginia 3546-6887-0454-7180 242.00$ 1056 2017-02-08 Kim Bambrick [email protected] 4 Towne Avenue 84170 Utah 6374-6917-5337-0770 515.00$ 1057 2017-02-09 Adaline Denholm [email protected] 6010 Browning Park 25775 West Virginia 3586-3802-3692-9110 882.00$ 1058 2017-02-10 Basile Caverhill [email protected] 1288 Rowland Center 23509 Virginia 6304-0277-2034-3630 317.00$ 1059 2017-02-10 Derril Hogsden [email protected] 07852 Pond Place 12255 New York 3555-8671-3458-7860 191.00$ 1060 2017-02-11 Curtice Noden [email protected] 7 Raven Circle 30033 Georgia 374-2885-3140-6071 384.00$ 1061 2017-02-12 Adiana Cocking [email protected] 51 Surrey Center 8619 New Jersey 3566-4963-4956-0470 577.00$ 1062 2017-02-13 Livvy Giacoboni [email protected] 37 Lien Terrace 61614 Illinois 3544-7235-0724-9800 741.00$ 1063 2017-02-13 Bob Nussen [email protected] 7136 Carberry Circle 33610 Florida 4911-5061-6903-3430 846.00$ 1064 2017-02-14 Adrien Curtois [email protected] 946 Lerdahl Crossing 77090 Texas 3557-4641-4387-7530 659.00$ 1065 2017-02-14 Sephira Corradi [email protected] 754 Commercial Park 81005 Colorado 5038713-1328-9363-0000 342.00$ 1066 2017-02-15 Drusilla Bligh [email protected] 98978 Dexter Junction 27105 North Carolina 374-6225-4978-9690 627.00$

Page 9: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How To Build Models To Predict the Location

#Ord

ers

Date

Frequency Distribution

Date

Cumulative Distribution Function (CDF)

0

1

Prob

abili

ty

P(X<2017-11-27)

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

Page 10: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How To Build Models To Predict the Location

#Ord

ers

Date

Frequency Distribution

Date

Cumulative Distribution Function (CDF)

0

1

Prob

abili

ty

P(X<2017-11-27) * N

… …

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

2017-11-27

2017-11-27

2017-11-27

2017-11-28

2017-11-28

Page 11: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Key

Model

… …

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

2017-11-27

2017-11-27

2017-11-27

2017-11-28

2017-11-28

CDF Model

Page 12: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Key

… …

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

2017-11-27

2017-11-27

2017-11-27

2017-11-28

2017-11-28

B-Trees are also models (regression tree)

Page 13: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What Does This Mean

Page 14: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Why Is This A Big Deal?

Key

Model

… …

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

2017-11-27

2017-11-27

2017-11-27

2017-11-28

2017-11-28

Page 15: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

id date first_name last_name email address zip state credit_card_nb amount1000 2017-01-01 Hobart Spracklin [email protected] 20565 High Crossing Plaza 56372 Minnesota 4405-6975-7285-5160 611.00$ 1001 2017-01-02 Billye Binnion [email protected] 3698 Upham Point 20260 District of Columbia 3533-7150-7728-9850 244.00$ 1002 2017-01-02 Johann Brockley [email protected] 23844 Artisan Place 98516 Washington 67597-1193-7985-5100 233.00$ 1003 2017-01-03 Artie [email protected] 6276 Toban Trail 78759 Texas 3537-4829-6134-5000 210.00$ 1004 2017-01-03 Delilah O'Currigan [email protected] 86016 New Castle Avenue 72199 Arkansas 3555-2017-2226-5780 286.00$ 1005 2017-01-04 Gretta Will [email protected] 0 Dottie Circle 68524 Nebraska 503844-1984-2085-5000 870.00$ 1006 2017-01-04 Gordon Kirsopp [email protected] 64060 Scott Park 20370 District of Columbia 633332-1895-2414-5000 687.00$ 1007 2017-01-05 Bendick Fagg [email protected] 94 Florence Hill 45440 Ohio 3528-9673-1815-8420 733.00$ 1008 2017-01-05 Dimitry Boyet [email protected] 35886 Golf Plaza 30066 Georgia 3576-6991-4041-3170 382.00$ 1009 2017-01-06 Ailsun Beinke [email protected] 1 Badeau Place 46295 Indiana 56022-2011-8072-1400 854.00$ 1010 2017-01-07 Lou Hallows [email protected] 1 Twin Pines Junction 91125 California 5602-2364-4079-0250 150.00$ 1011 2017-01-09 Tiffani Mathew [email protected] 0456 Meadow Vale Lane 75260 Texas 6387-6943-8910-4580 313.00$ 1012 2017-01-09 Perl Bridie [email protected] 07 Bluestem Junction 33124 Florida 3539-8662-2397-5880 558.00$ 1013 2017-01-09 Rosabelle Blasik [email protected] 7 Fairfield Pass 79699 Texas 5602-2297-6599-8560 941.00$ 1014 2017-01-10 Meggi Belamy [email protected] 0995 Manufacturers Street 10170 New York 3557-5094-7405-8340 875.00$ 1015 2017-01-10 Tadio Balderston [email protected] 80 Novick Road 75260 Texas 60485-3728-7119-9300 954.00$ 1016 2017-01-11 Gianina Oxteby [email protected] 72674 Fuller Avenue 89505 Nevada 4-0415-9268-2397 239.00$ 1017 2017-01-12 Brendan Doody [email protected] 87414 Golden Leaf Street 11480 New York 201-6348-4121-1314 308.00$ 1018 2017-01-13 Conway Coombs [email protected] 2810 Oakridge Park 32859 Florida 3529-1514-0357-9120 60.00$ 1019 2017-01-14 Germaine Bere [email protected] 82802 Oakridge Park 20041 District of Columbia 670961-0240-4054-9000 95.00$ 1020 2017-01-15 Davide Tolcharde [email protected] 89 Continental Avenue 79165 Texas 5018-7748-4325-9510 137.00$ 1021 2017-01-16 Nigel Artharg [email protected] 31 Mcbride Point 22301 Virginia 560225-6965-2870-0000 496.00$ 1022 2017-01-17 Rickard Trenholm [email protected] 93 Hoepker Parkway 70593 Louisiana 3541-5241-5383-9970 760.00$ 1023 2017-01-18 Juditha Dwane [email protected] 7914 Eliot Lane 14276 New York 5456-4410-0914-3180 474.00$ 1024 2017-01-19 Susan Ilden [email protected] 25204 Huxley Road 21684 Maryland 3574-8586-6367-9920 83.00$ 1025 2017-01-20 Abbey Triggle [email protected] 47 Debra Pass 74184 Oklahoma 3538-6047-6315-7710 513.00$ 1026 2017-01-21 Zsazsa Dunster [email protected] 7 Gerald Alley 40576 Kentucky 3562-0325-7709-3490 952.00$ 1027 2017-01-22 Grantham Friatt [email protected] 774 Prairieview Circle 29225 South Carolina 3571-1171-9476-8780 942.00$ 1028 2017-01-22 Ross Gaudin [email protected] 3102 Loeprich Trail 68197 Nebraska 5108-7578-4665-2710 572.00$ 1029 2017-01-22 Aluino Drover [email protected] 2717 Northridge Avenue 72199 Arkansas 670999-3171-8848-0000 318.00$ 1030 2017-01-23 Shurlock Braker [email protected] 30783 Jenna Alley 80945 Colorado 6331106-1894-9878-0000 166.00$ 1031 2017-01-24 Glenda Goodbody [email protected] 720 Pierstorff Way 7522 New Jersey 36-0593-2719-1684 412.00$ 1032 2017-01-24 Rollin Reddie [email protected] 09 Gina Park 65810 Missouri 4665-9188-1324-1040 383.00$ 1033 2017-01-26 Dorry Jenks [email protected] 1 Butterfield Road 85210 Arizona 3578-9195-0297-7730 636.00$ 1034 2017-01-26 Patti Emby [email protected] 26 Hoard Drive 91210 California 3585-8243-7506-2470 957.00$ 1035 2017-01-26 Nickie Menauteau [email protected] 035 Derek Junction 92110 California 3580-5488-8443-2070 484.00$ 1036 2017-01-28 Jon Kassman [email protected] 2171 Buena Vista Lane 89125 Nevada 3576-7358-0772-1380 64.00$ 1037 2017-01-29 Pansy Pelz [email protected] 15 Buena Vista Circle 55441 Minnesota 372-3019-6895-3127 498.00$ 1038 2017-01-30 Tedd Kingsley [email protected] 65 Crest Line Terrace 19892 Delaware 633447-9874-0606-9000 574.00$ 1039 2017-01-30 Brana Barnaby [email protected] 8 Mifflin Way 35225 Alabama 4911-0899-8885-2970 296.00$ 1040 2017-01-30 Alysa Knightly [email protected] 19 Talisman Lane 45454 Ohio 6771-5993-8703-9340 713.00$ 1041 2017-01-31 Erina Emmot [email protected] 4 Monument Plaza 32255 Florida 6706465-4418-7633-0000 997.00$ 1042 2017-01-31 Georgy Locket [email protected] 0 Huxley Parkway 37605 Tennessee 30-5661-6604-8367 285.00$ 1043 2017-02-01 Kordula Dobkin [email protected] 47 Golf View Point 94121 California 30-2114-0922-1485 677.00$ 1044 2017-02-01 Clarie Josskowitz [email protected] 1 Park Meadow Lane 39236 Mississippi 3546-0315-7744-3990 363.00$ 1045 2017-02-02 Reube Eatock [email protected] 5 Ruskin Park 97211 Oregon 3584-2997-8675-0280 505.00$ 1046 2017-02-04 Joellyn Bebis [email protected] 68430 Ridgeway Park 38197 Tennessee 5602-2261-7843-1310 917.00$ 1047 2017-02-05 Mavis Frigout [email protected] 5581 Montana Street 80910 Colorado 3579-6425-2725-3150 781.00$ 1048 2017-02-05 Sadye Probetts [email protected] 93 Duke Avenue 27615 North Carolina 3530-3785-5739-3570 464.00$ 1049 2017-02-06 Alberto Deeves [email protected] 39341 Brickson Park Plaza 79940 Texas 5010-1248-9700-6870 901.00$ 1050 2017-02-06 Terrence Missenden [email protected] 36339 Kinsman Center 77060 Texas 3552-8788-4710-8910 966.00$ 1051 2017-02-06 Whitby Mowsdell [email protected] 6235 Lotheville Alley 93591 California 3546-2664-8937-4240 126.00$ 1052 2017-02-07 Everard Wedlock [email protected] 8858 Briar Crest Avenue 36134 Alabama 3583-3948-6685-7240 923.00$ 1053 2017-02-07 Karlee Dowd [email protected] 3074 Northland Hill 15255 Pennsylvania 3589-6791-1914-2140 933.00$ 1054 2017-02-08 Lynett Nial [email protected] 845 Welch Junction 20551 District of Columbia 3579-0213-7287-8220 63.00$ 1055 2017-02-08 Tedman Pledge [email protected] 20 Kensington Parkway 24014 Virginia 3546-6887-0454-7180 242.00$ 1056 2017-02-08 Kim Bambrick [email protected] 4 Towne Avenue 84170 Utah 6374-6917-5337-0770 515.00$ 1057 2017-02-09 Adaline Denholm [email protected] 6010 Browning Park 25775 West Virginia 3586-3802-3692-9110 882.00$ 1058 2017-02-10 Basile Caverhill [email protected] 1288 Rowland Center 23509 Virginia 6304-0277-2034-3630 317.00$ 1059 2017-02-10 Derril Hogsden [email protected] 07852 Pond Place 12255 New York 3555-8671-3458-7860 191.00$ 1060 2017-02-11 Curtice Noden [email protected] 7 Raven Circle 30033 Georgia 374-2885-3140-6071 384.00$ 1061 2017-02-12 Adiana Cocking [email protected] 51 Surrey Center 8619 New Jersey 3566-4963-4956-0470 577.00$ 1062 2017-02-13 Livvy Giacoboni [email protected] 37 Lien Terrace 61614 Illinois 3544-7235-0724-9800 741.00$ 1063 2017-02-13 Bob Nussen [email protected] 7136 Carberry Circle 33610 Florida 4911-5061-6903-3430 846.00$ 1064 2017-02-14 Adrien Curtois [email protected] 946 Lerdahl Crossing 77090 Texas 3557-4641-4387-7530 659.00$ 1065 2017-02-14 Sephira Corradi [email protected] 754 Commercial Park 81005 Colorado 5038713-1328-9363-0000 342.00$ 1066 2017-02-15 Drusilla Bligh [email protected] 98978 Dexter Junction 27105 North Carolina 374-6225-4978-9690 627.00$

Adaptation To ApplicationData

Page 16: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Adaptation To ApplicationData

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

… … … …

… … … … … … … … … ... ... …….

… … … … …. … …. …….….

… … … … …. … …. … … … … … …. … …. …

B-Tree?

Page 17: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Adaptation To ApplicationData

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

data_array[id - 1000]

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

data_array[model(date)]

#Ord

ers

Date

Page 18: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

State-Of-The-ArtB-Tree

260ns ???

Does It Work? A First Attempt

Page 19: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

State-Of-The-ArtB-Tree

260ns >80,000ns

Does It Work? A First Attempt

Page 20: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Traditional model architectures do not work

Frameworks are not designed for nano-second execution

Overfitting can be good ML+System Co-Design

underfitting desired overfitting

desired

Challenges

Page 21: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Traditional model architectures do not work

Frameworks are not designed for nano-second execution

Overfitting can be good ML+System Co-Design

underfitting desired overfitting

desired

Challenges

Page 22: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What model type should I use?

Page 23: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What model type should I use?

Whatever works!

Page 24: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What model type should I use?

Whatever works!• Often continuous functions • Possible model types include neural nets, regression

models, piece-wise linear functions, among other things• Model-type can be auto-tuned• Opens up a complete new toolbox of building data

structures and algorithms

Page 25: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Traditional model architectures do not work

Frameworks are not designed for nano-second execution

Overfitting can be good ML+System Co-Design

underfitting desired overfitting

desired

Challenges

Page 26: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Overfitting is a Good ThingThe Last Mile Problem

Pos

Key

Page 27: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Overfitting is a Good Thing

…….

…….

…….

…….

…….

…….…….

…….

Index over 100M records. Page-size: 100

Precision Gain: 100M --> 1M(Min/Max-Error: 1M)

Precision Gain: 1M --> 10k

Precision Gain: 10k --> 100

100M records(i.e., 1M pages)

Page 28: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Traditional model architectures do not work

Frameworks are not designed for nano-second execution

Overfitting can be good ML+System Co-Design

underfitting desired overfitting

desired

Solution

Page 29: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

2-Stage RMI with Linear Modelpos0 = a0 + b0 * keypos1 = m1[pos0].a + m1[pos0].b * keyrecord = local-search(key, pos1)

Model 1.1

Model 2.1 Model 2.2 Model 2.3

Model 3.1 Model 3.2 Model 3.3 Model 3.4

…St

age

1St

age

3St

age

2

Position

Key

Recursive-Model Index (RMI)

Page 30: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Model 1.1

Model 2.1 Model 2.2 Model 2.3

Model 3.2 Model 3.4

Stag

e 1

Stag

e 3

Stag

e 2

Position

Key

B-Tree 3.3B-Tree 3.1

Hybrid RMI

Worst-Case Performance is the one of a B-Tree

Page 31: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Traditional model architectures do not work

Frameworks are not designed for nano-second execution

Overfitting can be good ML+System Co-Design

underfitting desired overfitting

desired

Solution

Page 32: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

The Learning Index Framework (LIF)

• An index synthesis system

• Given an index configuration generate the best possible code

• Uses ideas from Tupleware [VLDB15]

• Simple models are trained “on-the-fly”, whereas for complex models we use Tensorflow and extract weights afterwards (i.e., no Tensorflowduring inference time)

• Best index configuration is found using auto-tuning (e.g., see TuPAQ[SOCC15]

Page 33: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

State-Of-The-ArtB-Tree

265ns>80,000ns

Initial Results

85ns

Learned Index

13MB 0.7MB

Page 34: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

You Might Have Seen Certain Blog Posts

Page 35: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

0 50 100 150 200 250 300 350

256

32

4

0.5

Size (MB

)

Lookup-Time (ns)

FAST

LookupTable

Fixed-Size Read-OptimizedB-Tree w/ Interpolation Search

LearnedIndex

BetterW

orse

Better Worse

Initial Results

Page 36: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

My OwnComparison

Page 37: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

A Comparison To ARTful Indexes (Radix-Tree)

Experimental setup:• Dense: continuous keys from 0 to 256M

• Sparse: 256M keys where each bit is equally likely 0 or 1.

Viktor Leis, Alfons Kemper, Thomas Neumann: The Adaptive Radix Tree: ARTfulIndexing for Main-Memory Databases. ICDE 2013

Page 38: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

A Comparison To ARTful Indexes (Radix-Tree)

Experimental setup: continuous keys from 0 to 256M

Reported lookup throughput: 10M/s ≈ 100ns(1)

Size: not measured, but paper says overhead of ≈8 Bytes per key (dense, best case): 256M * 8 Byte ≈ 1953MB

(1)Numbers from the paper

Viktor Leis, Alfons Kemper, Thomas Neumann: The Adaptive Radix Tree: ARTfulIndexing for Main-Memory Databases. ICDE 2013

Page 39: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Learned Index

Generate Code:Record lookup(key) {

return data[0 + 1 * key];}

Page 40: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Learned Index

Generate Code:Record lookup(key) {

return data[key];}

Page 41: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Learned Index

Generate Code:Record lookup(key) {

return data[key];}

Lookup Latency: 10ns (learned index) vs 100ns* (ARTfull)or one-order-of-magnitude better

Space: 0MB vs 1953MBInfinitely better :)

Page 42: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

?

Page 43: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What about Updates and Inserts?

Page 44: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

What about Updates and Inserts?Alex Galakatos, Michael Markovitch, Carsten Binnig, Rodrigo Fonseca, Tim Kraska: A-Tree: A Bounded Approximate Index StructureSIGMOD 2019 (talk was yesterday)

Jialin Ding, Umar Farooq Minhas, Hantian Zhang, Yinan Li, Chi Wang, Badrish Chandramouli, Johannes Gehrke, Donald Kossmann, David B. Lomet: ALEX: An Updatable Adaptive Learned Index. CoRR abs/1905.08898 (2019)

Page 45: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

The Simple Approach: Delta Indexing

updates

Training a simple Multi-Variate Regression ModelCan be done in one pass over the data

Page 46: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Leverage the Distribution for Appends

Inse

rts

(e.g

., Ti

mes

tam

ps)

Time

New Inserts

If the Learned Model Can Generalize to InsertsInsert complexity is O(1) not O(Log N)

Ali Hadian, Thomas Heinis: Considerations for handling updates in learned index structures. aiDM@SIGMOD 2019: 3:1-3:4

Page 47: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Updates/Inserts • Less beneficial as the data still has to be stored sorted

• Idea: Leave space in the array where more updates/inserts are expected

• Can also be done with traditional trees.

• But, the error of learned indexes should increase with

per node in RMI whereas traditional indexes with! !

Page 48: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Still at the Beginning!

• Can we provide bounds for inserts?• When to retrain?• How to retrain models on the fly?• …

Page 49: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

A lot of follow up work (all from 2019)Jialin Ding, Umar Farooq Minhas, Hantian Zhang, Yinan Li, Chi Wang, Badrish Chandramouli, Johannes Gehrke, Donald Kossmann, David B. Lomet: ALEX: An Updatable Adaptive Learned Index. CoRR abs/1905.08898, 2019

Ali Hadian, Thomas Heinis: Considerations for handling updates in learned index structures. aiDM@SIGMOD 2019

Alex Galakatos, Michael Markovitch, Carsten Binnig, Rodrigo Fonseca, Tim Kraska: A-Tree: A Bounded Approximate Index Structure, SIGMOD 2019

Yingjun Wu, Jia Yu, Yuanyuan Tian, Richard Sidle, Ronald Barber: Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations. SIGMOD Conference 2019: 1223-1240

Ali Hadian, Thomas Heinis: Interpolation-friendly B-trees: Bridging the Gap Between Algorithmic and Learned Indexes. EDBT 2019: 710-713

P Van Sandt, Y Chronis, JM Patel: Efficiently Searching In-Memory Sorted Arrays: Revenge of the Interpolation Search?, SIGMOD 2019Wenkun Xiang, Hao Zhang, Rui Cui, Xing Chu, Keqin Li, Wei Zhou: Pavo: A RNN-Based Learned Inverted Index, Supervised or Unsupervised? IEEE Access 7: 293-303 (2019)

Giorgio Vinciguerra, Paolo Ferragina, Michele Miccinesi: Superseding traditional indexes by orchestrating learning and geometry, CoRR abs/1903.00507 (2019)

Yingjun Wu, Jia Yu, Yuanyuan Tian, Richard Sidle, Ronald Barber: Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations, CoRR abs/1903.11203, 2019

Chuzhe Tang, Zhiyuan Dong, Minjie Wang, Zhaoguo Wang, Haibo Chen: Learned Indexes for Dynamic Workloads. CoRRabs/1902.00655, 2019

….

Page 50: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Tree

Fundamental Algorithms & Data Structures

Page 51: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 52: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 53: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

id date first_name last_name email address zip state credit_card_nb amount1000 2017-01-01 Hobart Spracklin [email protected] 20565 High Crossing Plaza 56372 Minnesota 4405-6975-7285-5160 611.00$ 1001 2017-01-02 Billye Binnion [email protected] 3698 Upham Point 20260 District of Columbia 3533-7150-7728-9850 244.00$ 1002 2017-01-02 Johann Brockley [email protected] 23844 Artisan Place 98516 Washington 67597-1193-7985-5100 233.00$ 1003 2017-01-03 Artie [email protected] 6276 Toban Trail 78759 Texas 3537-4829-6134-5000 210.00$ 1004 2017-01-03 Delilah O'Currigan [email protected] 86016 New Castle Avenue 72199 Arkansas 3555-2017-2226-5780 286.00$ 1005 2017-01-04 Gretta Will [email protected] 0 Dottie Circle 68524 Nebraska 503844-1984-2085-5000 870.00$ 1006 2017-01-04 Gordon Kirsopp [email protected] 64060 Scott Park 20370 District of Columbia 633332-1895-2414-5000 687.00$ 1007 2017-01-05 Bendick Fagg [email protected] 94 Florence Hill 45440 Ohio 3528-9673-1815-8420 733.00$ 1008 2017-01-05 Dimitry Boyet [email protected] 35886 Golf Plaza 30066 Georgia 3576-6991-4041-3170 382.00$ 1009 2017-01-06 Ailsun Beinke [email protected] 1 Badeau Place 46295 Indiana 56022-2011-8072-1400 854.00$ 1010 2017-01-07 Lou Hallows [email protected] 1 Twin Pines Junction 91125 California 5602-2364-4079-0250 150.00$ 1011 2017-01-09 Tiffani Mathew [email protected] 0456 Meadow Vale Lane 75260 Texas 6387-6943-8910-4580 313.00$ 1012 2017-01-09 Perl Bridie [email protected] 07 Bluestem Junction 33124 Florida 3539-8662-2397-5880 558.00$ 1013 2017-01-09 Rosabelle Blasik [email protected] 7 Fairfield Pass 79699 Texas 5602-2297-6599-8560 941.00$ 1014 2017-01-10 Meggi Belamy [email protected] 0995 Manufacturers Street 10170 New York 3557-5094-7405-8340 875.00$ 1015 2017-01-10 Tadio Balderston [email protected] 80 Novick Road 75260 Texas 60485-3728-7119-9300 954.00$ 1016 2017-01-11 Gianina Oxteby [email protected] 72674 Fuller Avenue 89505 Nevada 4-0415-9268-2397 239.00$ 1017 2017-01-12 Brendan Doody [email protected] 87414 Golden Leaf Street 11480 New York 201-6348-4121-1314 308.00$ 1018 2017-01-13 Conway Coombs [email protected] 2810 Oakridge Park 32859 Florida 3529-1514-0357-9120 60.00$ 1019 2017-01-14 Germaine Bere [email protected] 82802 Oakridge Park 20041 District of Columbia 670961-0240-4054-9000 95.00$ 1020 2017-01-15 Davide Tolcharde [email protected] 89 Continental Avenue 79165 Texas 5018-7748-4325-9510 137.00$ 1021 2017-01-16 Nigel Artharg [email protected] 31 Mcbride Point 22301 Virginia 560225-6965-2870-0000 496.00$ 1022 2017-01-17 Rickard Trenholm [email protected] 93 Hoepker Parkway 70593 Louisiana 3541-5241-5383-9970 760.00$ 1023 2017-01-18 Juditha Dwane [email protected] 7914 Eliot Lane 14276 New York 5456-4410-0914-3180 474.00$ 1024 2017-01-19 Susan Ilden [email protected] 25204 Huxley Road 21684 Maryland 3574-8586-6367-9920 83.00$ 1025 2017-01-20 Abbey Triggle [email protected] 47 Debra Pass 74184 Oklahoma 3538-6047-6315-7710 513.00$ 1026 2017-01-21 Zsazsa Dunster [email protected] 7 Gerald Alley 40576 Kentucky 3562-0325-7709-3490 952.00$ 1027 2017-01-22 Grantham Friatt [email protected] 774 Prairieview Circle 29225 South Carolina 3571-1171-9476-8780 942.00$ 1028 2017-01-22 Ross Gaudin [email protected] 3102 Loeprich Trail 68197 Nebraska 5108-7578-4665-2710 572.00$ 1029 2017-01-22 Aluino Drover [email protected] 2717 Northridge Avenue 72199 Arkansas 670999-3171-8848-0000 318.00$ 1030 2017-01-23 Shurlock Braker [email protected] 30783 Jenna Alley 80945 Colorado 6331106-1894-9878-0000 166.00$ 1031 2017-01-24 Glenda Goodbody [email protected] 720 Pierstorff Way 7522 New Jersey 36-0593-2719-1684 412.00$ 1032 2017-01-24 Rollin Reddie [email protected] 09 Gina Park 65810 Missouri 4665-9188-1324-1040 383.00$ 1033 2017-01-26 Dorry Jenks [email protected] 1 Butterfield Road 85210 Arizona 3578-9195-0297-7730 636.00$ 1034 2017-01-26 Patti Emby [email protected] 26 Hoard Drive 91210 California 3585-8243-7506-2470 957.00$ 1035 2017-01-26 Nickie Menauteau [email protected] 035 Derek Junction 92110 California 3580-5488-8443-2070 484.00$ 1036 2017-01-28 Jon Kassman [email protected] 2171 Buena Vista Lane 89125 Nevada 3576-7358-0772-1380 64.00$ 1037 2017-01-29 Pansy Pelz [email protected] 15 Buena Vista Circle 55441 Minnesota 372-3019-6895-3127 498.00$ 1038 2017-01-30 Tedd Kingsley [email protected] 65 Crest Line Terrace 19892 Delaware 633447-9874-0606-9000 574.00$ 1039 2017-01-30 Brana Barnaby [email protected] 8 Mifflin Way 35225 Alabama 4911-0899-8885-2970 296.00$ 1040 2017-01-30 Alysa Knightly [email protected] 19 Talisman Lane 45454 Ohio 6771-5993-8703-9340 713.00$ 1041 2017-01-31 Erina Emmot [email protected] 4 Monument Plaza 32255 Florida 6706465-4418-7633-0000 997.00$ 1042 2017-01-31 Georgy Locket [email protected] 0 Huxley Parkway 37605 Tennessee 30-5661-6604-8367 285.00$ 1043 2017-02-01 Kordula Dobkin [email protected] 47 Golf View Point 94121 California 30-2114-0922-1485 677.00$ 1044 2017-02-01 Clarie Josskowitz [email protected] 1 Park Meadow Lane 39236 Mississippi 3546-0315-7744-3990 363.00$ 1045 2017-02-02 Reube Eatock [email protected] 5 Ruskin Park 97211 Oregon 3584-2997-8675-0280 505.00$ 1046 2017-02-04 Joellyn Bebis [email protected] 68430 Ridgeway Park 38197 Tennessee 5602-2261-7843-1310 917.00$ 1047 2017-02-05 Mavis Frigout [email protected] 5581 Montana Street 80910 Colorado 3579-6425-2725-3150 781.00$ 1048 2017-02-05 Sadye Probetts [email protected] 93 Duke Avenue 27615 North Carolina 3530-3785-5739-3570 464.00$ 1049 2017-02-06 Alberto Deeves [email protected] 39341 Brickson Park Plaza 79940 Texas 5010-1248-9700-6870 901.00$ 1050 2017-02-06 Terrence Missenden [email protected] 36339 Kinsman Center 77060 Texas 3552-8788-4710-8910 966.00$ 1051 2017-02-06 Whitby Mowsdell [email protected] 6235 Lotheville Alley 93591 California 3546-2664-8937-4240 126.00$ 1052 2017-02-07 Everard Wedlock [email protected] 8858 Briar Crest Avenue 36134 Alabama 3583-3948-6685-7240 923.00$ 1053 2017-02-07 Karlee Dowd [email protected] 3074 Northland Hill 15255 Pennsylvania 3589-6791-1914-2140 933.00$ 1054 2017-02-08 Lynett Nial [email protected] 845 Welch Junction 20551 District of Columbia 3579-0213-7287-8220 63.00$ 1055 2017-02-08 Tedman Pledge [email protected] 20 Kensington Parkway 24014 Virginia 3546-6887-0454-7180 242.00$ 1056 2017-02-08 Kim Bambrick [email protected] 4 Towne Avenue 84170 Utah 6374-6917-5337-0770 515.00$ 1057 2017-02-09 Adaline Denholm [email protected] 6010 Browning Park 25775 West Virginia 3586-3802-3692-9110 882.00$ 1058 2017-02-10 Basile Caverhill [email protected] 1288 Rowland Center 23509 Virginia 6304-0277-2034-3630 317.00$ 1059 2017-02-10 Derril Hogsden [email protected] 07852 Pond Place 12255 New York 3555-8671-3458-7860 191.00$ 1060 2017-02-11 Curtice Noden [email protected] 7 Raven Circle 30033 Georgia 374-2885-3140-6071 384.00$ 1061 2017-02-12 Adiana Cocking [email protected] 51 Surrey Center 8619 New Jersey 3566-4963-4956-0470 577.00$ 1062 2017-02-13 Livvy Giacoboni [email protected] 37 Lien Terrace 61614 Illinois 3544-7235-0724-9800 741.00$ 1063 2017-02-13 Bob Nussen [email protected] 7136 Carberry Circle 33610 Florida 4911-5061-6903-3430 846.00$ 1064 2017-02-14 Adrien Curtois [email protected] 946 Lerdahl Crossing 77090 Texas 3557-4641-4387-7530 659.00$ 1065 2017-02-14 Sephira Corradi [email protected] 754 Commercial Park 81005 Colorado 5038713-1328-9363-0000 342.00$ 1066 2017-02-15 Drusilla Bligh [email protected] 98978 Dexter Junction 27105 North Carolina 374-6225-4978-9690 627.00$

How To Build an Index For First and Last Name, Date, ID, and Email

Page 54: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

There is only oneorder on disk

Jump to results

Page 55: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

SpiciesPans

Coffee

Garbage MilkCleaningUpdates

Fruits

Cups

Plates

Stuff we do not need but still do not want to throw away

Christmas Cookie Stuff

Cleaning Stuff

Cleaning Stuff

Cutting boards

Alcohol

BBQ Stuff

Page 56: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Storage:

Date

Amount

Page 57: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Date

Amount

P(X < Start Date)

Storage: …

Page 58: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Date

Amount

P(X < Start Date)

Storage: …

Scan here

Page 59: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Date

Amount

P(X < Start Date)

Storage: …

Scan here Scan here

Page 60: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Date

Amount

P(X < Start Date)

Storage: …

Scan here Scan here Scan here Scan here

Page 61: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Models and Layout Can BeData and Workload Dependent

Page 62: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Initial Results

In-Memory Column Store, Single Threaded, Traditional Data Compression, No SIMD Opt.Queries: Real-world workload: only scan-filter-aggregate (no joins, etc)

101

102

103

Full Colum

n Sc

an

Cluste

red

C

olum

n Index

Redshift-like

Z-O

rder

UB tre

e

Hyp

eroctree

K-d tree

Flood843

144

9.66

204

41.7

14.1

2.88

Perf-Monitoring Workload

Avg

. Que

ry T

ime

(ms)

100

101

102

Full Colum

n Sc

an

92.8

Cluste

red

C

olum

n Index

0.47

Redshift-like

Z-O

rder

10.9

Flood

0.15

Sales DW WorkloadA

vg. Q

uery

Tim

e (m

s)

UB tre

e

Hyp

eroctree

K-d tree

38.1

6.467.34

35.4

R-Tree

Page 63: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Initial Results

In-Memory Column Store, Single Threaded, Traditional Data Compression, No SIMD Opt.Queries: Real-world workload: only scan-filter-aggregate (no joins, etc)

101

102

103

Full Colum

n Sc

an

Cluste

red

C

olum

n Index

Redshift-like

Z-O

rder

UB tre

e

Hyp

eroctree

K-d tree

Flood843

144

9.66

204

41.7

14.1

2.88

Perf-Monitoring Workload

Avg

. Que

ry T

ime

(ms)

100

101

102

Full Colum

n Sc

an

92.8

Cluste

red

C

olum

n Index

0.47

Redshift-like

Z-O

rder

10.9

Flood

0.15

Sales DW WorkloadA

vg. Q

uery

Tim

e (m

s)

UB tre

e

Hyp

eroctree

K-d tree

38.1

6.467.34

35.4

R-Tree

Note: We are still at the beginning!Un

explo

red o

ppor

tuni

ties

GPUs/FPGAs ML Compression

Re-Generating IDs Sparse vs dense storage

Page 64: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 65: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 66: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Is This Key In My Set?

Maybe Yes No No

Maybe No

Is This Key In My Set?

Model

Maybe Yes

36% Space Improvement over Bloom Filter at Same False Positive Rate

Bloom Filter- Approach 1

Page 67: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

No

Maybe Yes

Is This Key In My Set?

Model

Maybe Yes

Sandwiched Bloom Filter

No

Maybe No

Michael Mitzenmacher: A Model for Learned Bloom Filters and Optimizing by Sandwiching. NeurIPS 2018: 462-471

Page 68: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Follow up work

Michael Mitzenmacher: A Model for Learned Bloom Filters and Optimizing by Sandwiching. NeurIPS 2018: 462-471

Jack W. Rae, Sergey Bartunov, Timothy P. Lillicrap: Meta-Learning Neural Bloom Filters. ICML 2019: 5271-5280

Stephen Macke, Alex Beutel, Tim Kraska, Maheswaran Sathiamoorthy, Derek Zhiyuan Cheng, Ed H. Chi: Lifting the Curse of Multidimensional Data with Learned Existence Indexes, ML for Systems workshop at NeurIPS, 2018

….

Page 69: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 70: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 71: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

F

a

bc

nmo

z

UOCANZBM

a

bc

nmo

z

(a) CDF Model Pre-Sorts (b) Compact & local sort

abcmnoz

Sorting

Page 72: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

F

a

bc

nmo

z

UOCANZBM

a

bc

nmo

z

(a) CDF Model Pre-Sorts (b) Compact & local sort

abcmnoz

F

a

bc

nmo

z

UOCANZBM

a

bc

nmo

z

(a) CDF Model Pre-Sorts (b) Compact & local sort

abcmnoz

Sorting

Page 73: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Initial Results

200k 400k 600k 800k 1M

Number of Address Records

Tim

e in

Sec

onds

0.25

0.50

0.75

1.00

1.25std:sort QuickSort Learned Sort

1.5x – 2x

Page 74: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Initial ResultsRu

nnin

g tim

e (s

ec.)

0.0

1.0

2.0

3.0

0M 10M 20M 30M 40M 50M

std::sort Radix sort TimsortLearned Sort (pre-trained) Learned Sort

Runn

ing

time

(sec

.)

0.0

1.0

2.0

3.0

0M 10M 20M 30M 40M 50M

std::sort Radix sort TimsortLearned Sort (pre-trained) Learned Sort

32-bit ints; normal distribution (μ=0, σ=1e6) 128-bit ints; normal distribution (μ=0, σ=1e6)

Page 75: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 76: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 77: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Task

6

Task

5

Task

4

Scheduling

Task Queue

Servers

Task 1

Task 2

Task 2

Task 3

Task 1

Task 1

State-of-the art: Fair Scheduling

Learned scheduler improves average job

completion time by 21% over fair scheduling,

and 19-31% over best hand-crafted heuristics

Page 78: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 79: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 80: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

HashFunctionKey ModelKey

Hash Map

Goal: Reduce Conflicts

Page 81: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

25% - 70% Reduction in Hash-Map Conflicts

% Conflicts Hash Map % Conflicts Model ReductionMap Data 35.3% 07.9% 77.5%Web Data 35.3% 24.7% 30.0%Log Normal 35.4% 25.9% 26.7%

Figure 8: Reduction of Conflicts

micro-seconds), the model execution time is negligible and even small reductions in the conflict rate cansignificantly improve the overall performance. To conclude, learned hash functions are independent of theused Hash-map architecture and depending on the Hash-map architecture their complexity may or may notpay off.

5 Existence Index

The last common index type of DBMS are existence indexes, most importantly Bloom filters, a space efficientprobabilistic data structure to test whether an element is a member of a set. They are commonly used todetermine if a key exists on cold storage. For example, Bigtable uses them to determine if a key is containedin an SSTable [23].

Internally, Bloom filters use a bit array of size m and k hash functions, which each map a key to one ofthe m array positions (see Figure9(a)). To add an element to the set, a key is fed to the k hash-functions andthe bits of the returned positions are set to 1. To test if a key is a member of the set, the key is again fed intothe k hash functions to receive k array positions. If any of the bits at those k positions is 0, the key is not amember of a set. In other words, a Bloom filter does guarantee that there exists no false negatives, but haspotential false positives.

While Bloom filters are highly space-efficient, they can still occupy a significant amount of memory. Forexample for one billion records roughly ⇡ 1.76 Gigabytes are needed. For a FPR of 0.01% we would require⇡ 2.23 Gigabytes. There have been several attempts to improve the efficiency of Bloom filters [52], but thegeneral observation remains.

Yet, if there is some structure to determine what is inside versus outside the set, which can be learned, itmight be possible to construct more efficient representations. Interestingly, for existence indexes for databasesystems, the latency and space requirements are usually quite different than what we saw before. Given thehigh latency to access cold storage (e.g., disk or even band), we can afford more complex models while themain objective is to minimize the space for the index and the number of false positives. We outline twopotential ways to build existence indexes using learned models.

5.1 Learned Bloom filters

While both range and point indexes learn the distribution of keys, existence indexes need to learn a functionthat separates keys from everything else. Stated differently, a good hash function for a point index is one withfew collisions among keys, whereas a good hash function for a Bloom filter would be one that has lots ofcollisions among keys and lots of collisions among non-keys, but few collisions of keys and non-keys. Weconsider below how to learn such a function f and how to incorporate it into an existence index.

While traditional Bloom filters guarantee a false negative rate (FNR) of zero and a specific false positiverate (FPR) for any set of queries chosen a-priori [22], we follow the notion that we want to provide a specificFPR for realistic queries in particular while maintaining a FNR of zero. That is, we measure the FPR over aheldout dataset of queries, as is common in evaluating ML systems [30]. While these definitions differ, webelieve the assumption that we can observe the distribution of queries, e.g., from historical logs, holds in

15

Hash Map - Results

Skip

Page 82: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Independentof Hash-MapArchitecture

Page 83: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash Map – Example Results

Type Time (ns) Utilization Stanford AVX Cuckoo, 4 Byte value 31ns 99%Stanford AVX Cuckoo, 20 Byte record - Standard Hash 43ns 99% Commercial Cuckoo, 20Byte record - Standard Hash 90ns 95% In-place chained Hash-map, 20Byte record, learned hash functions 35ns 100%

Page 84: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 85: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 86: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 87: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

0.5

1

1.5

2

2.5

0 10 20 30 40 50 60 70 80 90 100

Perf

orm

ance R

ela

tive t

o P

ostg

reSQ

L

Episodes

RL (Row Vectors)RL (Histogram)

RL (1-Hot)Postgres

Page 88: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

0.5

1

1.5

2

2.5

0 10 20 30 40 50 60 70 80 90 100

Perf

orm

ance

Rel

ativ

e to

Ora

cle

Episodes

RL (Row Vectors)RL (Histogram)

RL (1-Hot)

OraclePostgreSQL on Oracle

Add reference

Page 89: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 90: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling

Cache Policy

Bloom-Filter

Fundamental Algorithms & Data Structures

DNA-Search SQL Query Optimizer

Nearest Neighbor

DataCubes

Page 91: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

We Have To Rewrite The BibleStart A New

Page 92: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Shared Components and Utilities

Relational Query Processor

Transactional Storage Manager

Client Communication Manager

Process Management

Admission Control

Dispatch and

Scheduling

Local Client ProtocolsRemote Client

Protocols

Query Parsing and Authentication

Query Rewrite

Query Optimization

Plan Executor

DDL and Utility Processing

Access Methods Buffer Manager

Log ManagerLock Manager

Catalog Manager

Memory Manager

Administration, Monitoring, &

Utilities

Replication and Loading Services

Batch Utilities

Database Architecture

Dispatch and

Scheduling

Query Rewrite

Query Optimization

Plan Executor

Access Methods

Joseph M. Hellerstein, Michael Stonebraker, and James Hamilton: Architecture of a Database System. Foundations and Trends in Databases 1(2): 141-259 (2007)

Page 93: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Shared Components and Utilities

Relational Query Processor

Transactional Storage Manager

Client Communication Manager

Process Management

Admission Control

Dispatch and

Scheduling

Local Client ProtocolsRemote Client

Protocols

Query Parsing and Authentication

Query Rewrite

Query Optimization

Plan Executor

DDL and Utility Processing

Access Methods Buffer Manager

Log ManagerLock Manager

Catalog Manager

Memory Manager

Administration, Monitoring, &

Utilities

Replication and Loading Services

Batch Utilities

Database Architecture

Admission Control

Dispatch and

Scheduling

Query Rewrite

Query Optimization

Plan Executor

DDL and Utility Processing

Access Methods

Buffer Manager

Log Manager

Catalog Manager

Memory Manager

Administration, Monitoring, &

Utilities

Replication and Loading Services

Batch Utilities

Local Client Protocols

Remote Client Protocols

Joseph M. Hellerstein, Michael Stonebraker, and James Hamilton: Architecture of a Database System. Foundations and Trends in Databases 1(2): 141-259 (2007)

Page 94: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Instance Optimality

Building a system from scratch for every single user is not economical

Machine Learning makes it possibleand we can leverage decades of ML research

The best performance for every user/application

Page 95: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Instance Optimality

An algorithm B is instance optimal over a class of algorithm A and a database d, if for every choice of a ∈ A:

Ronald Fagin, Amnon Lotem, Moni Naor: Optimal Aggregation Algorithms for Middleware. PODS 2001

Page 96: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Query Optimization

Query Execution

Data Access

- Data Cubes- AQP- Machine Learning

- Sorting- Joins- Aggregation- Scheduling

- Compression- Storage layout - Indexes

- Cardinality Estimation- Cost Model- Join Ordering

Data WorkloadHardware

Model Synthesis

Advanced Analytics

SageDB – Towards an Instance-Optimized Database System

Tim

Kra

ska,

Moh

amm

ad A

lizad

eh,A

lex

Beut

el,E

d H

. Chi

,Ani

Kr

isto

,Gui

llaum

e Le

cler

c,Sa

mue

l Mad

den,

Hon

gziM

ao,V

ikra

m

Nat

han:

Sag

eDB:

A L

earn

ed D

atab

ase

Syst

em.C

IDR

2019

Page 97: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Data Science /Database Systems ApplicationsMobile SystemsNetwork Systems

• Router Table• Rule Engine• Bandwidth Optimization• …

• Index Structures• Storage Manager• Scheduling• …

• Compression• Location Services• Transport Protocols• …

• Data-driven development

• Intelligent Assistants• …

Page 98: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

We Need To Start A New Bible

Page 99: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

We Need To Start New Bibles

Page 100: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

We Have To Start A New Bible• Maria-Florina Balcan, Travis Dick, Tuomas Sandholm, and Ellen Vitercik: Learning to branch. ICML, 2018.• Thodoris Lykouris and Sergei Vassilvitskii: Competitive caching with machine learned advice. ICML, 2018.• Tim Kraska, Alex Beutel, Ed H Chi, Jeffrey Dean, and Neoklis Polyzotis. The case for learned index structures. SIGMOD, 2018.• Michael Mitzenmacher. A model for learned bloom filters and optimizing by sandwiching. NeurIPS, 2018.• Michael Mitzenmacher. Load balancing. unpublished• Manish Purohit, Zoya Svitkina and Ravi Kumar. Improving Online Algorithms via ML Predictions. NeurIPS, 2018.• Luca Baldassarre, Yen-Huan Li, Jonathan Scarlett, Baran G¨ozc¨u, Ilija Bogunovic, and Volkan Cevher. Learning-based compressive subsampling. J-STSP, 2016.• Ashish Bora, Ajil Jalal, Eric Price, and Alexandros G Dimakis. Compressed sensing using generative models. ICML, 2017.• Ali Mousavi, Ankit B Patel, and Richard G Baraniuk. A deep learning approach to structured signal recovery. Allerton, 2015.• Ali Mousavi, Gautam Dasarathy, Richard G. Baraniuk. A Data-Driven and Distributed Approach to Sparse Signal Representation and Recovery. ICLR 2019• Hanjun Dai, Elias Khalil, Yuyu Zhang, Bistra Dilkina, and Le Song. Learning combinatorial optimization algorithms over graphs. NeurIPS, 2017.• H Mao, R Netravali, M Alizadeh. Neural adaptive video streaming with pensieve. SIGCOMM, 2017• H Mao, M Schwarzkopf, SB Venkatakrishnan, Z Meng, M Alizadeh. Learning Scheduling Algorithms for Data Processing Clusters. arXiv preprint arXiv:1810.01963• Hyeji Kim, Yihan Jiang, Sreeram Kannan, Sewoong Oh, Pramod Viswanath. Deepcode: Feedback Codes via Deep Learning. NeurIPS, 2018• Saeed Amizadeh, Sergiy Matusevych, Markus Weimer. Learning To Solve Circuit-SAT: An Unsupervised Differentiable Approach. ICLR, 2019• Daniel Selsam, Matthew Lamm, Benedikt Bünz, Percy Liang, Leonardo de Moura, David L. Dill. Learning a SAT Solver from Single-Bit Supervision. ICLR, 2019• Weiwei Kong, Christopher Liaw, Aranyak Mehta, D. Sivakumar. A new dog learns old tricks: RL finds classic optimization algorithms. ICLR, 2019• Jun-Ting Hsieh, Shengjia Zhao, Stephan Eismann, Lucia Mirabella, Stefano Ermon. Learning Neural PDE Solvers with Convergence Guarantees. ICLR 2019• Morteza Mardani, Qingyun Sun, David Donoho, Vardan Papyan, Hatef Monajemi, Shreyas Vasanawala, John Pauly. Neural Proximal Gradient Descent for Compressive Imaging.

NeurIPS 2018• Andrés Muñoz Medina and Sergei Vassilvitskii. Revenue optimization with approximate bid predictions. NIPS, 2017.• MF Balcan, T Dick, C White. Data-Driven Clustering via Parameterized Lloyd's Families. NeurIPS, 2018• Mislav Balunovic, Pavol Bielik, Martin Vechev. Learning to Solve SMT Formulas. NeurIPS, 2018• Marcelo O. R. Prates, Pedro H. C. Avelar, Henrique Lemos, Luis Lamb, Moshe Vardi. Learning to Solve NP-Complete Problems - A Graph Neural Network for Decision TSP• Jimenez, Daniel A. and Lin, Calvin. Neural Methods for Dynamic Branch Prediction, TOCS 2002• Milad Hashemi, Kevin Swersky, Jamie A. Smith, Grant Ayers, Heiner Litz, Jichuan Chang, Christos Kozyrakis, Parthasarathy Ranganathan: Learning Memory Access Patterns.

arXiv:1803.02329v1, 2018• W. Xiang and H. Zhang and R. Cui and X. Chu and K. Li, W. Zhou. Pavo: A RNN-Based Learned Inverted Index, Supervised or Unsupervised?. IEEE Access, 2019• Harrie Oosterhuis, J. Shane Culpepper, Maarten de Rijke. The Potential of Learned Index Structures for Index Compression. arXiv:1811.06678v1, 2018• Stephen Macke, Alex Beutel, Tim Kraska, Maheswaran Sathiamoorthy, Derek Zhiyuan Cheng, and Ed H. Chi. Lifting the Curse of Multidimensional Data with Learned Existence

Indexes. Workshop on ML for Systems at NeurIPS, 2018• Zhe Wang, Dylan Cashman, Mingwei Li, Jixian Li, Matthew Berger, Joshua A. Levine, Remco Chang, Carlos Scheidegger: NeuralCubes: Deep Representations for Visual Data

Exploration, CoRR abs/1808.08983, 2018…

Page 101: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

Page 102: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

2. CDF: empirical CDF model of the data

Page 103: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

2. CDF: empirical CDF model of the data

3. Oracle: prediction model

Page 104: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

2. CDF: empirical CDF model of the data

3. Oracle: prediction model

4. Full-Model: learning the entire algorithm/data structure

Page 105: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

2. CDF: empirical CDF model of the data

3. Oracle: prediction model

4. Full-Model: learning the entire algorithm/data structure

5. Hybrids: Any combination of the above 4

Page 106: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Hash-MapTree Sorting

Join

Range-FilterMulti-Dim Index

…..

Scheduling Cache Policy

Bloom-Filter

Fundamental Algorithms & Data StructuresOur initial paper Work in Progress

DNA-Search

F(x)

CDF-Synth.

SQL Query Optimizer

Nearest Neighbor

DataCubes

Work in Progress

Oracle -based CDF-basedCDF-based CDF-based Oracle-based CDF-based

CDF-based/Full Full Full Full FullCDF-based

Page 107: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Data System for AI Lab DSAIL@CSAILRe

sea

rch

Are

aSy

stem

Facu

ltyFo

und

ing

Spons

ors

ML

Facu

lty

Page 108: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Conclusion

Page 109: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

General Purpose DB

Page 110: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Instance Optimized

Page 111: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Customized SystemsAdaptation to data and workload

Page 112: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

4.5 Ways to Instance Optimized Algorithms and Data Structures

1. Configure/synthesize traditional algorithm using a model

2. CDF: empirical CDF model of the data

3. Oracle: prediction model

4. Full-Model: learning the entire algorithm/data structure

5. Hybrids: Any combination of the above 4

Page 113: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Can Change the Complexity Class

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

data_array[id - 1000]

idda

tefir

st_n

ame

last

_nam

eem

ail

addr

ess

zip

stat

ecr

edit_

card

_nb

amou

nt10

0020

17-0

1-01

Hoba

rtSp

rack

linhs

prac

klin

0@da

ilym

otio

n.co

m20

565

High

Cro

ssin

g Pl

aza

5637

2M

inne

sota

4405

-697

5-72

85-5

160

611.

00$

1001

2017

-01-

02Bi

llye

Binn

ion

bbin

nion

1@12

3-re

g.co

.uk

3698

Uph

am P

oint

2026

0Di

stric

t of C

olum

bia

3533

-715

0-77

28-9

850

244.

00$

1002

2017

-01-

02Jo

hann

Broc

kley

jbro

ckle

y2@

bizj

ourn

als.

com

2384

4 Ar

tisan

Pla

ce98

516

Was

hing

ton

6759

7-11

93-7

985-

5100

233.

00$

1003

2017

-01-

03Ar

tieM

acM

enam

inam

acm

enam

in3@

hao1

23.c

om62

76 T

oban

Tra

il78

759

Texa

s35

37-4

829-

6134

-500

021

0.00

$ 10

0420

17-0

1-03

Delil

ahO

'Cur

rigan

docu

rrig

an4@

chro

n.co

m86

016

New

Cas

tle A

venu

e72

199

Arka

nsas

3555

-201

7-22

26-5

780

286.

00$

1005

2017

-01-

04G

rett

aW

illgw

ill5@

yelp

.com

0 Do

ttie

Circ

le68

524

Neb

rask

a50

3844

-198

4-20

85-5

000

870.

00$

1006

2017

-01-

04G

ordo

nKi

rsop

pgk

irsop

p6@

utex

as.e

du64

060

Scot

t Par

k20

370

Dist

rict o

f Col

umbi

a63

3332

-189

5-24

14-5

000

687.

00$

1007

2017

-01-

05Be

ndic

kFa

ggbf

agg7

@ar

my.

mil

94 F

lore

nce

Hill

4544

0O

hio

3528

-967

3-18

15-8

420

733.

00$

1008

2017

-01-

05Di

mitr

yBo

yet

dboy

et8@

saku

ra.n

e.jp

3588

6 G

olf P

laza

3006

6G

eorg

ia35

76-6

991-

4041

-317

038

2.00

$ 10

0920

17-0

1-06

Ails

unBe

inke

abei

nke9

@si

.edu

1 Ba

deau

Pla

ce46

295

Indi

ana

5602

2-20

11-8

072-

1400

854.

00$

1010

2017

-01-

07Lo

uHa

llow

slh

allo

wsa

@th

egua

rdia

n.co

m1

Twin

Pin

es Ju

nctio

n91

125

Calif

orni

a56

02-2

364-

4079

-025

015

0.00

$ 10

1120

17-0

1-09

Tiff

ani

Mat

hew

tmat

hew

b@se

attle

times

.com

0456

Mea

dow

Val

e La

ne75

260

Texa

s63

87-6

943-

8910

-458

031

3.00

$ 10

1220

17-0

1-09

Perl

Brid

iepb

ridie

c@hu

bpag

es.c

om07

Blu

este

m Ju

nctio

n33

124

Flor

ida

3539

-866

2-23

97-5

880

558.

00$

1013

2017

-01-

09Ro

sabe

lleBl

asik

rbla

sikd

@de

licio

us.c

om7

Fairf

ield

Pas

s79

699

Texa

s56

02-2

297-

6599

-856

094

1.00

$ 10

1420

17-0

1-10

Meg

giBe

lam

ym

bela

mye

@as

k.co

m09

95 M

anuf

actu

rers

Str

eet

1017

0N

ew Y

ork

3557

-509

4-74

05-8

340

875.

00$

1015

2017

-01-

10Ta

dio

Bald

erst

ontb

alde

rsto

nf@

apac

he.o

rg80

Nov

ick

Road

7526

0Te

xas

6048

5-37

28-7

119-

9300

954.

00$

1016

2017

-01-

11G

iani

naO

xteb

ygo

xteb

yg@

goog

le.p

l72

674

Fulle

r Ave

nue

8950

5N

evad

a4-

0415

-926

8-23

9723

9.00

$ 10

1720

17-0

1-12

Bren

dan

Dood

ybd

oody

h@cr

aigs

list.o

rg87

414

Gol

den

Leaf

Str

eet

1148

0N

ew Y

ork

201-

6348

-412

1-13

1430

8.00

$ 10

1820

17-0

1-13

Conw

ayCo

ombs

ccoo

mbs

i@bl

ogge

r.com

2810

Oak

ridge

Par

k32

859

Flor

ida

3529

-151

4-03

57-9

120

60.0

0$

10

1920

17-0

1-14

Ger

mai

neBe

regb

erej

@br

aves

ites.

com

8280

2 O

akrid

ge P

ark

2004

1Di

stric

t of C

olum

bia

6709

61-0

240-

4054

-900

095

.00

$

1020

2017

-01-

15Da

vide

Tolc

hard

edt

olch

arde

k@re

dcro

ss.o

rg89

Con

tinen

tal A

venu

e79

165

Texa

s50

18-7

748-

4325

-951

013

7.00

$ 10

2120

17-0

1-16

Nig

elAr

thar

gna

rtha

rgl@

gizm

odo.

com

31 M

cbrid

e Po

int

2230

1Vi

rgin

ia56

0225

-696

5-28

70-0

000

496.

00$

1022

2017

-01-

17Ri

ckar

dTr

enho

lmrt

renh

olm

m@

cbsl

ocal

.com

93 H

oepk

er P

arkw

ay70

593

Loui

sian

a35

41-5

241-

5383

-997

076

0.00

$ 10

2320

17-0

1-18

Judi

tha

Dwan

ejd

wan

en@

vk.c

om79

14 E

liot L

ane

1427

6N

ew Y

ork

5456

-441

0-09

14-3

180

474.

00$

1024

2017

-01-

19Su

san

Ilden

sild

eno@

aol.c

om25

204

Huxl

ey R

oad

2168

4M

aryl

and

3574

-858

6-63

67-9

920

83.0

0$

10

2520

17-0

1-20

Abbe

yTr

iggl

eat

riggl

ep@

goog

le.c

om.a

u47

Deb

ra P

ass

7418

4O

klah

oma

3538

-604

7-63

15-7

710

513.

00$

1026

2017

-01-

21Zs

azsa

Duns

ter

zdun

ster

q@na

ture

.com

7 G

eral

d Al

ley

4057

6Ke

ntuc

ky35

62-0

325-

7709

-349

095

2.00

$ 10

2720

17-0

1-22

Gra

ntha

mFr

iatt

gfria

ttr@

seat

tletim

es.c

om77

4 Pr

airie

view

Circ

le29

225

Sout

h Ca

rolin

a35

71-1

171-

9476

-878

094

2.00

$ 10

2820

17-0

1-22

Ross

Gau

din

rgau

dins

@sa

msu

ng.c

om31

02 L

oepr

ich

Trai

l68

197

Neb

rask

a51

08-7

578-

4665

-271

057

2.00

$ 10

2920

17-0

1-22

Alui

noDr

over

adro

vert

@da

gond

esig

n.co

m27

17 N

orth

ridge

Ave

nue

7219

9Ar

kans

as67

0999

-317

1-88

48-0

000

318.

00$

1030

2017

-01-

23Sh

urlo

ckBr

aker

sbra

keru

@hu

ffin

gton

post

.com

3078

3 Je

nna

Alle

y80

945

Colo

rado

6331

106-

1894

-987

8-00

0016

6.00

$ 10

3120

17-0

1-24

Gle

nda

Goo

dbod

ygg

oodb

odyv

@ec

onom

ist.c

om72

0 Pi

erst

orff

Way

7522

New

Jers

ey36

-059

3-27

19-1

684

412.

00$

1032

2017

-01-

24Ro

llin

Redd

ierr

eddi

ew@

tinyp

ic.c

om09

Gin

a Pa

rk65

810

Mis

sour

i46

65-9

188-

1324

-104

038

3.00

$ 10

3320

17-0

1-26

Dorr

yJe

nks

djen

ksx@

virg

inia

.edu

1 Bu

tter

field

Roa

d85

210

Ariz

ona

3578

-919

5-02

97-7

730

636.

00$

1034

2017

-01-

26Pa

tti

Emby

pem

byy@

wea

ther

.com

26 H

oard

Driv

e91

210

Calif

orni

a35

85-8

243-

7506

-247

095

7.00

$ 10

3520

17-0

1-26

Nic

kie

Men

aute

aunm

enau

teau

z@eb

ay.c

om03

5 De

rek

Junc

tion

9211

0Ca

lifor

nia

3580

-548

8-84

43-2

070

484.

00$

1036

2017

-01-

28Jo

nKa

ssm

anjk

assm

an10

@i2

i.jp

2171

Bue

na V

ista

Lan

e89

125

Nev

ada

3576

-735

8-07

72-1

380

64.0

0$

10

3720

17-0

1-29

Pans

yPe

lzpp

elz1

1@w

ebed

en.c

o.uk

15 B

uena

Vis

ta C

ircle

5544

1M

inne

sota

372-

3019

-689

5-31

2749

8.00

$ 10

3820

17-0

1-30

Tedd

King

sley

tkin

gsle

y12@

arm

y.m

il65

Cre

st L

ine

Terr

ace

1989

2De

law

are

6334

47-9

874-

0606

-900

057

4.00

$ 10

3920

17-0

1-30

Bran

aBa

rnab

ybb

arna

by13

@go

o.ne

.jp8

Miff

lin W

ay35

225

Alab

ama

4911

-089

9-88

85-2

970

296.

00$

1040

2017

-01-

30Al

ysa

Knig

htly

akni

ghtly

14@

slid

esha

re.n

et19

Tal

ism

an L

ane

4545

4O

hio

6771

-599

3-87

03-9

340

713.

00$

1041

2017

-01-

31Er

ina

Emm

otee

mm

ot15

@hi

bu.c

om4

Mon

umen

t Pla

za32

255

Flor

ida

6706

465-

4418

-763

3-00

0099

7.00

$ 10

4220

17-0

1-31

Geo

rgy

Lock

etgl

ocke

t16@

saku

ra.n

e.jp

0 Hu

xley

Par

kway

3760

5Te

nnes

see

30-5

661-

6604

-836

728

5.00

$ 10

4320

17-0

2-01

Kord

ula

Dobk

inkd

obki

n17@

prlo

g.or

g47

Gol

f Vie

w P

oint

9412

1Ca

lifor

nia

30-2

114-

0922

-148

567

7.00

$ 10

4420

17-0

2-01

Clar

ieJo

ssko

witz

cjos

skow

itz18

@de

.vu

1 Pa

rk M

eado

w L

ane

3923

6M

issi

ssip

pi35

46-0

315-

7744

-399

036

3.00

$ 10

4520

17-0

2-02

Reub

eEa

tock

reat

ock1

9@so

up.io

5 Ru

skin

Par

k97

211

Ore

gon

3584

-299

7-86

75-0

280

505.

00$

1046

2017

-02-

04Jo

elly

nBe

bis

jbeb

is1a

@st

udio

pres

s.co

m68

430

Ridg

eway

Par

k38

197

Tenn

esse

e56

02-2

261-

7843

-131

091

7.00

$ 10

4720

17-0

2-05

Mav

isFr

igou

tm

frig

out1

b@ca

.gov

5581

Mon

tana

Str

eet

8091

0Co

lora

do35

79-6

425-

2725

-315

078

1.00

$ 10

4820

17-0

2-05

Sady

ePr

obet

tssp

robe

tts1

c@la

st.fm

93 D

uke

Aven

ue27

615

Nor

th C

arol

ina

3530

-378

5-57

39-3

570

464.

00$

1049

2017

-02-

06Al

bert

oDe

eves

adee

ves1

d@us

trea

m.tv

3934

1 Br

icks

on P

ark

Plaz

a79

940

Texa

s50

10-1

248-

9700

-687

090

1.00

$ 10

5020

17-0

2-06

Terr

ence

Mis

send

entm

isse

nden

1e@

bigl

obe.

ne.jp

3633

9 Ki

nsm

an C

ente

r77

060

Texa

s35

52-8

788-

4710

-891

096

6.00

$ 10

5120

17-0

2-06

Whi

tby

Mow

sdel

lw

mow

sdel

l1f@

ifeng

.com

6235

Lot

hevi

lle A

lley

9359

1Ca

lifor

nia

3546

-266

4-89

37-4

240

126.

00$

1052

2017

-02-

07Ev

erar

dW

edlo

ckew

edlo

ck1g

@bl

ueho

st.c

om88

58 B

riar C

rest

Ave

nue

3613

4Al

abam

a35

83-3

948-

6685

-724

092

3.00

$ 10

5320

17-0

2-07

Karle

eDo

wd

kdow

d1h@

mai

l.ru

3074

Nor

thla

nd H

ill15

255

Penn

sylv

ania

3589

-679

1-19

14-2

140

933.

00$

1054

2017

-02-

08Ly

nett

Nia

lln

ial1

i@el

egan

tthe

mes

.com

845

Wel

ch Ju

nctio

n20

551

Dist

rict o

f Col

umbi

a35

79-0

213-

7287

-822

063

.00

$

1055

2017

-02-

08Te

dman

Pled

getp

ledg

e1j@

sun.

com

20 K

ensi

ngto

n Pa

rkw

ay24

014

Virg

inia

3546

-688

7-04

54-7

180

242.

00$

1056

2017

-02-

08Ki

mBa

mbr

ick

kbam

bric

k1k@

inde

pend

ent.c

o.uk

4 To

wne

Ave

nue

8417

0U

tah

6374

-691

7-53

37-0

770

515.

00$

1057

2017

-02-

09Ad

alin

eDe

nhol

mad

enho

lm1l

@oa

kley

.com

6010

Bro

wni

ng P

ark

2577

5W

est V

irgin

ia35

86-3

802-

3692

-911

088

2.00

$ 10

5820

17-0

2-10

Basi

leCa

verh

illbc

aver

hill1

m@

post

erou

s.co

m12

88 R

owla

nd C

ente

r23

509

Virg

inia

6304

-027

7-20

34-3

630

317.

00$

1059

2017

-02-

10De

rril

Hogs

den

dhog

sden

1n@

moz

illa.

com

0785

2 Po

nd P

lace

1225

5N

ew Y

ork

3555

-867

1-34

58-7

860

191.

00$

1060

2017

-02-

11Cu

rtic

eN

oden

cnod

en1o

@ye

llow

book

.com

7 Ra

ven

Circ

le30

033

Geo

rgia

374-

2885

-314

0-60

7138

4.00

$ 10

6120

17-0

2-12

Adia

naCo

ckin

gac

ocki

ng1p

@m

ail.r

u51

Sur

rey

Cent

er86

19N

ew Je

rsey

3566

-496

3-49

56-0

470

577.

00$

1062

2017

-02-

13Li

vvy

Gia

cobo

nilg

iaco

boni

1q@

blog

talk

radi

o.co

m37

Lie

n Te

rrac

e61

614

Illin

ois

3544

-723

5-07

24-9

800

741.

00$

1063

2017

-02-

13Bo

bN

usse

nbn

usse

n1r@

tops

y.co

m71

36 C

arbe

rry

Circ

le33

610

Flor

ida

4911

-506

1-69

03-3

430

846.

00$

1064

2017

-02-

14Ad

rien

Curt

ois

acur

tois

1s@

arm

y.m

il94

6 Le

rdah

l Cro

ssin

g77

090

Texa

s35

57-4

641-

4387

-753

065

9.00

$ 10

6520

17-0

2-14

Seph

iraCo

rrad

isc

orra

di1t

@go

ogle

.cn

754

Com

mer

cial

Par

k81

005

Colo

rado

5038

713-

1328

-936

3-00

0034

2.00

$ 10

6620

17-0

2-15

Drus

illa

Blig

hdb

ligh1

u@fa

cebo

ok.c

om98

978

Dext

er Ju

nctio

n27

105

Nor

th C

arol

ina

374-

6225

-497

8-96

9062

7.00

$

data_array[model(date)]

#Ord

ers

Date

Page 114: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Big potential for GPUs/FPGAs/TPUs

Page 115: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Open Challenges

• Development• Benchmarks• Type of Models• Other algorithms• Adaptation to changes• Inserts/Updates• Complexity Analysis and Robustness Guarantees• Predictive Modeling• ….

Page 116: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How We Do Software Development Has To Change Fundamentally

Page 117: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

How We Do Software Development Has To Change Fundamentally

Page 118: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Open Challenges

• Development• Benchmarks• Type of Models• Other algorithms• Adaptation to changes• Inserts/Updates• Complexity Analysis and Robustness Guarantees• Predictive Modeling• ….

Page 119: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road

Learned Algorithms and Data Structures• ML-Enhanced Algorithms, Data Structures, Systems Components Are On The

Rise

• They Provide A New Way To Build Highly Customized Systems (i.e., Instance-Optimized Systems)

• Many Data-Related Problems Can Be Reduced to Learning A CDF model

• We Found That RMIs (Mixture Of Experts With Very Simple Models) Are A Very powerful Building Block

• What Makes The Approach So Powerful Is The Use Of Continuous Functions And Easy To Vectorized Math Operations (the HW has changed!!!)

Page 120: Part 2 -Learned Data Structures and Algorithmspeople.csail.mit.edu/kraska/pub/sigmod19tutorialpart2.pdf · 1015 2017-01-10 Tadio Balderston tbalderstonf@apache.org 80 Novick Road