Embed Size (px)
Citation preview
Part 2: Theory of Active LearningGeneral Case
• Disagreement-Based Agnostic Active Learning
• Disagreement Coefficient
• Sample Complexity Bounds
Tutorial on Active Learning: Theory to Practice
Steve HannekeToyota Technological Institute at [email protected]
Robert NowakUniversity of Wisconsin - [email protected]
Agnostic Active Learning
Uniform Bernstein Inequality
Agnostic Active Learning Balcan, Beygelzimer, & Langford (2006)
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Agnostic Active Learning
Sample Complexity Analysis Hanneke (2007,…)
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
f*
Sample Complexity Analysis
f*
f B(f*,r)
Sample Complexity Analysis
f*
DIS(B(f*,r))
Sample Complexity Analysis
f*
DIS(B(f*,r))
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Sample Complexity Analysis
Stopping Criterion
Simpler Agnostic Active Learning Hsu (2010,…)
Surrogate Loss Hanneke & Yang (2012)
Importance-Weighted Active Learning Beygelzimer, Dasgupta, Langford (2009)
Importance-Weighted Active Learning Beygelzimer, Dasgupta, Langford (2009)
Questions?
![A tutorial on active learning - Machine Learning (Theory)active_learning/active_learning_icml09.pdf · Active learning example: drug design [Warmuth et al 03] Goal: find compounds](https://img.pdfslide.us/doc/110x75/5ec5197b775d7944a73948ef/a-tutorial-on-active-learning-machine-learning-theory-activelearningactivelearning.jpg)
