Part 2: Theory of Active Learning General Case

Part 2: Theory of Active LearningGeneral Case

• Disagreement-Based Agnostic Active Learning

• Disagreement Coefficient

• Sample Complexity Bounds

Tutorial on Active Learning: Theory to Practice

Steve HannekeToyota Technological Institute at Chicagosteve.hanneke@gmail.com

Robert NowakUniversity of Wisconsin - Madisonrdnowak@wisc.edu

Agnostic Active Learning

Uniform Bernstein Inequality

Agnostic Active Learning Balcan, Beygelzimer, & Langford (2006)

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Agnostic Active Learning

Sample Complexity Analysis Hanneke (2007,…)

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

f*

Sample Complexity Analysis

f*

f B(f*,r)

Sample Complexity Analysis

f*

DIS(B(f*,r))

Sample Complexity Analysis

f*

DIS(B(f*,r))

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Sample Complexity Analysis

Stopping Criterion

Simpler Agnostic Active Learning Hsu (2010,…)

Surrogate Loss Hanneke & Yang (2012)

Importance-Weighted Active Learning Beygelzimer, Dasgupta, Langford (2009)

Importance-Weighted Active Learning Beygelzimer, Dasgupta, Langford (2009)

Questions?