Agnostic Active Learning Is Always Better Than Passive Learning

TL;DR

We prove that for every concept class, the optimal query complexity of agnostic active learning is strictly smaller than the sample complexity of agnostic passive learning.

Opening excerpt from the authors’ abstract. source