Advancing Deep Active Learning & Data Subset Selection: Unifying Principles with Information-Theory Intuitions

At its core, this thesis aims to enhance the practicality of deep learning by improving the label and training efficiency of deep learning models. To this end, we investigate data subset selection techniques, specifically active learning and active sampling, grounded in information-theoretic principles. Active learning improves label efficiency, while active sampling enhances training efficiency. Supervised deep learning models often require extensive training with labeled data. Label acquisition can be expensive and time-consuming, and training large models is resource-intensive, hindering the …

active learning core cs.it cs.lg data deep learning efficiency information information-theory math.it sampling theory thesis training