Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review. (arXiv:2105.01044v2 [cs.IR] UPDATED)

Technology-assisted review (TAR) refers to iterative active learning
workflows for document review in high recall retrieval (HRR) tasks. TAR
research and most commercial TAR software have applied linear models such as
logistic regression to lexical features. Transformer-based models with
supervised tuning are known to improve effectiveness on many text
classification tasks, suggesting their use in TAR. We indeed find that the
pre-trained BERT model reduces review cost by 10% to 15% in TAR workflows
simulated on the RCV1-v2 newswire collection. …

arxiv bert review technology