Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost

arXiv:2403.07687v1 Announce Type: cross
Abstract: Current foundation models have shown impressive performance across various tasks. However, several studies have revealed that these models are not effective for everyone due to the imbalanced geographical and economic representation of the data used in the training process. Most of this data comes from Western countries, leading to poor results for underrepresented countries. To address this issue, more data needs to be collected from these countries, but the cost of annotation can be a …

annotation annotations arxiv balance budget cost cs.ai cs.cl cs.cv data geo performance type