Algorithmic encoding of protected characteristics in image-based models for disease detection. (arXiv:2110.14755v4 [cs.LG] UPDATED)

It has been rightfully emphasized that the use of AI for clinical decision
making could amplify health disparities. An algorithm may encode protected
characteristics, and then use this information for making predictions due to
undesirable correlations in the (historical) training data. It remains unclear
how we can establish whether such information is actually used. Besides the
scarcity of data from underserved populations, very little is known about how
dataset biases manifest in predictive models and how this may result in …

arxiv detection disease encoding image lg