Decomposing and Editing Predictions by Modeling Model Computation

arXiv:2404.11534v1 Announce Type: cross
Abstract: How does the internal computation of a machine learning model transform inputs into predictions? In this paper, we introduce a task called component modeling that aims to address this question. The goal of component modeling is to decompose an ML model's prediction in terms of its components -- simple functions (e.g., convolution filters, attention heads) that are the "building blocks" of model computation. We focus on a special case of this task, component attribution, where …

arxiv computation cs.ai cs.lg editing modeling predictions stat.ml type