Outline of an Independent Systematic Blackbox Test for ML-based Systems. (arXiv:2401.17062v1 [cs.LG])

This article proposes a test procedure that can be used to test ML models and
ML-based systems independently of the actual training process. In this way, the
typical quality statements such as accuracy and precision of these models and
system can be verified independently, taking into account their black box
character and the immanent stochastic properties of ML models and their
training data. The article presents first results from a set of test
experiments and suggest extensions to existing test …

accuracy article arxiv blackbox cs.lg independent ml models precision process quality systems test training