DeepKnowledge: Generalisation-Driven Deep Learning Testing

arXiv:2403.16768v1 Announce Type: new
Abstract: Despite their unprecedented success, DNNs are notoriously fragile to small shifts in data distribution, demanding effective testing techniques that can assess their dependability. Despite recent advances in DNN testing, there is a lack of systematic testing approaches that assess the DNN's capability to generalise and operate comparably beyond data in their training distribution. We address this gap with DeepKnowledge, a systematic testing methodology for DNN-based systems founded on the theory of knowledge generalisation, which aims …

abstract advances arxiv beyond capability cs.ai cs.lg cs.se data deep learning distribution dnn small success testing type