Zero-shot Object-Level OOD Detection with Context-Aware Inpainting

Machine learning algorithms are increasingly provided as black-box cloud services or pre-trained models, without access to their training data. This motivates the problem of zero-shot out-of-distribution (OOD) detection. Concretely, we aim to detect OOD objects that do not belong to the classifier's label set but are erroneously classified as in-distribution (ID) objects. Our approach, RONIN, uses an off-the-shelf diffusion model to replace detected objects with inpainting. RONIN conditions the inpainting process with the predicted ID label, drawing the input object …

aim algorithms box classifier cloud cloud services context cs.cv cs.lg data detection distribution inpainting machine machine learning machine learning algorithms objects pre-trained models services set training training data zero-shot