Demonstration of MaskSearch: Efficiently Querying Image Masks for Machine Learning Workflows

arXiv:2404.06563v1 Announce Type: cross
Abstract: We demonstrate MaskSearch, a system designed to accelerate queries over databases of image masks generated by machine learning models. MaskSearch formalizes and accelerates a new category of queries for retrieving images and their corresponding masks based on mask properties, which support various applications, from identifying spurious correlations learned by models to exploring discrepancies between model saliency and human attention. This demonstration makes the following contributions:(1) the introduction of MaskSearch's graphical user interface (GUI), which enables …

abstract applications arxiv cs.db cs.lg cs.mm databases generated image images machine machine learning machine learning models machine learning workflows masks queries support type workflows