Model Stitching and Visualization How GAN Generators can Invert Networks in Real-Time

arXiv:2302.02181v2 Announce Type: replace-cross
Abstract: In this work, we propose a fast and accurate method to reconstruct activations of classification and semantic segmentation networks by stitching them with a GAN generator utilizing a 1x1 convolution. We test our approach on images of animals from the AFHQ wild dataset, ImageNet1K, and real-world digital pathology scans of stained tissue samples. Our results show comparable performance to established gradient descent methods but with a processing time that is two orders of magnitude faster, …

abstract animals arxiv classification convolution cs.ai cs.cv cs.lg dataset eess.iv gan generator generators images networks real-time segmentation semantic stitching test them type visualization work