HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View

arXiv:2311.15478v2 Announce Type: replace
Abstract: We present HawkI, for synthesizing aerial-view images from text and an exemplar image, without any additional multi-view or 3D information for finetuning or at inference. HawkI uses techniques from classical computer vision and information theory. It seamlessly blends the visual features from the input image within a pretrained text-to-2Dimage stable diffusion model with a test-time optimization process for a careful bias-variance trade-off, which uses an Inverse Perspective Mapping (IPM) homography transformation to provide subtle cues …

aerial arxiv cs.cv free guidance homography image information type view