GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes

arXiv:2305.16037v4 Announce Type: replace
Abstract: GenerateCT, the first approach to generating 3D medical imaging conditioned on free-form medical text prompts, incorporates a text encoder and three key components: a novel causal vision transformer for encoding 3D CT volumes, a text-image transformer for aligning CT and text tokens, and a text-conditional super-resolution diffusion model. Given the absence of directly comparable methods in 3D medical imaging, we established baselines with cutting-edge methods to demonstrate our method's effectiveness. GenerateCT significantly outperforms these methods …

abstract arxiv causal components cs.cv diffusion encoder encoding form free image imaging key medical medical imaging novel prompts text text-image tokens transformer type vision