MedCycle: Unpaired Medical Report Generation via Cycle-Consistency

arXiv:2403.13444v1 Announce Type: new
Abstract: Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding space for images and reports, necessitating a specific labeling schema for both. We introduce an innovative approach that eliminates the need for consistent labeling schemas, thereby enhancing data accessibility and enabling the use of incompatible datasets. This approach is based on cycle-consistent mapping …

abstract arxiv challenge cs.cv data embedding image images labeling medical ray report reports schema space training type via x-ray