SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models

arXiv:2404.14755v1 Announce Type: cross
Abstract: With the continuous advancement of vision language models (VLMs) technology, remarkable research achievements have emerged in the dermatology field, the fourth most prevalent human disease category. However, despite these advancements, VLM still faces "hallucination" in dermatological diagnosis, and due to the inherent complexity of dermatological conditions, existing tools offer relatively limited support for user comprehension. We propose SkinGEN, a diagnosis-to-generation framework that leverages the stable diffusion (SD) method to generate reference demonstrations from diagnosis results …

abstract advancement arxiv complexity continuous cs.ai cs.cv cs.hc cs.mm dermatology diagnosis disease framework hallucination however human interactive language language models research technology type vision vision-language vision-language models vlm vlms