Advancing Multimodal Medical Capabilities of Gemini

arXiv:2405.03162v1 Announce Type: cross
Abstract: Many clinical tasks require an understanding of specialized data, such as medical images and genomics, which is not typically found in general-purpose large multimodal models. Building upon Gemini's multimodal models, we develop several models within the new Med-Gemini family that inherit core capabilities of Gemini and are optimized for medical use via fine-tuning with 2D and 3D radiology, histopathology, ophthalmology, dermatology and genomic data. Med-Gemini-2D sets a new standard for AI-based chest X-ray (CXR) report …

abstract arxiv building capabilities clinical core cs.ai cs.cl cs.cv cs.lg data family found gemini general genomics images large multimodal models medical multimodal multimodal models tasks type understanding