ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain Modeling

arXiv:2404.07031v1 Announce Type: new
Abstract: Every day, countless surgeries are performed worldwide, each within the distinct settings of operating rooms (ORs) that vary not only in their setups but also in the personnel, tools, and equipment used. This inherent diversity poses a substantial challenge for achieving a holistic understanding of the OR, as it requires models to generalize beyond their initial training datasets. To reduce this gap, we introduce ORacle, an advanced vision-language model designed for holistic OR domain modeling, …

abstract arxiv challenge cs.cv diversity domain equipment every knowledge language language models modeling oracle tools type understanding vision vision-language models