Is it safe to cross? Interpretable Risk Assessment with GPT-4V for Safety-Aware Street Crossing

Safely navigating street intersections is a complex challenge for blind and low-vision individuals, as it requires a nuanced understanding of the surrounding context - a task heavily reliant on visual cues. Traditional methods for assisting in this decision-making process often fall short, lacking the ability to provide a comprehensive scene analysis and safety level. This paper introduces an innovative approach that leverages large multimodal models (LMMs) to interpret complex street crossing scenes, offering a potential advancement over conventional traffic signal …

assessment blind challenge context cs.ai cs.cv decision gpt gpt-4v low making process risk risk assessment safety street understanding vision visual visual cues