Apple researchers publish a paper on Ferret-UI, a multimodal LLM tailored for enhanced understanding of mobile UI screens (Malcolm Owen/AppleInsider)

Malcolm Owen / AppleInsider:

Apple researchers publish a paper on Ferret-UI, a multimodal LLM tailored for enhanced understanding of mobile UI screens  —  Apple's Ferret LLM could help allow Siri to understand the layout of apps in an iPhone display, potentially increasing the capabilities of Apple's digital assistant.

apple apps ferret iphone llm mobile multimodal paper researchers siri understanding