Tencent Introduces VoCo-LLaMA for Compressing Visual Information with LLMs

By leveraging attention distillation, VoCo-LLaMA distils how large language models understand uncompressed vision tokens into their processing of the compact VoCo tokens.

ai news & update attention compact distillation information language language models large language large language models llama llms processing tencent tokens vision visual