TransGPT: Multi-modal Generative Pre-trained Transformer for Transportation

Natural language processing (NLP) is a key component of intelligent transportation systems (ITS), but it faces many challenges in the transportation domain, such as domain-specific knowledge and data, and multi-modal inputs and outputs. This paper presents TransGPT, a novel (multi-modal) large language model for the transportation domain, which consists of two independent variants: TransGPT-SM for single-modal data and TransGPT-MM for multi-modal data. TransGPT-SM is finetuned on a single-modal Transportation dataset (STD) that contains textual data from various sources in the …

challenges cs.ai cs.cl data domain generative generative pre-trained transformer independent inputs intelligent intelligent transportation key knowledge language language model language processing large language large language model modal multi-modal natural natural language natural language processing nlp novel paper processing systems transformer transportation variants