Transformer-Aided Semantic Communications

arXiv:2405.01521v1 Announce Type: cross
Abstract: The transformer structure employed in large language models (LLMs), as a specialized category of deep neural networks (DNNs) featuring attention mechanisms, stands out for their ability to identify and highlight the most relevant aspects of input data. Such a capability is particularly beneficial in addressing a variety of communication challenges, notably in the realm of semantic communication where proper encoding of the relevant data is critical especially in systems with limited bandwidth. In this work, …

abstract arxiv attention attention mechanisms capability challenges communication communications cs.cv cs.it cs.lg data eess.sp highlight identify language language models large language large language models llms math.it networks neural networks semantic transformer type