Multi-Scale Protein Language Model for Unified Molecular Modeling

arXiv:2403.12995v1 Announce Type: cross
Abstract: Protein language models have demonstrated significant potential in the field of protein engineering. However, current protein language models primarily operate at the residue scale, which limits their ability to provide information at the atom level. This limitation prevents us from fully exploiting the capabilities of protein language models for applications involving both proteins and small molecules. In this paper, we propose ms-ESM (multi-scale ESM), a novel approach that enables multi-scale unified molecular modeling. ms-ESM achieves …

abstract arxiv atom capabilities cs.ce cs.lg current engineering however information language language model language models modeling protein protein engineering q-bio.bm scale type