Beyond ESM2: Graph-Enhanced Protein Sequence Modeling with Efficient Clustering

arXiv:2404.15805v1 Announce Type: cross
Abstract: Proteins are essential to life's processes, underpinning evolution and diversity. Advances in sequencing technology have revealed millions of proteins, underscoring the need for sophisticated pre-trained protein models for biological analysis and AI development. Facebook's ESM2, the most advanced protein language model to date, leverages a masked prediction task for unsupervised learning, crafting amino acid representations with notable biochemical accuracy. Yet, it lacks in delivering functional protein insights, signaling an opportunity for enhancing representation quality.Our study …

abstract advanced advances ai development analysis arxiv beyond clustering cs.lg development diversity evolution facebook graph language language model life modeling processes protein proteins q-bio.bm sequencing technology type