MolNexTR: A Generalized Deep Learning Model for Molecular Image Recognition

arXiv:2403.03691v1 Announce Type: new
Abstract: In the field of chemical structure recognition, the task of converting molecular images into graph structures and SMILES string stands as a significant challenge, primarily due to the varied drawing styles and conventions prevalent in chemical literature. To bridge this gap, we proposed MolNexTR, a novel image-to-graph deep learning model that collaborates to fuse the strengths of ConvNext, a powerful Convolutional Neural Network variant, and Vision-TRansformer. This integration facilitates a more nuanced extraction of both …

abstract arxiv bridge challenge cs.ai cs.cv deep learning gap generalized graph image image recognition images literature recognition string type