Nougat: Neural Optical Understanding for Academic Documents - Meta AI 2023

Project page: [https://facebookresearch.github.io/nougat/](https://facebookresearch.github.io/nougat/) Includes example Paper conversions!

Paper: [https://arxiv.org/abs/2308.13418](https://arxiv.org/abs/2308.13418)

Github: [https://github.com/facebookresearch/nougat](https://github.com/facebookresearch/nougat)

Abstract:

>Scientific knowledge is predominantly stored in books and scientific journals, often in the form of PDFs. However, the PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural Optical Understanding for Academic Documents), a Visual Transformer model that performs an Optical Character Recognition (OCR) task for processing scientific documents into a markup language, and demonstrate the effectiveness of our model on …

abstract academic books character recognition documents format information knowledge leads loss machinelearningnews ocr optical character recognition pdf processing recognition semantic transformer transformer model understanding