Table Pre-training: A Survey on Model Architectures, Pretraining Objectives, and Downstream Tasks. (arXiv:2201.09745v2 [cs.CL] UPDATED)

Since a vast number of tables can be easily collected from web pages,
spreadsheets, PDFs, and various other document types, a flurry of table
pre-training frameworks have been proposed following the success of text and
images, and they have achieved new state-of-the-arts on various tasks such as
table question answering, table type recognition, column relation
classification, table search, formula prediction, etc. To fully use the
supervision signals in unlabeled tables, a variety of pre-training objectives
have been designed and evaluated, …

arxiv survey training