Towards Cross-Table Masked Pretraining for Web Data Mining

Tabular data pervades the landscape of the World Wide Web, playing a foundational role in the digital architecture that underpins online information. Given the recent influence of large-scale pretrained models like ChatGPT and SAM across various domains, exploring the application of pretraining techniques for mining tabular data on the web has emerged as a highly promising research direction. Indeed, there have been some recent works around this topic where most (if not all) of them are limited in the scope …

application architecture chatgpt cs.lg data data mining digital domains influence information landscape mining playing pretrained models pretraining role sam scale table tabular tabular data web world world wide web