HierCode: A Lightweight Hierarchical Codebook for Zero-shot Chinese Text Recognition

arXiv:2403.13761v1 Announce Type: new
Abstract: Text recognition, especially for complex scripts like Chinese, faces unique challenges due to its intricate character structures and vast vocabulary. Traditional one-hot encoding methods struggle with the representation of hierarchical radicals, recognition of Out-Of-Vocabulary (OOV) characters, and on-device deployment due to their computational intensity. To address these challenges, we propose HierCode, a novel and lightweight codebook that exploits the innate hierarchical nature of Chinese characters. HierCode employs a multi-hot encoding strategy, leveraging hierarchical binary tree …

abstract arxiv challenges characters chinese computational cs.cv deployment encoding hierarchical hot intensity recognition representation scripts struggle text type vast zero-shot