Assessing the potential of AI-assisted pragmatic annotation: The case of apologies

arXiv:2305.08339v4 Announce Type: replace
Abstract: Certain forms of linguistic annotation, like part of speech and semantic tagging, can be automated with high accuracy. However, manual annotation is still necessary for complex pragmatic and discursive features that lack a direct mapping to lexical forms. This manual process is time-consuming and error-prone, limiting the scalability of function-to-form approaches in corpus linguistics. To address this, our study explores automating pragma-discursive corpus annotation using large language models (LLMs). We compare ChatGPT, the Bing chatbot, …

abstract accuracy annotation arxiv automated case cs.ai cs.cl features forms however mapping part process semantic speech tagging type