all AI news
OPAL: Ontology-Aware Pretrained Language Model for End-to-End Task-Oriented Dialogue. (arXiv:2209.04595v1 [cs.CL])
cs.CL updates on arXiv.org arxiv.org
This paper presents an ontology-aware pretrained language model (OPAL) for
end-to-end task-oriented dialogue (TOD). Unlike chit-chat dialogue models,
task-oriented dialogue models fulfill at least two task-specific modules:
dialogue state tracker (DST) and response generator (RG). The dialogue state
consists of the domain-slot-value triples, which are regarded as the user's
constraints to search the domain-related databases. The large-scale
task-oriented dialogue data with the annotated structured dialogue state
usually are inaccessible. It prevents the development of the pretrained
language model for the …
arxiv language language model ontology pretrained language model