PEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure

arXiv:2404.13645v1 Announce Type: new
Abstract: In this work, we propose a novel tree-based explanation technique, PEACH (Pretrained-embedding Explanation Across Contextual and Hierarchical Structure), that can explain how text-based documents are classified by using any pretrained contextual embeddings in a tree-based human-interpretable manner. Note that PEACH can adopt any contextual embeddings of the PLMs as a training input for the decision tree. Using the proposed PEACH, we perform a comprehensive analysis of several contextual embeddings on nine different NLP text classification …

abstract arxiv cs.cl documents embedding embeddings hierarchical human novel text tree type work