I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learning. (arXiv:2208.09828v3 [cs.CL] UPDATED)

Knowledge graph (KG) embedding seeks to learn vector representations for
entities and relations. Conventional models reason over graph structures, but
they suffer from the issues of graph incompleteness and long-tail entities.
Recent studies have used pre-trained language models to learn embeddings based
on the textual information of entities and relations, but they cannot take
advantage of graph structures. In the paper, we show empirically that these two
kinds of features are complementary for KG embedding. To this end, we propose …

arxiv distillation embedding graph knowledge knowledge graph