Revisiting Code Similarity Evaluation with Abstract Syntax Tree Edit Distance

arXiv:2404.08817v1 Announce Type: new
Abstract: This paper revisits recent code similarity evaluation metrics, particularly focusing on the application of Abstract Syntax Tree (AST) editing distance in diverse programming languages. In particular, we explore the usefulness of these metrics and compare them to traditional sequence similarity metrics. Our experiments showcase the effectiveness of AST editing distance in capturing intricate code structures, revealing a high correlation with established metrics. Furthermore, we explore the strengths and weaknesses of AST editing distance and prompt-based …

abstract application arxiv code cs.cl cs.pl cs.se diverse edit editing evaluation evaluation metrics explore languages metrics paper programming programming languages syntax them tree type