Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts. (arXiv:2210.13836v1 [cs.CL])

This work demonstrates that Legal Judgement Prediction systems without
expert-informed adjustments can be vulnerable to shallow, distracting surface
signals that arise from corpus construction, case distribution, and confounding
factors. To mitigate this, we use domain expertise to strategically identify
statistically predictive but legally irrelevant information. We adopt
adversarial training to prevent the system from relying on it. We evaluate our
deconfounded models by employing interpretability techniques and comparing to
expert annotations. Quantitative experiments and qualitative analysis show that
our deconfounded …

alignment arxiv cases court experts human human rights judgment legal prediction rights