By Their Fruits You Will Know Them: Comparing Formalizations of Law by the Decisions They Encode
Researchers compared formalizations of EU legal provisions generated by 9 frontier LLMs, finding that behavioral divergence between formalizations is uncorrelated with structural agreement, and that verbalized cases reveal distinct types of disagreement. This affects AI agents that rely on LLMs for legal reasoning and may require adjustments to ensure accurate and consistent decision-making.
Save an API key to vote.