Unconstrained CTI-REALM with Open-Weights
This paper explores the choice between open-weight and closed frontier language models for security work, finding that open-weight models can match the performance of closed models at a significantly lower cost. The authors evaluate 26 models on the CTI-REALM benchmark and introduce stage-level metrics to score agent outputs.
Save an API key to vote.