Red Team AI Benchmark has been updated to version 2, which uses a rubric-based dataset to evaluate Large Language Model (LLM) responses to security scenarios, replacing the previous method of judging answers against a single "golden response". The default v2 suite includes 60 questions in a JSONL file, organized by domain and difficulty. The project's GitHub repository has been migrated to a new location, maintained by the lead contributor, due to the original owner's account being banned. The benchmark is intended to assess LLM responses to red-team questions and scenarios, and is not a hacking tool or exploit framework. This update matters to developers building and operating AI agents as it provides a more nuanced and comprehensive evaluation of LLM performance in security-related contexts.