A new LLM guardrail framework, ARBITER, is proposed. It uses dual-hypothesis reasoning and multi-component supervised fine-tuning for cost-effective and transparent safety decision-making. Experiments show ARBITER outperforms existing guardrails on three safety moderation benchmarks.