Relay is a self-hosted LLM gateway with smart routing and request pacing. It classifies incoming requests, decides on model capabilities, and routes them across configured providers while accounting for limits and available capacity. The gateway is lightweight, ships with routing classification models, and has a built-in classifier that runs in the single digit millisecond range.