Rethinking Latency Denial-of-Service: Attacking the LLM Serving Framework, Not the Model
A research paper proposes a new Fill and Squeeze attack strategy targeting the state transition of the LLM serving system's scheduler. The attack exploits system-level optimization vulnerabilities to induce Head-of-Line blocking and repetitive preemption, leading to significant degradation of a vLLM's throughput and average slowdown.
Save an API key to vote.