AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs

AudioTETRIS is a training-free, two-stage framework for compressing audio tokens in Large Audio Language Models (LALMs) without losing performance. It uses the audio encoder's representation geometry as an acoustic prior to compute a per-token fused score, which drives progressive top-$k$ token selection. This results in near-uncompressed performance using only 25% of audio tokens.

RSS Score 0 10/12/2026, 4:00:00 AM Original Source
Save an API key to vote.