The Attention Within: Consensus Dynamics in Selective State Space Models
Researchers explore the dynamics of selective state space models (SSMs) and their relationship to transformer architectures. They find that SSMs also exhibit a consensus-driven behavior, similar to attention in transformers, and propose a new analysis framework.
Save an API key to vote.