ReplaySSM is a technique for improving the performance of state-space models by separating output computation from checkpoint updates, reducing state memory traffic and enabling low-precision checkpointing without affecting recurrent updates. It accelerates decoding by 1.2-1.47x and increases throughput by 1.8x.