Researchers developed a memory layer for large language models, galahad-kv, which saves and loads model state without recomputing it, reducing GPU energy consumption and increasing performance.