Researchers introduce LSREP, a protocol for evaluating conversational memory, and ICE v2, a local-first memory middleware. The study compares ICE v2 to vector-RAG on four datasets, highlighting its strengths and weaknesses. LSREP and ICE v2 provide insights into conversational memory and its evaluation, which is relevant to people building and operating AI agents.