Mark Kogan

In working with LLMs, a consistent source of performance gaps comes from limitations in memory and learning over time. In my own work, this gap shows up repeatedly: amazing performance in isolated tasks, followed by brittleness once interactions extend over time or require the system to build on prior experience. Memory and self-learning may not be the only way to frame the problem, but they are currently useful lenses for understanding where today’s LLM architectures break down. What makes this gap interesting is the contrast: these systems can be super-human in narrow capabilities, yet frustratingly wrong when even modest persistence or learning over time is expected. You don’t need to be a cognitive scientist to notice that the human brain is not just a very large context window. From a practical standpoint, it can be useful to think architecturally in terms of adding or improving memory and learning—not as the only way to frame the problem or its solution, but as architecturally useful working models. Seen this way, the issue is not access to more text via larger context windows, but the absence of persistent, updateable processes—mechanisms that govern what is retained, revised, and abstracted across interactions. I recently looked at Hindsight (link to repo in the comments), an open approach to agent memory that treats memory as more than a flat retrieval layer. Instead of storing everything in a single vector space, it introduces explicit memory categories that resemble familiar cognitive distinctions: 🔹World knowledge — relatively stable facts 🔹Experiences — what the agent itself has done and observed 🔹Opinions — beliefs that carry confidence or uncertainty 🔹Observations — higher-level models formed by reflecting across prior memory What stands out is not just the taxonomy, but the separation of memory operations: 🔹Retain information intentionally 🔹Recall relevant past context when needed 🔹Reflect to synthesize new insights from accumulated history This structure makes it easier to reason about how an agent’s knowledge evolves—particularly how beliefs change, how experience accumulates, and how abstractions form over longer horizons. Many existing RAG-style systems struggle here once interactions extend beyond short-term context. The approach has also been evaluated on LongMemEval, where it reports leading accuracy among open systems, with independent verification by external research groups. Whether or not this specific architecture becomes standard, it points toward a direction that feels necessary: systems that can accumulate experience, revise beliefs, and build internal models over time. That seems like a prerequisite for anything we would reasonably call self-learning. How are you thinking about memory and persistent learning in your own AI or LLM projects? And how much improvement do you think this could bring to LLM or AI systems’ performance? #AIAgents #LLMs #AgentMemory #MachineLearning #AIArchitecture

2

3 Comments