The Problem With AI “Memory”

“Memory” is the feature everyone asked for and few thought through. The pitch is lovely: the assistant remembers your preferences, your projects, your writing style , the fact that you are vegetarian and allergic to long emails, so you never have to repeat yourself. In practice, it is one of the most consequential privacy decisions in consumer AI, dressed up as a convenience toggle, and most people flipped it on without reading past the word “remember.” Convenience and surveillance are the same feature The uncomfortable truth is that there is no version of persistent memory that is not also a growing personal record. For the assistant to remember your details, it has to store your details. The thing that makes it feel like it knows you is a file — structured or otherwise — accumulating what you have told it, and inferring more from what you did not. The warmth and the dossier are not two features. They are one feature seen from two angles. A system that remembers everything you tell it is, definitionally, a system that keeps a record of everything you tell it. The friendliness is the interface; the record is the substance. The profile that shapes what you are shown A stored model of who you are does not sit there inertly; it starts to shape the responses you get. That is the entire selling point — a memory-enabled assistant tailors its answers to what it believes about you. But tailoring cuts both ways. Once the system has decided you are a particular sort of person, with particular views and particular tastes, it begins to give you the version of the world it thinks you want, and you lose the ability to know what it would have said to someone it had profiled differently. The personalisation that feels like being understood is also, quietly, a narrowing. We have seen this film before, with recommendation feeds that learned our preferences and then fed them back to us until the preferences hardened into a cage. A memory-driven assistant risks the same dynamic applied