AI/ ai · ai-agents · recommendation-systems · machine-learning

New Framework Turns Recommendation Feedback Into AI Memory

A new framework called TIDE uses delayed clicks and conversions, not just semantic search, to decide which AI agent memories to keep, reinforce, or discard.

A new framework treats an AI agent's memory like a population that has to earn its keep, culling entries that stop performing and promoting ones that work.

Researchers describe TIDE (Trajectory-Informed Directed Memory Evolution), a system built to solve a specific problem: content-generation agents get feedback from real users, clicks, conversions, and outright rejections, but that feedback arrives late, is noisy, and rarely says which memory caused which outcome. TIDE assigns credit to individual memories based on timing, semantic relevance, and which memories were actually referenced when content was generated, then reinforces, combines, mutates, or evicts memories accordingly. The team also introduces a new metric, Memory Evolution Gain (MEG), which measures how much an evolved memory bank improves an agent's performance on future tasks compared to having no memory at all. Tested on an e-commerce membership marketing content-generation agent, TIDE produced a 7.75-percentage-point MEG improvement in offline replay tests, and on a separate delayed-label benchmark it beat comparison methods on both error rate and MEG.

The real story here is attribution, not memory storage. Most agent memory systems today lean on semantic similarity or immediate feedback as a proxy for whether something worked, which is a weak signal when the actual payoff shows up well after the fact and gets muddied by audience mix and placement. A method that can trace delayed outcomes back to the specific memories responsible is a prerequisite for agents that improve on their own rather than needing constant manual curation.

That said, the results so far come from one retailer's marketing engine, and offline replay is not the same as watching an agent run unsupervised for months. Whether this kind of memory evolution holds up outside a controlled benchmark is still an open question.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →