Agent memory needs its OpenTelemetry moment

(lorekit.io)

11 points | by mthines 1 hour ago

9 comments

  • Fordec 11 minutes ago
    On the general premise, I agree. But I don't think that moment is today, not yet anyway. I don't think we understand the right way to approach context and memory yet or how long they should last for, never mind standardizing on an abstraction prematurely that ends up being like SOAP or SGML.
  • Implicated 10 minutes ago
    I decided long ago to not wait for you all to figure this out.

    Index it all. Embed it all. Give your agents the ability to query it all. Eval different configurations to figure out what works best for you.

  • imgyuri 17 minutes ago
    The need for a unified format or spec is greatly reduced in the case of Agent memory because by definition it is read by agents, and agents are already instructed / programmed to read memory files of different formats. Even if such instructions did not exist, agents are extremely good at traversing files to get the necessary context it needs.
    • jstanley 13 minutes ago
      This is true and it probably is actually fine, but in a way you don't want it to be wasting its reasoning abilities and context window on figuring out which text files to read.

      It would be like trying to accomplish something as a human but all your reference material is always in a different format, it would be maddening.

  • hagen8 7 minutes ago
    Well, coding agents are smart, they can use all kinds of memory. A simple skill on how and when to access it is enough...
  • te_chris 21 minutes ago
    So we need another complicated format to store information so that the machines which read unstructured text can work with it?
  • slopinthebag 19 minutes ago
    at this point i'm pretty convinced agent memory is strictly harmful. it remembers the wrong things, and then turns them into an inane focus for each task. i disable it universally on every harness. if i want memory, i specifically instruct the agent to record findings into a file.
    • SwellJoe 15 minutes ago
      Same. Everybody builds one, and then eventually realizes it makes the model stupid and confused. The right solution is pretty much always developer documentation in the repo, in roughly the same shape you'd make developer docs for humans that you want to be able to get up to speed about your codebase really quickly.

      This has the benefit of being something you can easily read over every now and then to make sure the model hasn't baked in some random comment you made about a specific circumstance a month ago and made a weird religion out of it.

  • monster_truck 11 minutes ago
    it's called a markdown file
  • mthines 1 hour ago
    [flagged]