Hi everyone! As an AI enthusiast, I came up with this idea so I’ve put together a theoretical architecture called CM-LLMand it is a Hierarchical Epistemic Memory for LLMs to address some of the limits of context windows and standard vector RAG. Key components: • Hierarchical & Epistemic: Multi-level abstraction that tracks the certainty/validity of stored information. • Grounded: Links concepts to their origin to mitigate hallucinations. • Decaying: Simulates memory decay over time to clear stale context. • Bridge-Enabled: Fast connections to navigate between granular details and high-level concepts. Everything is free and open-source on GitHub: FP-01/Cortex-LLM ( I hope is ok to share this. ) EDIT: The core of my idea is turning a LLM into s system that knows when it understand somethings but can forgets thing gradually while keeping track of uncertainty. From a mathematically point of view my idea can be described as: A Hilbert space R dimesional at which apply temporal dynamics with stability constraint Cauchy like. So, everything live in a vector space ( as usual), now istead of saying " this concept = one vector" my idea is turning everything concept in a Gaussian in this way we can separate facts from opinions, the knowledge evolve over time but here I put a confidence decay and an uncertainty grows factors ( this is similiar to how human memory works). At this point a stability like Cauchy give a sort of capacity of understanding to the LLM. Now a structure emerge and this let the system discover cluster automatically. The key part is the bridge between domani where we look for structural analogy. Memory became dynamic: it change overtime ( decays or get reinforced ). The retrieval is is a score = similarità + confidence - uncertainty. Since I designed this purely for fun, I’d love to hear your feedback: Is this approach sound good, or someone is already working on it and I miss somethings or is it already rendered obsolete by frameworks like GraphRAG or MemGPT? It is totally garbage and it is better delete the repository? from a theoretical point of view this should work but i don’t know from a practical/implementation point of view. submitted by /u/Icy-Fox-7154
Originally posted by u/Icy-Fox-7154 on r/ArtificialInteligence