Unified storage solution for lifelong context engineering
Develop a unified storage architecture for lifelong context engineering that preserves as much user context as possible without loss, specifies the infrastructure or interfaces needed to record context to the maximum extent, and enables storage systems that simultaneously support high-compression storage, high-precision retrieval, and low-latency access at scale.
References
We currently lack a unified solution: How can we preserve as much context as possible, ensuring that all of my contexts can be effectively retained without loss? What kind of infrastructure or interface would facilitate recording our context to the maximum extent? And how can storage systems simultaneously support high-compression, high-precision retrieval, and low-latency access at scale?
In personal informatics, since goals emerge and change and future goals are hard to anticipate, it is instead unclear at collection time what to record and which dimensions will later matter.
How to keep open-ended logging worthwhile is a question future work should examine.
Key open questions include scalable architectures for long-term personal data management services, precise models for purpose- and policy-aware data exchange, verifiable sandboxing of untrusted services, and explainable AI agents.
An open question remains as to how the community should design techniques for constructing context layers at scale while providing efficient build times, low memory footprints, and fast access patterns.
One central open question is: what data structure should represent semantic context?