Mar 31, 2026 rate-distortion context compression ShannonThe Rate-Distortion Theory of Context CompressionContext compaction is a lossy compression problem. Rate-distortion theory gives the theoretical lower bound on how much conversation history can be compressed.
