Tag
prefix-sharing
- Jun 22, 2026 Prompt Cache Economics: Hit Rate, Prefix Length, and Break-Even What a cache hit actually saves, how prefix granularity bounds the achievable hit rate, and where cache storage competes with concurrency for the same memory. inference systems
- Jun 10, 2025 Path Compression and the Patricia Trie Single-child chains inflate a trie by one node per byte. Patricia compression stores only branching nodes plus a skip value, changing lookup, insertion, and deletion in specific ways. data structures