Uber Cuts Translation Cache Memory by up to 90% While Keeping P99 Latency Below 1 MS

Image: InfoQ
ad slot · in-content video 16:9
Coverage
More coverage
- Uber redesigned its Go-based translation cache to reduce its initial memory footprint by more than 90% while maintaining a cache hit rate above 99.9% and p99 disk-backed cache miss latency below 100 microseconds. The hybrid architecture combines in-memory keys and frequently accessed values with…