Scaling Laws for Context Length: How Performance Changes with Window Size
Similar to Kaplan's scaling laws for model size, there are scaling laws for context length. Performance doesn't scale linearly — here's the math.
// tag
Posts tagged "compute optimal"
1 post found