New ask Hacker News story: Ask HN: Why don't we talk about context window size anymore?
Ask HN: Why don't we talk about context window size anymore?
3 by rce123 | 1 comments on Hacker News.
Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance. Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?
3 by rce123 | 1 comments on Hacker News.
Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance. Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?
Comments
Post a Comment