New ask Hacker News story: Ask HN: Why don't we talk about context window size anymore?

Ask HN: Why don't we talk about context window size anymore?
3 by rce123 | 1 comments on Hacker News.
Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance. Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?

Comments

Popular posts from this blog

How can Utilize Call Center Outsourcing for Increase your Business Income well?

New ask Hacker News story: EVM-UI – visual tool to interact with EVM-based smart contracts