https://the-decoder.com/microsoft-longnet-could-deliver-web-scale-ai-for-future-llms/
Microsoft LongNet could deliver web-scale AI for future LLMs
Jul 9, 2023 - ChatGPT can read 4,096 tokens, LongNet a billion. This could enable Transformer models that can process entire parts of the Web simultaneously.
web scaleai formicrosoftlongnetcould
https://deepai.org/publication/longnet-scaling-transformers-to-1000000000-tokens
LongNet: Scaling Transformers to 1,000,000,000 Tokens | DeepAI
Jul 5, 2023 - 07/05/23 - Scaling sequence length has become a critical demand in the era of large language models. However, existing methods struggle with ...
1 000longnetscalingtransformerstokens