https://hyper.ai/en/papers/2609.29845
Your Transformer Can Hold Two Thoughts at Once: Evidence of Linear Superposition in LLMs | Papers |...
While Large Language Models (LLMs) rely on highly non-linear components, in this work we demonstrate that they exhibit fundamental linearity: when inputs from...
at oncelinear superpositiontransformerholdtwo