https://datapecharcha.substack.com/p/llm4n5-embeddings-and-postional-encoding
LLM4N5: Embeddings and Postional Encoding - by Mahaprasad
Setting the stage for transformers, how and why positional encoding work, and what's next?
embeddingsencodingmahaprasad