https://genai.gitpull.in/2-intro-genai/2.1-key-concept/3-attention-mechanism/index.html Self-Attention: The Core of Transformers Imagine you’re reading a sentence: "The cat sat on the mat. Each word is important, but some are more related to others. “cat” is related to “sat.” “mat” is related to “sat.” “on” is less important. Self-Attention helps the model decide which words to focus on! How Self-Attention Works (Step-by-Step) Self-attention is done in 4 steps: 1. Convert Words into Vectors (Embeddings) Computers don’t understand words, so we convert them into numbers (word embeddings). Hugo en-us