Building a Modern LLM from Scratch: RMSNorm, RoPE, GQA and SwiGLU

This is the fourth part of a series on how language models work, built from the ground up. Part 1 built a neural network as an office building and trained it. Part 2 put text through the building and