How Neo Builds His Own Transformer: A Matrix StoryAct I: The Construct Inside the training construct, rain falls in sheets of green code. Neo stands before a floating terminal, his fingers hovering over glowing symbols. Trinity watches from the shadoJul 26 · 13 min readthe-tech-inside.hashnode.dev
Inside the Transformer Training LoopNeo: I know kung fu. Morpheus: Show me. (Neo steps forward, his body moving in a blur of perfect, calculated strikes. He doesn't have to think about it. The knowledge is crystallized in his muscles. HJul 24 · 9 min readthe-tech-inside.hashnode.dev
How a Decoder-Only Transformer Works?In my last post, we dissected the Encoder (think BERT)—the bidirectional powerhouse that understands context by looking left and right. Today, we are flipping the script. We are building a Decoder-OnlJul 23 · 16 min readthe-tech-inside.hashnode.dev
How a Encoder-only Transformer Works?Imagine teaching a young kid how to read. At first, they don’t just need letters — they need to understand meaning, order, and how words relate to each other. You can’t simply hand them a book and hopJul 19 · 16 min readthe-tech-inside.hashnode.dev
Every AI prompt Triggers an Invisible FactoryYou type a question. Hit enter. Get an answer in seconds. But what you don't see is the invisible factory that just ran to generate those words. A massive, power-hungry manufacturing plant springs intJul 14 · 8 min readthe-tech-inside.hashnode.dev