RouteKV Compiler: The Brain That Decides Where Your LLM's Memory LivesImagine you're running a massive LLM in production think 128K context windows, thousands of concurrent users, all hammering your GPU cluster. At some point, you notice something weird: your GPUs aren'Apr 30 · 19 min readharshamangena.hashnode.dev
AI CLI in GOWorkflow with CodeAI CLI CodeAI CLI is a command-line tool designed to empower developers by integrating artificial intelligence capabilities directly into their development environment. Leveraging local large language models (LLMs) through the Ollam...Mar 27, 2025 · 6 min readharshamangena.hashnode.dev
Micro LLMs: Fine-Tuning for Specific TasksIntroduction Hey there! If you've been following the AI space lately, you've probably heard about Large Language Models (LLMs) like ChatGPT, Claude, or LLaMA. These AI marvels can write essays, answer questions, and even create code. But there's a ne...Mar 6, 2025 · 8 min readharshamangena.hashnode.dev
Tools for LLM TuningTraining large language models (LLMs) can feel like trying to tame a dragon: powerful, resource-hungry, and intimidating. But with the right tools, even beginners can achieve impressive results. In this guide, we’ll explore three popular frameworks—U...Feb 5, 2025 · 3 min readharshamangena.hashnode.dev
Advanced Adapter Merging Strategies in LLMsIn the rapidly evolving landscape of Large Language Models (LLMs), the ability to efficiently customize and adapt these models for specific tasks has become increasingly crucial. This comprehensive guide explores two sophisticated adapter merging str...Feb 3, 2025 · 6 min readharshamangena.hashnode.dev