Aman Karki (@amankarki)

C++/CUDA engineer building LLM inference and GPU code from scratch: verbum.cpp, Lattice, RAAG. 2 CUDA PRs merged into llama.cpp. I write about inference, GPU performance, and measuring things honestly.

Aman Karki

About

Available for

Aman Karki's blogs

My GPU fix was 13% faster on one card and 81% slower on another

Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow

Blockwise FP8 on Ada GPUs: why your L4 falls back to Marlin, measured

Two CUDA PRs into llama.cpp, and what they taught me about a 100K-star codebase

Two From-Scratch Systems, and the Day They Talked

Aman Karki

About

Available for

Aman Karki's blogs

My GPU fix was 13% faster on one card and 81% slower on another

Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow

Blockwise FP8 on Ada GPUs: why your L4 falls back to Marlin, measured

Two CUDA PRs into llama.cpp, and what they taught me about a 100K-star codebase

Two From-Scratch Systems, and the Day They Talked

Aman Karki

About

Available for

Aman Karki's blogs

My GPU fix was 13% faster on one card and 81% slower on another

Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow

Blockwise FP8 on Ada GPUs: why your L4 falls back to Marlin, measured

Two CUDA PRs into llama.cpp, and what they taught me about a 100K-star codebase

Two From-Scratch Systems, and the Day They Talked

Search Hashnode

Aman Karki

About

Available for

Aman Karki's blogs

My GPU fix was 13% faster on one card and 81% slower on another

Blockwise FP8 on Ada GPUs, part 2: my kernel was correct and 4x too slow

Blockwise FP8 on Ada GPUs: why your L4 falls back to Marlin, measured

Two CUDA PRs into llama.cpp, and what they taught me about a 100K-star codebase

Two From-Scratch Systems, and the Day They Talked