Aditya Kulkarni

I write down what I learn about deep learning, LLMs, and the systems underneath them. This is where those notes live.

Recent notes

Warp Divergence and Why Branches Are Expensive on GPUs CUDA KV-Caching, and How Autoregressive Decoding Stays Fast LLMs Layer Normalization, and Why Transformers Need It Deep Learning