Goyalayus

Notes

• Aug 27, 2026Building An Async Runtime From Scratch In Python — Building a high-performance chat app while learning why event loops, coroutines, Futures, Tasks, and async I/O exist.
• Aug 25, 2026Notes From Simon Boehm’s CUDA Matmul Blog — My notes while working through Simon Boehm’s CUDA SGEMM optimization blog, one kernel at a time.
• Aug 03, 2026From CPU Hardware To Concurrency, Threads, Coroutines, And Async I/O: The Hitchhiker's Guide To Concurrency
• Aug 01, 2026Learning To Summarize From Human Feedback — my notes on this paper.
• Jul 31, 2026Asynchronous Rlhf, Faster And More Efficient Off-Policy RL For Language Models — my notes on this paper.
• Jul 14, 2026Okay Here's Your ETH, But — How Lending in Decentralised level work at the level of code
• Jul 14, 2026Tesla Is Tarding At $335.16 Or Is It? — How are stock prices really calculated
• Jul 14, 2026My Notes On RL
• Jul 14, 2026Reinforcement Le
• Jul 14, 2026R
• Jun 25, 2026Probablity
• Jun 25, 2026Calculas — no more summarizable
• Jun 14, 2026Leanings From My First RL Training Run Or Maybe Runs — my experience training 0.6b qwen model to play wordle and observing it learn to cheat and collapse
• Dec 10, 2025Inference — notes for myself
• Dec 09, 2025Broadcasting — notes for myself
• Dec 08, 2025My Complete Notes On Distributed Training — these are just notes for myself, it might feel ai written because some part of it is.
• Dec 07, 2025Block Matrice Multiplication — notes for myself
• Dec 07, 2025Computing Gradients For The Sake Of It — .
• Nov 29, 2025CUDA Kernels Zero To One — learn basics of gpu programming and writing custom cuda kernels
• Nov 16, 2025Mathematics Behind Exploding And Vanishing Gradients — .
• Oct 13, 2025Everyone Is Rewriting Their C++ Code Into Rust. Why? No, It's Not Performance — .
• Sep 24, 2025The Hitchhiker’s Guide To Working With Audio Data — audio data has two parts amplitude and frequency.
• Sep 24, 2025The Hitchhiker’s Guide To Golang Concurrency — Go has special Threads called Go-Routines.
• Sep 22, 2025Thread Synchronization In C — I don’t write for absolute beginners so this post is for someone who know on a high level how threads work but does not know the low levels
• Aug 29, 2025Ensuring A Stable Pre-Train — there are majorly two reasons for unstable training of your llm
• Aug 29, 2025You See Neural Nets Wrong — Deriving and Memorizing Forward Pass in Neural Networks
• Aug 20, 2025So, You Want To Make A Dating App... — Our efforts for an app, which apparently never made it to the 'peepl'
• Aug 19, 2025How B2C Will Play Out After LLMs — note : This post is about B2C, I have very little Experience on B2B but still will include a section at last on my views
• Aug 19, 2025Paras Chopra Saved My Failed Startup — My notes from paras Chopra's Mental Models
• Aug 19, 2025How Multi-Model LLM's Work — To be honest it’s really simple, but please read my previous posts on Transformer Architecture and Tokenizers.
• Aug 19, 2025How LLM Tokenizers Work — Understanding Byte-Pair Encoding (BPE)
• Aug 19, 2025Distribution For PMF — This blog was written before I used substack to write.
• Aug 19, 20252 Startups — Why Startup Advice sometimes feel contradictory
• Aug 19, 2025How KV Caching Works In Attention — Explained with Examples
• Aug 19, 2025Tell Me How You Work, GPT — LLM Internals for Developers
• Aug 19, 2025How Are Stable Coins Stable — The core algorithm behind Stable Coins easily explained
• Aug 18, 2025So You Want Some Ethereum — All about how Decentralized Exchanges really work
• Aug 18, 2025Nft's Are Okayish — all about non-fungible tokens
• Aug 18, 2025Why So Many Coins — Fungible Tokens and ERC - 20
• Aug 18, 2025Layer 2 Network Internals On Blockchain — The incomplete solution to scale Blockchain
• Aug 16, 2025How Ethereum Really Works — Ethereum internals from accounts and gas to consensus and execution.
• Aug 15, 2025Blockchain Internals For Developers — worlds best blog for not-so-technical folks
• Aug 03, 2025The Counter-Intuitive Path To Machine Learning — you do not need mathematics.
• Jul 18, 2025Netflix's Big Bet — One model to rule recommendations
• Jul 16, 2025Why Death And Taxes Will Soon Be Obsolete. — .