The Ratchet Loop — Systematically Optimizing a TPU Kernel to the Hardware Ceiling
The Ratchet Loop — Systematically Optimizing a TPU Kernel to the Hardware Ceiling Part 3...
Train Your First LLM on a Free TPU Here’s a fact that still surprises people: the same chip family Google uses to train Gemini is sitting in a free Colab...
./read_more.shExplore my thoughts on Machine Learning, AI, and more
The Ratchet Loop — Systematically Optimizing a TPU Kernel to the Hardware Ceiling Part 3...
Deep-Dive into TPU Profiling — XProf, HLO, and the Roofline Model Part 2 of the...
Writing Fast Attention on TPU — From Naive Kernel to Fused FlashAttention with Pallas Part...
Running Containerised Batch Jobs on Google Cloud Platform I needed to OCR tens of thousands...
In today’s data-driven world, video content is everywhere—from security surveillance and industrial monitoring to social...
Large Language Models (LLMs) are powerful predictors. Given a sequence of text, they excel at...
Speech synthesize has become more human like within last few years and gained a higher...