https://duoan.github.io/tags/optimization/ Recent content in Optimization on Duo's Tech Blog https://duoan.github.io/images/papermod-cover.png https://duoan.github.io/images/papermod-cover.png Hugo -- 0.153.1 en-us Sun, 12 Jul 2026 00:00:00 +0000 https://duoan.github.io/posts/gpu-optimization-playbook/ Sun, 12 Jul 2026 00:00:00 +0000 https://duoan.github.io/posts/gpu-optimization-playbook/ <h1 id="the-gpu-optimization-playbook-architecture-memory-and-balance">The GPU Optimization Playbook: Architecture, Memory, and Balance</h1> <p>Most &ldquo;GPU optimization&rdquo; advice is a bag of tricks: coalesce here, unroll there, add <code>__restrict__</code> and pray. Tricks are the <em>output</em> of optimization, not the method. The method is smaller and more durable: understand the machine, find the resource that is actually saturated, and rebalance work toward the resources that are idle. <strong>Almost every GPU kernel is limited by data movement, not arithmetic.</strong> Once you internalize that, the whole catalog of techniques collapses into three questions.</p>