https://duoan.github.io/categories/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/cuda/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/categories/engineering/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/gpu/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/tags/mfu/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/tags/modal/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/categories/performance/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/tags/performance/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/posts/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/roofline/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/posts/roofline-first-step-of-performance-optimization/ 2026-07-11T00:00:00+00:00 https://duoan.github.io/tags/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/communication/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/tags/grouped-gemm/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/posts/large-moe-from-sparsity-to-communication/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/tags/llm/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/megascale/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/tags/megatron/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/tags/moe/ 2026-07-04T00:00:00+00:00 https://duoan.github.io/tags/dynamo/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/tags/inductor/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/tags/pytorch/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/tags/torch.compile/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/posts/torch-compile-from-bytecode-to-triton/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/tags/triton/ 2026-05-31T00:00:00+00:00 https://duoan.github.io/tags/bf16/ 2026-05-24T00:00:00+00:00 https://duoan.github.io/tags/kernel-fusion/ 2026-05-24T00:00:00+00:00 https://duoan.github.io/posts/optimizing-vlm-training-on-one-gpu/ 2026-05-24T00:00:00+00:00 https://duoan.github.io/tags/training/ 2026-05-24T00:00:00+00:00 https://duoan.github.io/tags/vlm/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/data-pipeline/ 2026-03-12T00:00:00+00:00 https://duoan.github.io/tags/ddp/ 2026-03-12T00:00:00+00:00 https://duoan.github.io/tags/transformer/ 2026-03-12T00:00:00+00:00 https://duoan.github.io/posts/why-variable-sequence-length-breaks-ddp-throughput/ 2026-03-12T00:00:00+00:00 https://duoan.github.io/tags/distributed-training/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/posts/learning-ddp-performance-tuning-on-one-gpu/ 2026-02-18T00:00:00+00:00 https://duoan.github.io/tags/systems/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/nsight/ 2026-01-16T00:00:00+00:00 https://duoan.github.io/tags/profiling/ 2026-01-16T00:00:00+00:00 https://duoan.github.io/posts/profiling-pytorch-training-end-to-end/ 2026-01-16T00:00:00+00:00 https://duoan.github.io/posts/scalable-multimodal-datapipeline/ 2025-12-22T00:00:00+00:00 https://duoan.github.io/tags/multimodal/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/categories/research/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/scalability/ 2025-12-22T00:00:00+00:00 https://duoan.github.io/tags/streaming/ 2025-12-22T00:00:00+00:00 https://duoan.github.io/tags/cot/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/curriculum/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/distillation/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/qwen/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/siglip/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/siq-vl/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/posts/siq-vl-curriculum-under-compute-constraints/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/capacity-planning/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/posts/large-model-capacity-plan/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/tags/scaling-laws/ 2026-07-12T00:00:00+00:00 https://duoan.github.io/archives/ https://duoan.github.io/search/ https://duoan.github.io/series/