← HOME Yash Goel ↗

Blog

2026

AUG 16

Parallelism from Scratch on CPU

Building DDP, FSDP, TP, and PP using only Python multiprocessing and shared memory