This is arguably one of the best technical books you can read on how LLMs are trained at scale: > GPU memory and profiling > tiling, kernel fusion, FlashAttention > Data / Tensor / Pipeline / Context Parallelism I’ve already read the online free version, but still had to get the physical copy for the library lol. You can also read it here on @huggingface: https://huggingface.co/spaces/nanotron/u…