How To Scale Your Model

Back to Top
Previous Part
Next Part
Sections (current)
Part 0. Introduction Part 1. Intro to Rooflines Part 2. All About TPUs Part 3. Sharded Matmuls Part 4. Transformers Part 5. Training Part 6. Training LLaMA Part 7. Inference Part 8. Serving LLaMA Part 9. Profiling Part 10. All About JAX Part 11. Conclusions