Principles and Practice of Parallel Programming

• Author of HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism within the Main Conference-track