Colossal AI 37.9k
Maximize the runtime performance of your large neural networks with distributed techniques of Colossal-AI.
DeepSpeed 32.8k
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Megatron LM 8.7k
Megatron is a large, powerful transformer developed by the Applied Deep Learning Research team at NVIDIA.
