Open source. Open possibilities.

DeepSpeed is a deep learning optimization library designed to make the training and inference of large-scale models easy, efficient, and effective.

Colossal-AI is an open-source system for training and running large AI models more cheaply and efficiently, offering parallel training strategies, memory management, and inference acceleration for LLMs, diffusion models, and more.