DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Introduction
DeepSpeed 是一个深度学习优化库,它能使得分布式训练和推理变得简单、高效且有效。【此简介由AI生成】
Apache-2.0 Python3.3 KCommitsbillion-parameterscompressiondata-parallelismdeep-learninggpuinferencemachine-learningmixture-of-expertsmodel-parallelismpipeline-parallelismpytorchtrillion-parameterszero深度学习
Customize your domain