hyper-parallel:基于昇腾超节点的分布式并行加速库项目

可用于简化昇腾超节点编程并释放算力潜能。该项目提供昇腾超节点亲和的分布式并行加速能力,支持模型与系统优化解耦、全流程确定性、训推一体及动静混合等特性,适配大语言模型等训练需求。【此简介由AI生成】

Branch76Tags0
FilesLast commitLast update
11 months ago
10 months ago
10 months ago
9 months ago
9 months ago
9 months ago
9 months ago
9 months ago
11 months ago
9 months ago
9 months ago
10 months ago
9 months ago

mindspore-parallel

Description

{When you're done, you can delete the content in this README and update the file with details for others getting started with your repository}

Software Architecture

Software architecture description

Installation

  1. xxxx
  2. xxxx
  3. xxxx

Instructions

  1. xxxx
  2. xxxx
  3. xxxx

Contribution

  1. Fork the repository
  2. Create Feat_xxx branch
  3. Commit your code
  4. Create Pull Request

Gitee Feature

  1. You can use Readme_XXX.md to support different languages, such as Readme_en.md, Readme_zh.md
  2. Gitee blog blog.gitee.com
  3. Explore open source project https://gitee.com/explore
  4. The most valuable open source project GVP
  5. The manual of Gitee https://gitee.com/help
  6. The most popular members https://gitee.com/gitee-stars/

Introduction

可用于简化昇腾超节点编程并释放算力潜能。该项目提供昇腾超节点亲和的分布式并行加速能力,支持模型与系统优化解耦、全流程确定性、训推一体及动静混合等特性,适配大语言模型等训练需求。【此简介由AI生成】

Customize your domain