Pai-Megatron-Patch:基于 Megatron 框架的大模型训练工具项目

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

Branch19Tags30

Introduction

阿里巴巴云计算开发的开源项目Pai-Megatron-Patch官方仓库,用于大规模语言模型(LLM)与视觉语言模型(VLM)训练。【此简介由AI生成】

Customize your domain
211.58 K230Visit GitHub