master

Ii-robot!5769 GPT-Neox 内存优化&重计算优化

10f6b971创建于 2023年11月14日历史提交

文件	最后提交记录	最后更新时间
data	Replenish and switch to Tag v2.0 Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
fused_kernels	参数对齐，优化点合并 Signed-off-by: l30040116 <liuxinxin34@huawei.com>	2 年前
gradient_noise_scale	Replenish and switch to Tag v2.0 Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
model	!5769 GPT-Neox 内存优化&重计算优化 Merge pull request !5769 from jianyu jiang/master	2 年前
mpu	tp_allreducee隐藏&倒三角&readme Signed-off-by: l30040116 <liuxinxin34@huawei.com>	2 年前
neox_arguments	!5709 README补充 & 选择重计算优化 & 执行脚本补充 & deepspeed0.9.2适配 Merge pull request !5709 from 刘鑫鑫/master	2 年前
optimizer	!5769 GPT-Neox 内存优化&重计算优化 Merge pull request !5769 from jianyu jiang/master	2 年前
tokenizer	Adapting to the NPU Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
__init__.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
checkpointing.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
initialize.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
learning_rates.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
logging.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
mup_substitute.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
optimizers.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
text_generation_utils.py	Adding megatron in segments Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前
training.py	!5709 README补充 & 选择重计算优化 & 执行脚本补充 & deepspeed0.9.2适配 Merge pull request !5709 from 刘鑫鑫/master	2 年前
utils.py	Adapting to the NPU Signed-off-by: lifuhua <lifuhua3@huawei.com>	2 年前