torch.distributed.optim

Note

若API“是否支持”为“是”,“限制与说明”为“-”,说明此API和原生API支持度保持一致。

API名称 是否支持 限制与说明
torch.distributed.optim.DistributedOptimizer -
torch.distributed.optim.DistributedOptimizer.step -
torch.distributed.optim.PostLocalSGDOptimizer -
torch.distributed.optim.PostLocalSGDOptimizer.load_state_dict -
torch.distributed.optim.PostLocalSGDOptimizer.state_dict -
torch.distributed.optim.PostLocalSGDOptimizer.step -
torch.distributed.optim.ZeroRedundancyOptimizer 支持的输入类型为torch.nn.Optimizer对象
不支持NPU融合优化器对象
torch.distributed.optim.ZeroRedundancyOptimizer.add_param_group -
torch.distributed.optim.ZeroRedundancyOptimizer.consolidate_state_dict -
torch.distributed.optim.ZeroRedundancyOptimizer.join_device -
torch.distributed.optim.ZeroRedundancyOptimizer.join_hook -
torch.distributed.optim.ZeroRedundancyOptimizer.join_process_group -
torch.distributed.optim.ZeroRedundancyOptimizer.load_state_dict -
torch.distributed.optim.ZeroRedundancyOptimizer.state_dict -
torch.distributed.optim.ZeroRedundancyOptimizer.step -