torch.distributed.pipelining

Note

若API“是否支持”为“是”,“限制与说明”为“-”,说明此API和原生API支持度保持一致。

API名称 是否支持 限制与说明
torch.distributed.pipelining.SplitPoint -
torch.distributed.pipelining.pipeline -
torch.distributed.pipelining.Pipe -
torch.distributed.pipelining.pipe_split -
torch.distributed.pipelining.microbatch.TensorChunkSpec -
torch.distributed.pipelining.microbatch.split_args_kwargs_into_chunks -
torch.distributed.pipelining.microbatch.merge_chunks -
torch.distributed.pipelining.stage.PipelineStage -
torch.distributed.pipelining.stage.build_stage -
torch.distributed.pipelining.schedules.ScheduleGPipe -
torch.distributed.pipelining.schedules.Schedule1F1B -
torch.distributed.pipelining.schedules.ScheduleInterleaved1F1B -
torch.distributed.pipelining.schedules.ScheduleLoopedBFS -
torch.distributed.pipelining.schedules.PipelineScheduleSingle -
torch.distributed.pipelining.schedules.PipelineScheduleSingle.step -
torch.distributed.pipelining.schedules.PipelineScheduleMulti -
torch.distributed.pipelining.schedules.PipelineScheduleMulti.step -
torch.distributed.pipelining.schedules.ScheduleFlexibleInterleaved1F1B -
torch.distributed.pipelining.schedules.ScheduleInterleavedZeroBubble -