Closed
[Requirement|需求建议]: moe_ep_combine/moe_ep_dispatch优化 #5359
Yuyu-LiAdd on  Sep 16Closed at  Sep 16
Yuyu-LiCollaborators
Sep 16 Create

Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.

Backgroud(背景信息)

moe_ep_combine/moe_ep_dispatch优化

Benefit / Necessity (价值/作用)

Design(设计方案)

likedislike
YYuyu-LiCollaborators
Sep 16 Added label: requirement
游震Collaborators
Sep 16 Comments:

/assign @Yuyu-Li

likedislike
CANN-robotCANN-robotCollaborators
Sep 16 Assign Yuyu-Li as responsible person
CANN-robotCANN-robotCollaborators
Sep 16 Close issue
CANN-robotCANN-robotCollaborators
Sep 16 Added label: resolved
YYuyu-LiCollaborators
26 days ago Associated pull request
YYuyu-LiCollaborators
26 days ago Change title to "[Requirement|需求建议]: moe_ep_combine/moe_ep_dispatch优化", originally titled "[Requirement|需求建议]: moe_ep_combine优化".
YYuyu-LiCollaborators
26 days ago Modify description of issue
YYuyu-LiCollaborators
4 days ago Associated pull request
周云飞
周云飞Collaborators
4 days ago Comments:

PR #13422 已合入,为 MoE EP dispatch/combine 引入 shared_jetty 通信路径,支持单 Jetty 服务多个对端,并通过 comm_alg 参数选择通信算法。

在 combine 路径中,新增了通信算法参数校验,并通过 TilingKey 分流至对应的 kernel;shared_jetty 路径要求至少 64 个 rank,且仅支持 direct 拓扑。

关联 PR:PR #13422

likedislike