Closed
[Requirement|需求建议]: 负载均衡SectionStreamK支持S1G不合轴 #4559
FiguraDogeAdd on  Aug 25Closed at  Aug 26
FiguraDogeCollaborators
Aug 25 Create

Thanks for sending an requirement! Please fill in the following template to help quickly solve your problem.

Backgroud(背景信息)

部分算子使用DN格式运算效果更佳。
此时S1G不合轴,需要负载均衡支持输出不合轴的分核方案。

Benefit / Necessity (价值/作用)

如背景所述,提升算子性能。

Design(设计方案)

  1. GeneralBalanceParam结构体
    OutputLayout字段,可以设置BN2_S1G或BN1_S1,选择输出格式。

  2. SectionStreamKFaResult结构体
    字段bN2End改为bNEnd
    字段s1GEnd改为mEnd

  3. SectionStreamKFdResult结构体
    字段bN2Idx改为bNIdx

  4. SectionStreamKImpl算法实现
    原有BN2循环支持BN1循环,BN2乘以G即可转换为BN1。
    BN1时,head的N值需要改用N1而不是N2。
    其余计算逻辑保持一致,循环逻辑改动即可。

likedislike
FFiguraDogeCollaborators
Aug 25 Added label: requirement
weihao18Collaborators
Aug 25 Comments:

/assign @ChengjiaWu

likedislike
CANN-robotCANN-robotCollaborators
Aug 25 Assign ChengjiaWu as responsible person
CANN-robotCANN-robotCollaborators
Aug 26 Close issue
CANN-robotCANN-robotCollaborators
Aug 26 Added label: resolved