文件最后提交记录最后更新时间
init 7 个月前
新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !59 merge master into master 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 描述 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称。 ## 关联的Issue #https://gitcode.com/cann/hixl/issues/52 #https://gitcode.com/cann/hixl/issues/46 ## 测试 已经自检。 ## 文档更新 更新的md文件列表如下。 docs/cpp/LLM-DataDist接口.md docs/cpp/README.md docs/python/BlocksCacheKey.md docs/python/Cache.md docs/python/CacheKey.md docs/python/CacheKeyByIdAndIndex.md docs/python/CacheManager.md docs/python/CacheTask.md docs/python/LLMClusterInfo.md docs/python/LLMConfig.md docs/python/LLMDataDist.md docs/python/LLMException.md docs/python/LayerSynchronizer.md docs/python/README.md docs/python/TransferConfig.md docs/python/TransferWithCacheKeyConfig.md docs/python/待废弃.md ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他,请描述: See merge request: cann/hixl!595 个月前
新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !59 merge master into master 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 描述 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称。 ## 关联的Issue #https://gitcode.com/cann/hixl/issues/52 #https://gitcode.com/cann/hixl/issues/46 ## 测试 已经自检。 ## 文档更新 更新的md文件列表如下。 docs/cpp/LLM-DataDist接口.md docs/cpp/README.md docs/python/BlocksCacheKey.md docs/python/Cache.md docs/python/CacheKey.md docs/python/CacheKeyByIdAndIndex.md docs/python/CacheManager.md docs/python/CacheTask.md docs/python/LLMClusterInfo.md docs/python/LLMConfig.md docs/python/LLMDataDist.md docs/python/LLMException.md docs/python/LayerSynchronizer.md docs/python/README.md docs/python/TransferConfig.md docs/python/TransferWithCacheKeyConfig.md docs/python/待废弃.md ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他,请描述: See merge request: cann/hixl!595 个月前
修改大模型检测错误 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !99 merge master into master 修改大模型检测错误 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [ ] 新特性 - [ ] 代码重构 - [x] 文档更新 - [ ] 其他,请描述: ## 描述 <!--简要描述本次改动的背景,包括改动的原因、解决的问题等。--> 修改大模型检测错误 ## 测试项 <!--描述进行了哪些测试来验证本次改动,或新增了哪些测试用例。--> 修改大模型检测错误 ## 测试结果 <!--描述上述测试项的测试结果,可通过表格、图片等形式展示。--> 已经自检 ## Checklist <!-- [x] 表示选中 --> - [ ] 该Pull Request的代码风格和项目的代码风格一致 - [ ] 提交的代码已经过充分的验证 - [x] 涉及的相关文档修改已更新 - [ ] 标题中正确使用了类型标签(例如:feat/bugfix/refactor/docs/test等) ## 其它(可选) <!--可以在这里描述任何和该Pull Request相关的说明。--> See merge request: cann/hixl!995 个月前
修改大模型检测错误 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !99 merge master into master 修改大模型检测错误 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [ ] 新特性 - [ ] 代码重构 - [x] 文档更新 - [ ] 其他,请描述: ## 描述 <!--简要描述本次改动的背景,包括改动的原因、解决的问题等。--> 修改大模型检测错误 ## 测试项 <!--描述进行了哪些测试来验证本次改动,或新增了哪些测试用例。--> 修改大模型检测错误 ## 测试结果 <!--描述上述测试项的测试结果,可通过表格、图片等形式展示。--> 已经自检 ## Checklist <!-- [x] 表示选中 --> - [ ] 该Pull Request的代码风格和项目的代码风格一致 - [ ] 提交的代码已经过充分的验证 - [x] 涉及的相关文档修改已更新 - [ ] 标题中正确使用了类型标签(例如:feat/bugfix/refactor/docs/test等) ## 其它(可选) <!--可以在这里描述任何和该Pull Request相关的说明。--> See merge request: cann/hixl!995 个月前
新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !59 merge master into master 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 描述 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称。 ## 关联的Issue #https://gitcode.com/cann/hixl/issues/52 #https://gitcode.com/cann/hixl/issues/46 ## 测试 已经自检。 ## 文档更新 更新的md文件列表如下。 docs/cpp/LLM-DataDist接口.md docs/cpp/README.md docs/python/BlocksCacheKey.md docs/python/Cache.md docs/python/CacheKey.md docs/python/CacheKeyByIdAndIndex.md docs/python/CacheManager.md docs/python/CacheTask.md docs/python/LLMClusterInfo.md docs/python/LLMConfig.md docs/python/LLMDataDist.md docs/python/LLMException.md docs/python/LayerSynchronizer.md docs/python/README.md docs/python/TransferConfig.md docs/python/TransferWithCacheKeyConfig.md docs/python/待废弃.md ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他,请描述: See merge request: cann/hixl!595 个月前
新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !59 merge master into master 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 描述 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称。 ## 关联的Issue #https://gitcode.com/cann/hixl/issues/52 #https://gitcode.com/cann/hixl/issues/46 ## 测试 已经自检。 ## 文档更新 更新的md文件列表如下。 docs/cpp/LLM-DataDist接口.md docs/cpp/README.md docs/python/BlocksCacheKey.md docs/python/Cache.md docs/python/CacheKey.md docs/python/CacheKeyByIdAndIndex.md docs/python/CacheManager.md docs/python/CacheTask.md docs/python/LLMClusterInfo.md docs/python/LLMConfig.md docs/python/LLMDataDist.md docs/python/LLMException.md docs/python/LayerSynchronizer.md docs/python/README.md docs/python/TransferConfig.md docs/python/TransferWithCacheKeyConfig.md docs/python/待废弃.md ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他,请描述: See merge request: cann/hixl!595 个月前
新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Co-authored-by: lwx1255555<liuxiaofang17@huawei-partners.com> # message auto-generated for no-merge-commit merge: !59 merge master into master 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称 Created-by: lwx1255555 Commit-by: lwx1255555 Merged-by: cann-robot Description: ## 描述 新增TransferAsync/GetTransferStatus接口api资料。添加Notify特性相关API,另将产品名称统一修改成芯片名称。 ## 关联的Issue #https://gitcode.com/cann/hixl/issues/52 #https://gitcode.com/cann/hixl/issues/46 ## 测试 已经自检。 ## 文档更新 更新的md文件列表如下。 docs/cpp/LLM-DataDist接口.md docs/cpp/README.md docs/python/BlocksCacheKey.md docs/python/Cache.md docs/python/CacheKey.md docs/python/CacheKeyByIdAndIndex.md docs/python/CacheManager.md docs/python/CacheTask.md docs/python/LLMClusterInfo.md docs/python/LLMConfig.md docs/python/LLMDataDist.md docs/python/LLMException.md docs/python/LayerSynchronizer.md docs/python/README.md docs/python/TransferConfig.md docs/python/TransferWithCacheKeyConfig.md docs/python/待废弃.md ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他,请描述: See merge request: cann/hixl!595 个月前
init 7 个月前
README.md

接口参考(C++)

简介

  • LLM-DataDist

    • LLM-DataDist相关接口存放在:"INSTALL_DIR/include/llm_datadist/llm_datadist.h"。INSTALL_DIR请替换为CANN软件安装后文件存储路径。若安装的Ascend-cann-toolkit软件包,以root安装举例,则安装后文件存储路径为:/usr/local/Ascend/latest。
    • LLM-DataDist接口对应的库文件是:libllm_datadist.so。
  • HIXL:Huawei Xfer Library

    • HIXL相关接口存放在:"INSTALL_DIR/include/hixl/hixl.h"。INSTALL_DIR请替换为CANN软件安装后文件存储路径。若安装的Ascend-cann-toolkit软件包,以root安装举例,则安装后文件存储路径为:/usr/local/Ascend/latest。
    • HIXL接口对应的库文件是:hixl.so。

支持的产品形态如下:

  • Ascend 910B:仅支持Atlas 800I A2 推理服务器、Atlas 300I A2 推理卡、A200I A2 Box 异构组件。该场景下Server采用HCCS传输协议时,仅支持D2D。
  • Ascend 910C:该场景下采用HCCS传输协议时,不支持Host内存作为远端Cache。

接口列表

接口列表如下: