master

cann-robot自动选取可用网卡

0e6fffaa创建于 9 小时前历史提交

文件	最后提交记录	最后更新时间
config_store	自动选取可用网卡 Co-authored-by: zhangyunqi<zhangyunqi5@huawei.com> # message auto-generated for no-merge-commit merge: !368 merge fix/auto-select-network-interface into master 自动选取可用网卡 Created-by: zhangyunqi Commit-by: zhangyunqi Merged-by: cann-robot Description: ## 描述 <!--在这里详细描述你的改动，包括改动的原因和所采取的方法。--> 自动选取可用网卡 ## 关联的Issue <!-- 如果这个PR是为了解决特定的Issue，请在这里提供Issue链接。例如：关联Issue #123--> https://gitcode.com/cann/shmem/issues/268 ## 测试 <!--描述进行了哪些测试来验证你的改动。包括但不限于二级冒烟、算子泛化等。--> 不指定环境变量自动搜索   指定环境变量  无可用网卡  ## 文档更新 <!--如果这个PR包含文档的更新，请在这里指出。例如：更新了README.md文件。--> ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [ ] 文档更新 - [ ] 其他，请描述： See merge request: cann/shmem!368	9 小时前
socket	cleancode整改v1 Co-authored-by: zhangyunqi<zhangyunqi5@huawei.com> # message auto-generated for no-merge-commit merge: !215 merge sscleancode into master cleancode整改v1 Created-by: zhangyunqi Commit-by: zhangyunqi Merged-by: cann-robot Description: ## 描述 <!--在这里详细描述你的改动，包括改动的原因和所采取的方法。--> cleancode ## 关联的Issue <!-- 如果这个PR是为了解决特定的Issue，请在这里提供Issue链接。例如：关联Issue #123--> <!-- 如果这个PR是为了解决特定的问题单，请在这里描述问题单单号。--> https://gitcode.com/cann/shmem/issues/149 ## 测试 <!--描述进行了哪些测试来验证你的改动。包括但不限于二级冒烟、算子泛化等。--> ## 文档更新 <!--如果这个PR包含文档的更新，请在这里指出。例如：更新了README.md文件。--> ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [ ] 新特性 - [ ] 性能优化 - [ ] 文档更新 - [x] 其他，请描述：cleancode See merge request: cann/shmem!215	2 个月前
shmemi_bootstrap_config_store.cpp	feat(issue-280): [Task|任务]: namespace 整改 Co-authored-by: nino888<yinqiran1@huawei.com> # message auto-generated for no-merge-commit merge: !387 merge autodev/issue-280 into master feat(issue-280): [Task|任务]: namespace 整改 Created-by: nino888 Commit-by: nino888 Merged-by: cann-robot Description: ## Summary - Implement issue #280: [Task|任务]: namespace 整改 - Source issue: https://gitcode.com/cann/shmem/issues/280 - Branch: autodev/issue-280 (nino888/shmem -> cann/shmem) ## Changes - examples/dispatch_gmm_combine/include/dispatch_gmm_combine.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_init_routing_quant_v2.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_common.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_expert_token_out.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_fullload_dynamic_quant.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_fullload_quant.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_fullload_quant_base.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_gather_dynamic_quant.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_gather_quant.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_mrgsort.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_mrgsort_out.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_sort_base.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_sort_multi_core.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_sort_one_core.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_src_to_dst_and_gather.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_src_to_dst_op.h - examples/dispatch_gmm_combine/include/moe_init_routing_quant_v2/moe_v2_src_to_dst_with_capacity.h - examples/dispatch_gmm_combine/include/moe_token_unpermute.h - examples/dispatch_gmm_combine/include/select_helper.h - examples/dispatch_gmm_combine/include/sync_util.h - examples/dynamic_tiling/impl/kernel/allgather_matmul.h - examples/dynamic_tiling/impl/kernel/allgather_matmul_padding.h - examples/dynamic_tiling/impl/kernel/allgather_matmul_with_gather_result.h - examples/dynamic_tiling/impl/kernel/matmul_allreduce.h - examples/dynamic_tiling/impl/kernel/matmul_reduce_scatter.h - examples/dynamic_tiling/impl/kernel/matmul_reduce_scatter_padding_a.h - examples/dynamic_tiling/impl/kernel/matmul_reduce_scatter_padding_ab.h - examples/dynamic_tiling/impl/kernel/matmul_reduce_scatter_padding_b.h - examples/matmul_allreduce/epilogue/block/epilogue_allreduce.hpp - src/device/gm2gm/shmemi_device_rma.cpp - src/host/bootstrap/shmemi_bootstrap_config_store.cpp - src/host/data_plane/shmem_host_rma.cpp - src/host/entity/mem_entity_default.cpp - src/host/entity/mem_entity_entry.cpp - src/host/init/shmem_init.cpp - src/host/mem/heap/hybm_vmm_based_segment.cpp - src/host/mem/shmem_rma.cpp - src/host/team/shmem_team.cpp - src/host/transport/transport_manager.cpp ## Local Validation - echo 'TODO: replace with real tests, e.g. pytest -q': passed See merge request: cann/shmem!387	10 小时前
shmemi_bootstrap_mpi.cpp	[Feature] Multi Instance 1.0 Co-authored-by: zhu-wangyi<zhuwangyi@huawei.com> # message auto-generated for no-merge-commit merge: !155 merge feature/multi_instance_master into master SHMEM多实例特性添加 Created-by: zhu-wangyi Commit-by: zhu-wangyi Merged-by: cann-robot Description: ## 描述 <!--在这里详细描述你的改动，包括改动的原因和所采取的方法。--> ## 关联的Issue <!-- 如果这个PR是为了解决特定的Issue，请在这里提供Issue链接。例如：关联Issue #123--> <!-- 如果这个PR是为了解决特定的问题单，请在这里描述问题单单号。--> ## 测试 新增init uid多实例测试结果   h2d能力测试结果  h2d多实例测试结果  python_extension测试结果  ## 文档更新 <!--如果这个PR包含文档的更新，请在这里指出。例如：更新了README.md文件。--> ## 类型标签 <!-- [x] 表示选中 --> - [ ] Bug修复 - [x] 新特性 - [ ] 性能优化 - [x] 文档更新 - [ ] 其他，请描述： See merge request: cann/shmem!155	2 个月前
shmemi_bootstrap_uid.cpp	Fix #231: Complete security validation with zero-overhead device checks Co-authored-by: suqwe<sujianjia@huawei.com> # message auto-generated for no-merge-commit merge: !306 merge fix-issue-231-port-validation into master Fix #231: Complete security validation with zero-overhead device checks Created-by: suqwe Commit-by: suqwe Merged-by: cann-robot Description: #描述 ## Problems Fixed (6 Security Issues) This PR addresses all 6 security vulnerabilities reported in Issue #231. ### ✅ Problem 0 & 1: Port Parsing Validation (CWE-197) **Files**: - src/host/bootstrap/shmemi_bootstrap_uid.cpp - src/host/init/shmem_init.cpp **Issue**: std::stoi() result directly cast to uint16_t without range check - Truncation: 65536→0, -1→65535 - Security impact: unexpected port binding **Fix**: Parse to int, validate [0,65535], error logging, safe cast --- ### ✅ Problem 2: ASCEND_HOME_PATH Library Loading (CWE-426) **File**: src/host/entity/mem_entity_entry.cpp **Issue**: Environment variable controls library loading path - No owner/permission validation - Attackers can load malicious .so **Fix**: Added IsOwnedByCurrentUserOrRoot + HasSecurePermissions checks --- ### ✅ Problem 3: SHMEM_LOG_PATH Log Directory (CWE-73) **File**: src/host/utils/log/shmemi_logger.cpp **Issue**: Environment variable controls log directory - No realpath/owner/permission validation - Attackers can redirect logs to arbitrary paths **Fix**: Added Realpath + owner/permission checks with fallback to /tmp/shmem/log --- ### ✅ Problem 4: GetFileSize() ftell() Error (CWE-197) **File**: src/host/utils/shmemi_file_util.h **Issue**: ftell() returns -1L on failure, cast to SIZE_MAX - Wrong file size propagates downstream **Fix**: Check ftell() == -1L, return 0 on error --- ### ✅ Problem 5: sysconf() Truncation + VLA Overflow (CWE-119) **File**: src/host/utils/log/shmemi_logger.cpp **Issue**: - int truncates sysconf() long result - VLA char buffer[bufsize] non-standard - negative bufsize in memset causes overflow **Fix**: Use long, validate range, replace VLA with std::vector --- ### ✅ Problem 6: PE Array Access (CWE-129) **File**: src/device/gm2gm/engine/shmem_device_rdma.hpp **Issue**: pe parameter unvalidated, causes OOB read - pe < 0 or pe >= npes causes memory corruption **Fix**: Device不进行校验 --- ## 🔐 New Security Functions Added 3 reusable validation functions: 1. **IsOwnedByCurrentUserOrRoot(path)** - Check if path owner is current user or root - Prevent loading from untrusted paths 2. **HasSecurePermissions(path)** - Check no write permission for group/others - Prevent tampering with files --- ## 🚀 Device Performance Optimization **Zero-overhead design**: Device不进行校验 --- ## ✅ Testing Results ✅ Port validation: [0,65535] accepted, out-of-range rejected ✅ Path owner: current user/root accepted, others rejected ✅ Path permissions: secure accepted, insecure rejected ✅ ftell() error: returns 0 instead of SIZE_MAX ✅ sysconf() range: validates bufsize <= 1MB --- Fixes #231 See merge request: cann/shmem!306	15 天前