| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
解决批量部分失败不准确的问题&重构批量读写 Co-authored-by: yrewzjsx<zhangjinshi2@huawei.com> # message auto-generated for no-merge-commit merge: !130 merge develop into develop 解决批量部分失败不准确的问题&重构批量读写 Created-by: yrewzjsx Commit-by: yrewzjsx Merged-by: chenyz6 Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!130 | 6 个月前 | |
【性能】支持聚合个数调参 Co-authored-by: yrewzjsx<zhangjinshi2@huawei.com> # message auto-generated for no-merge-commit merge: !120 merge develop into develop 【性能】支持聚合个数调参 Created-by: yrewzjsx Commit-by: yrewzjsx Merged-by: chenyz6 Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!120 | 6 个月前 | |
【性能】支持聚合个数调参 Co-authored-by: yrewzjsx<zhangjinshi2@huawei.com> # message auto-generated for no-merge-commit merge: !120 merge develop into develop 【性能】支持聚合个数调参 Created-by: yrewzjsx Commit-by: yrewzjsx Merged-by: chenyz6 Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!120 | 6 个月前 | |
【性能】支持聚合个数调参 Co-authored-by: yrewzjsx<zhangjinshi2@huawei.com> # message auto-generated for no-merge-commit merge: !120 merge develop into develop 【性能】支持聚合个数调参 Created-by: yrewzjsx Commit-by: yrewzjsx Merged-by: chenyz6 Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!120 | 6 个月前 | |
benchmark适配mooncake Co-authored-by: m30059434<marunhua1@h-partners.com> # message auto-generated for no-merge-commit merge: !138 merge develop_fix into develop benchmark适配mooncake Created-by: mrh1024 Commit-by: m30059434 Merged-by: yrewzjsx Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [x] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!138 | 6 个月前 | |
direct拷贝方向导出 Co-authored-by: Hututu-w<wangyibing13@huawei.com> # message auto-generated for no-merge-commit merge: !304 merge rfc into develop direct拷贝方向导出 Created-by: Hututu-w Commit-by: Hututu-w Merged-by: liu1103xwxw Description: ## 变更说明 在 memcache_hybrid 模块级新增 L2G=0 / G2L=1 / G2H=2 / H2G=3 / AUTO=9 五个常量，同步修改文档及示例测试文件中的调用方式。 变更文件： 1. __init__.py — 新增常量定义，加入 __all__ 2. doc/memcache_python_api.md — SMEMB_COPY_* 替换为 memcache_hybrid.* 3. test_mmc_malloc.py — 手写 0/1 替换为 L2G/G2L 4. mutil_process.py — 手写 0/1/2 替换为 L2G/G2L/G2H See merge request: Ascend/memcache!304 | 2 个月前 | |
[fix] 解决测试脚本可能core的问题 Co-authored-by: mrh1024<marunhua1@h-partners.com> # message auto-generated for no-merge-commit merge: !232 merge develop_fix into develop [fix] 解决测试脚本可能core的问题 Created-by: mrh1024 Commit-by: mrh1024 Merged-by: yrewzjsx Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!232 | 4 个月前 | |
【性能】支持聚合个数调参 Co-authored-by: yrewzjsx<zhangjinshi2@huawei.com> # message auto-generated for no-merge-commit merge: !120 merge develop into develop 【性能】支持聚合个数调参 Created-by: yrewzjsx Commit-by: yrewzjsx Merged-by: chenyz6 Description: # Pull Request Template ## Description <!-- Provide a clear summary of the change, the problem it solves, and the technical approach. --> ## Related Issues <!-- Replace with actual issue numbers. Example: Closes #123, Related to #456 --> ## Type of Change - [ ] Bug fix - [ ] New feature - [ ] Performance optimization - [ ] Documentation update - [ ] Other (please describe):_______________ ## Testing <!-- Describe how the changes were tested. Include: - Unit/integration test coverage - Manual validation steps - Links to CI reports (e.g., CIDA) if available - Note any pending tests --> ## Checklist - [ ] I have performed a self-review of my own code. - [ ] I have updated the documentation. - [ ] I have added tests to prove my changes are effective. See merge request: Ascend/memcache!120 | 6 个月前 |
benchmark
提供python benchmark，以方便测试memcache内存池put/get性能
主要涉及如下步骤
一、启动元数据服务
export MMC_META_CONFIG_PATH=${your config path}/mmc-meta.conf;
bash bench_start_meta.sh
二、写数据测试
export MMC_LOCAL_CONFIG_PATH=${your config path}/mmc-local.conf;
bash bench_start.sh -t write -p 1 -b 16 -s 1048576 -n 100 -d 1 -e memcache -l npu
三、读数据测试
export MMC_LOCAL_CONFIG_PATH=${your config path}/mmc-local.conf;
bash bench_start.sh -t read -p 1 -b 16 -s 1048576 -n 100 -d 1 -e memcache -l npu
入参说明
| 参数 | 可选项 | 说明 |
|---|---|---|
| -t | [read, write] | 控制测试是写入数据还是读取数据 |
| -p | [1, 32] | process count, 运行的进程数量, 受限于NPU的个数 |
| -b | [1, ] | batch size, 单次IO key的个数 |
| -s | [1, ] | block size, 单次IO key对应的value的大小，单位byte |
| -n | [10, ] | call count, 循环测试次数，受限于内存池总容量，会生成 batch_size * process_count * call_count个key |
| -d | [1, 2] | 测试连续tensor（1）还是离散tensor（2），离散tensor默认为61128KB + 6116KB，连续tensor大小为block size |
| -e | [memcache, mooncake] | 内存池后端，默认支持memcache，mooncake须安装相关软件 |
| -l | [npu, cpu] | 测试数据tensor位于NPU还是CPU |