| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[docs] Clarify etcd is optional and unify OpenYuanrong naming (#51) ## Description - Clarify that etcd setup is optional for YR transport (only needed for etcd mode, metastore mode is default with no external dependencies) - Unify "OpenYuanrong" naming across all documentation files - Update environment variables section in installation.md to reference yr_transport.md instead of listing outdated env vars - Fix pip install commands to properly quote version constraints (e.g., "openyuanrong-datasystem>=0.8.0") ## Files Changed - README.md: OpenYuanrong naming - docs/developer_guide/setup.md: etcd optional clarification, naming - docs/user_guide/installation.md: etcd optional, env vars reference - docs/user_guide/yr_transport.md: naming, pip command fix - docs/user_guide/index.md: naming - ray_ascend/utils/yr_utils.py: pip command fix in error messages Signed-off-by: Haichuan Hu <kaisennhu@gmail.com> | 3 个月前 | |
[ci] add basic ci for pre-commit/build/test/doc/publish (#23) * 1. add github workflow: dco check, pre-commit, ci (build, tests), publish to github release/pypi 2. support versioning when publish Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * fix pre-commit check Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * trigger build and test on each push Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * 1. support manually-triggered workflow with publish version 2. support full installation in ci.yml Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * 1. enforce ray version >= 2.54.0 to use register tensor transport 2. merge build and test to one job 3. fix yr tensor transport Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * fix doc build ci Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * update ascend runner name Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * fix copilot nit Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * modify ci container image Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * 1. fix cann version 2. add pytest-cov to pyproject Signed-off-by: tianyi-huawei <getianyi1@huawei.com> * pip install requirements Signed-off-by: tianyi-huawei <getianyi1@huawei.com> --------- Signed-off-by: tianyi-huawei <getianyi1@huawei.com> Co-authored-by: tianyi-huawei <getianyi1@huawei.com> | 4 个月前 | |
[Doc] Fix build and doc ci workflow (#36) # Description 1. enable triggering by manual dispatch 2. if push to master, only docs changes trigger github page update 3. fix datasystem download link (download 3-days-ago version) 4. use nginx mirror on ascend machines --------- Signed-off-by: tianyi-huawei <getianyi1@huawei.com> Co-authored-by: tianyi-huawei <getianyi1@huawei.com> | 3 个月前 | |
[feat] Add HCCL tensor transport for RDT (#21) ## Description - Implement HCCLTensorTransport to integrate HCCL with RDT tensor transport flow and enable explicit registration - Add HCCL collective backend tests by using register_collective_backend API - Add tests covering HCCL tensor transport usage in RDT - Provide register_hccl_collective_backend, register_hccl_tensor_transport, and register_yr_tensor_transport API - Update the usage doc ## Self-Check Result - HCCL collective backend tests by using register_collective_backend API: bash [root@devserver-bms-54 ray-ascend]# pytest -v /home/hhc/ray_wp/ray-ascend/tests/collective/test_hccl_via_registry.py ====================================================================== test session starts ======================================================================= platform linux -- Python 3.10.16, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket=<bucket_type> rootdir: /home/hhc/ray_wp/ray-ascend configfile: pyproject.toml plugins: cov-6.2.1, hydra-core-1.3.2, jaxtyping-0.3.2, anyio-4.8.0, random-order-1.2.0, mock-3.14.1, typeguard-4.3.0 collected 6 items tests/collective/test_hccl_via_registry.py::test_allreduce PASSED [ 16%] tests/collective/test_hccl_via_registry.py::test_broadcast PASSED [ 33%] tests/collective/test_hccl_via_registry.py::test_allgather PASSED [ 50%] tests/collective/test_hccl_via_registry.py::test_reduce PASSED [ 66%] tests/collective/test_hccl_via_registry.py::test_reducescatter PASSED [ 83%] tests/collective/test_hccl_via_registry.py::test_send_recv PASSED [100%] ======================================================================== warnings summary ======================================================================== tests/collective/test_hccl_via_registry.py::test_allreduce /usr/local/python3.10.16/lib/python3.10/site-packages/ray/_private/worker.py:2052: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0 warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ========================================================================= tests coverage ========================================================================= ________________________________________________________ coverage: platform linux, python 3.10.16-final-0 ________________________________________________________ Name Stmts Miss Cover Missing --------------------------------------------------------------------------------------- ray_ascend/__init__.py 0 0 100% ray_ascend/_version.py 13 13 0% 4-34 ray_ascend/collective/__init__.py 2 0 100% ray_ascend/collective/hccl_collective_group.py 334 259 22% 30, 34-36, 65-83, 94-102, 118-119, 122-123, 126-130, 136-146, 150-162, 167, 173-181, 197-222, 241-274, 291-315, 326-333, 347-374, 393-426, 441-461, 476-496, 499-512, 524-554, 558-560, 572-585, 589-615, 625-636, 640-642, 647-653, 668-677 ray_ascend/direct_transport/__init__.py 3 3 0% 1-8 ray_ascend/direct_transport/hccl_tensor_transport.py 9 9 0% 1-22 ray_ascend/direct_transport/yr_tensor_transport.py 116 116 0% 1-253 ray_ascend/direct_transport/yr_tensor_transport_util.py 44 44 0% 1-91 --------------------------------------------------------------------------------------- TOTAL 521 444 15% Coverage HTML written to dir htmlcov Coverage XML written to file coverage.xml ============================================================ 6 passed, 1 warning in 60.06s (0:01:00) ============================================================= - HCCL tensor transport tests: bash [root@devserver-bms-54 ray-ascend]# pytest -v /home/hhc/ray_wp/ray-ascend/tests/direct_transport/test_hccl_tensor_transport.py ====================================================================== test session starts ======================================================================= platform linux -- Python 3.10.16, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket=<bucket_type> rootdir: /home/hhc/ray_wp/ray-ascend configfile: pyproject.toml plugins: cov-6.2.1, hydra-core-1.3.2, jaxtyping-0.3.2, anyio-4.8.0, random-order-1.2.0, mock-3.14.1, typeguard-4.3.0 collected 1 item tests/direct_transport/test_hccl_tensor_transport.py::test_hccl_tensor_transport PASSED [100%] ======================================================================== warnings summary ======================================================================== tests/direct_transport/test_hccl_tensor_transport.py::test_hccl_tensor_transport /usr/local/python3.10.16/lib/python3.10/site-packages/ray/_private/worker.py:2052: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0 warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ========================================================================= tests coverage ========================================================================= ________________________________________________________ coverage: platform linux, python 3.10.16-final-0 ________________________________________________________ Name Stmts Miss Cover Missing --------------------------------------------------------------------------------------- ray_ascend/__init__.py 0 0 100% ray_ascend/_version.py 13 13 0% 4-34 ray_ascend/collective/__init__.py 2 0 100% ray_ascend/collective/hccl_collective_group.py 334 259 22% 30, 34-36, 65-83, 94-102, 118-119, 122-123, 126-130, 136-146, 150-162, 167, 173-181, 197-222, 241-274, 291-315, 326-333, 347-374, 393-426, 441-461, 476-496, 499-512, 524-554, 558-560, 572-585, 589-615, 625-636, 640-642, 647-653, 668-677 ray_ascend/direct_transport/__init__.py 3 0 100% ray_ascend/direct_transport/hccl_tensor_transport.py 9 2 78% 21-22 ray_ascend/direct_transport/yr_tensor_transport.py 116 82 29% 47-49, 52, 56, 60, 66-104, 107-125, 140-152, 160-173, 185, 194-220, 238-248 ray_ascend/direct_transport/yr_tensor_transport_util.py 44 22 50% 9-10, 22-23, 46, 49, 53-55, 58-59, 62-63, 66, 71, 79, 82-83, 86-87, 90-91 --------------------------------------------------------------------------------------- TOTAL 521 378 27% Coverage HTML written to dir htmlcov Coverage XML written to file coverage.xml ============================================================ 1 passed, 1 warning in 68.25s (0:01:08) ============================================================= ## Related issues Closes #9 #3 --------- Signed-off-by: Haichuan Hu <kaisennhu@gmail.com> | 2 个月前 | |
[ci] Fix publish version update in container (#63) ## Summary Fix the publish workflow version update step in the container environment. ## Changes - Pass the release version from GITHUB_REF directly to ci/update_version.py. - Pass the commit SHA from GITHUB_SHA instead of calling git rev-parse HEAD inside the container. ## Why The self-hosted container runner can fail when running git commands inside the container. Using GitHub Actions environment variables avoids that dependency. ## Validation - Locally verified that ci/update_version.py writes the expected version and commit when given GITHUB_REF and GITHUB_SHA values. Signed-off-by: tianyi-huawei <getianyi1@huawei.com> Co-authored-by: tianyi-huawei <getianyi1@huawei.com> | 1 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 3 个月前 | ||
| 4 个月前 | ||
| 3 个月前 | ||
| 2 个月前 | ||
| 1 个月前 |