| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
fix(build): align coordinator packages | 3 天前 | |
build: gate HCCS RH2D on HIXL 8.5.2 | 1 个月前 | |
fix(build): revert tags select + add missing st_cluster/ut_object brpc deps Three independent build fixes that together unblock all bazel ST/level0 tests and compilation: 1. Revert ds_cc_test tags select (commit 34c515c3 regression): Bazel's cc_test.tags attribute is non-configurable — using select() there breaks the entire load phase with "attribute 'tags' is not configurable" for every ds_cc_test target, making all bazel tests unrunnable. Reverted to tags = tags + ["ds_test"]. 2. Add missing brpc deps to st_cluster (commit ec6e80edf regression): base_cluster.h includes brpc_factory.h, rpc_stub_cache_mgr.h, and generic_service.brpc.stub.pb.h, but st_cluster's BUILD deps were never updated. Added three targets. 3. Add ut_object_brpc genrule (missing since ut_object.proto added): ut_object.proto defines service UtOCService (9 RPC methods), so the brpc adapter produces ut_object.irpc.pb.h. st_oc_service_impl.h includes it but no bazel target existed. Added genrule + cc_library and wired the dep into st_common. is_asan/is_tsan config_settings and .bazelrc defines are kept for a future correct implementation of sanitizer auto-tagging. | 1 天前 | |
feat:Support three steps pipeline rh2d Three steps pipeline: 1. worker2 -> worker1: urma write 2. worker1 -> kvclient: share memory queue 3. kvclient -> gpu: cuda The main idea diff from two step pipeline lays sending chunk info from worker1 to kvclient by share memory queue. Changes: 1. enlarge chunk maxsize from 16m to 4G 2. pin cuda memory in connecting stage 3. support timeout cancelling pipeline in kvclient and worker 4. make client request id atomic. 5. add vlog for pipeline debuging 6. auto find os-transport lib without installing rpm 7. support gpu id and gpu uuid as connection args 8. rename H2DParam to PiplnRh2dParam 9. worker don't need cuda lib 10. clean up worker rpc channel when worker lost Signed-off-by: mszjaas <mszjaas@qq.com> | 1 个月前 | |
Supply "coordinator_server.h" and "libdatasystem_coordinator.so" to user. | 12 天前 | |
feat(build): Bazel与CMake编译产物对齐 重写Bazel编译安装逻辑,使output/目录结构与CMake编译产物完全对齐。 主要变更: - 重写_bazel_install_outputs(),从bazel-bin独立产物组装output/目录 - 添加strip/sym genrule(objcopy --add-gnu-debuglink) - 添加cc_shared_library用于worker共享库 - 创建自定义Bazel规则生成CMake find_package配置 - 重命名worker shared lib为libdatasystem_worker.so(匹配CMake) - 更新bazel_build.md文档(build.sh -b bazel用法+高级选项) - 移除worker_config_bazel.json,统一使用worker_config.json Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> | 3 个月前 | |
Supply "coordinator_server.h" and "libdatasystem_coordinator.so" to user. | 12 天前 | |
build: add braft v1.1.2 dependency | 3 天前 | |
lib version update | 3 个月前 | |
For whl packages built with Bazel, dscli --version now displays the commit ID. | 3 个月前 | |
build: use bazel stamping for git version | 1 个月前 | |
add bazel build | 3 个月前 | |
Refactory bazel build for third party deps | 3 个月前 | |
Set default python version for wheel bazel build | 3 个月前 | |
build: use bazel stamping for git version | 1 个月前 | |
refactor(zmq): remove dead enableExclusiveConnection feature The exclusive per-thread UDS connection optimization was ZMQ-only (gated by !FLAGS_use_brpc everywhere) and is already a no-op in brpc mode. Remove it entirely as the repo migrates to brpc. Removes: - ConnectOptions.enableExclusiveConnection + all client API plumbing (ObjectClientImpl/CloneWith/pybind/4 Python clients/docs) - proto fields enable_exclusive_connection(11) + exclusive_conn_sockpath(21) - ExclusiveConnMgr + work_agent (orphaned by the removal) - ZmqService exclusive listener/SendErrorMaxExclusive/ProcessAccept excl branch - ZmqStub::SetExclusiveConnInfo + exclusiveId_/exclusiveSockPath_ - ClientUnaryWriterReaderImpl exclusive branches (Init/Is/SendConnMsg/RecvConnReply) - stub generator templates (zmq + brpc) + exclusiveId_ branch - PerfKey ZMQ_STUB_TO_EXCL_CONN - dedicated tests (client_get_test ExclusiveConn fixture, kv_cache_exclusive_client_test) Preserves SHM data path: IsShmEnableByUDS, SetServiceUdsEnabled, UnixSockFd, fd-passing, mmap unchanged (IsShmEnableByUDS is shared SHM infra, not exclusive-conn-owned). Verified: bazel build //bazel:datasystem_wheel + cmake build/install both pass; worker deployed via dscli, KVClient Set/Get/Exist/Delete/TTL pass. Breaking: Python client ctors drop enable_exclusive_connection param. Co-Authored-By: Claude <noreply@anthropic.com> | 10 天前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 3 天前 | ||
| 1 个月前 | ||
| 1 天前 | ||
| 1 个月前 | ||
| 12 天前 | ||
| 3 个月前 | ||
| 12 天前 | ||
| 3 天前 | ||
| 3 个月前 | ||
| 3 个月前 | ||
| 1 个月前 | ||
| 3 个月前 | ||
| 3 个月前 | ||
| 3 个月前 | ||
| 1 个月前 | ||
| 10 天前 |