| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[feat] support GDR in mooncake backend (#131) Add GDR support for mooncake backend Signed-off-by: xupinjie <xupinjie321@outlook.com> | 21 天前 | |
[feat] Provide save/load checkpoint interfaces (#124) ## Summary - Add tq.save_checkpoint(checkpoint_dir, *, include_storage, metadata) and tq.load_checkpoint(checkpoint_dir) as top-level public APIs - Controller and each storage unit write state directly to file in-process (only a bool ACK goes through Ray object store), avoiding large payload transmission over Ray - Save order: controller first, then storage units in parallel — guarantees consistency without pausing the data flow (storage unit data is always a superset of what the controller has confirmed) - Atomic save via a .tmp directory that is renamed on success and deleted on failure, ensuring no partial checkpoint is left on disk - Load validates storage unit count before touching any state; restoration is position-based (global_idx % num_units) so storage unit IDs regenerated across restarts are handled correctly Checkpoint layout: checkpoint_dir/ ├── metadata.json # timestamp, storage unit list, user metadata ├── controller_state.pkl # TransferQueueController full state └── storage_units/ ├── su_0_<id>.pkl └── su_1_<id>.pkl ## Test plan - [ ] pytest tests/e2e/test_checkpoint_e2e.py -v - save creates expected files and metadata structure - load restores controller partitions, key mappings, and per-sample tags - load restores storage data and round-trips tensors correctly across multiple partitions - include_storage=False saves only controller state - error cases: uninitialized system, missing directory/metadata, storage unit count mismatch - failed save leaves no partial directory on disk - non-tensor fields (NonTensorStack) and variable-length (jagged) tensor fields survive round-trip --------- Signed-off-by: yxstev <zhangyixiang9@huawei.com> | 29 天前 | |
[feat] Add metrics exporter and dashboard for TransferQueue (#83) Expose Prometheus metrics from the controller and storage units so TransferQueue activity can be monitored end to end. Include a Grafana dashboard and tests so the observability workflow is easier to validate and adopt. --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> | 2 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 21 天前 | ||
| 29 天前 | ||
| 2 个月前 |