YYip Coekjanchore: set tonic blocking threads via env
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
perf: local shared memory for controller-worker communication (#88) * perf: local shared memory for controller-worker communication * chore: clippy & format * feat: raii for shm queue * chore: enlarge queue * chore: remove verbose log * chore: clippy & format * perf: tuning * chore: gracefully terminate worker (shm version) * fix: ExpertRegistry route mistake after rebalance action (#1) * docs: add some comments for dispatcher logic * feat: add new config for Commuicate Backend (grpc && shm) feat: add uniform get_registry for both backend * feat: set node to deactivate in db when node exit, avoiding wrong info used by schedule * chore: clippy & format * feat: allow specifying communication channel * chore: remove unused code * chore: clippy --------- Co-authored-by: Chongpeng Liu <liuchongpeng1999@foxmail.com> | 10 个月前 | |
perf: remove useless locks & replace 3rd OnceCell with std OnceLock (#85) * perf: remove useless locks & replace 3rd OnceCell with std OnceLock * chore: clippy & format | 10 个月前 | |
Add max_conn_size settings for DBConnectionPool (#20) * fix: add max_conn_size settings for * feat: refactor configuration structure * dev: update local config --------- Co-authored-by: Liu Hancheng <liuhancheng.cn@gmail.com> | 1 年前 | |
chore: clippy and format (#77) * chore: clippy * chore: manual fixes to make clippy happy * chore: cargo fmt | 10 个月前 | |
chore: set tonic blocking threads via env | 10 个月前 | |
Minor fix for running deepseek-v3 671B (#25) * feat: add torch install role * feat: convert safetensor to torch tensor without copy * dev: update ansible settings * chore: tweak rust grpc settings and coding style * dev: tweak python settings * fix: remove absolute path * feat: auto reconnect to controller * feat: use rwlock in worker * dev: load worker on start Signed-off-by: Liu Hancheng <cn_lhc@qq.com> * dev: auto reconnect * doc: update readme.md --------- Signed-off-by: Liu Hancheng <cn_lhc@qq.com> | 1 年前 | |
| 1 年前 | ||
chore: clippy and format (#77) * chore: clippy * chore: manual fixes to make clippy happy * chore: cargo fmt | 10 个月前 |