| [docs] A performance report of ray-ascend[yr] (#55) **Local Mode: yr direct transport VS ray actor P2P** | Setting | Tensor Count | Tensor Size (KB) | Total Size (GB) | Transport Mode | P99 Latency (s) | P95 Latency (s) | P90 Latency (s) | AVG Throughput(Gbps)| |---------|--------------|------------------|-----------------|----------------|------------------|-----------------|----------------|---| | small | 9216 | 32 | 0.28 | yr | 7.33 | 7.30 | 7.10 | 0.35| | small | 9216 | 32 | 0.28 | ray | 12.27 | 12.15 | 12.14 | 0.19 | | medium | 61440 | 128 | 7.50 | yr | 49.17| 49.09| 48.99| 1.25| | medium | 61440 | 128 | 7.50 | ray | 152.03 | 144.54 | 144.05 | 0.42| | large | 35000 | 384 | 12.81 | yr | 24.76 | 24.46 | 24.38 |4.27 | | large | 35000 | 384 | 12.81| ray | 149.16 | 148.90 | 148.14 | 0.70 | **Remote Mode:** | Setting | Tensor Count | Tensor Size (KB) | Total Size (GB) | Transport Mode | P99 Latency (s) | P95 Latency (s) | P90 Latency (s) | AVG Throughput(Gbps)| |---------|--------------|------------------|-----------------|----------------|------------------|-----------------|----------------|---| | small | 9216 | 32 | 0.28 | yr | 9.25 | 9.02 | 8.76 | 0.27| | small | 9216 | 32 | 0.28 | ray | 12.14 | 12.10 | 12.05 | 0.19 | | medium | 61440 | 128 | 7.50 | yr | 55.22| 55.15| 54.97| 1.11| | medium | 61440 | 128 | 7.50 | ray | 129.54 | 129.16 | 128.63 | 0.47 | | large | 35000 | 384 | 12.81 | yr | 30.18 | 30.14 | 29.98 |3.48 | | large | 35000 | 384 | 12.81| ray | 138.81 | 136.74 | 135.85 | 0.76 | --------- Signed-off-by: dpj135 <958208521@qq.com> | 2 个月前 |
