[Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
[Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3
App: ddp_lab
Mode: comm
World size: 4
Per-rank batch size: 128
Global batch size: 512
Slowest steady-state rank: 1
Slowest steady-state step time (ms): 271.46
Global steady-state throughput (samples/s): 1886.09
Average rank skew per step (ms): 9.10

rank=0 step_ms=271.40 data_ms=0.82 compute_ms=270.58
rank=1 step_ms=271.46 data_ms=1.03 compute_ms=270.43
rank=2 step_ms=271.41 data_ms=0.87 compute_ms=270.54
rank=3 step_ms=271.33 data_ms=0.92 compute_ms=270.41