[Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 App: ddp_lab Mode: skew World size: 4 Per-rank batch size: 128 Global batch size: 512 Slowest steady-state rank: 1 Slowest steady-state step time (ms): 102.54 Global steady-state throughput (samples/s): 4993.20 Average rank skew per step (ms): 7.45 rank=0 step_ms=102.19 data_ms=44.64 compute_ms=57.55 rank=1 step_ms=102.54 data_ms=0.75 compute_ms=101.79 rank=2 step_ms=102.17 data_ms=0.78 compute_ms=101.39 rank=3 step_ms=102.31 data_ms=0.81 compute_ms=101.50