[Gloo] Rank 0 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 2 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 1 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 [Gloo] Rank 3 is connected to 3 peer ranks. Expected number of connected peer ranks is : 3 App: ddp_lab Mode: baseline World size: 4 Per-rank batch size: 128 Global batch size: 512 Slowest steady-state rank: 0 Slowest steady-state step time (ms): 70.24 Global steady-state throughput (samples/s): 7289.15 Average rank skew per step (ms): 11.93 rank=0 step_ms=70.24 data_ms=0.78 compute_ms=69.46 rank=1 step_ms=70.15 data_ms=0.92 compute_ms=69.23 rank=2 step_ms=70.17 data_ms=0.76 compute_ms=69.41 rank=3 step_ms=69.97 data_ms=0.87 compute_ms=69.09