save checkpoint with error

[13613979212]

set max_steps=500, save_steps=100
When it reaches step 100, the checkpoint is saved successfully but nccl_timeout is displayed

[Muennighoff]

i think that is the first issue mentioned here: https://github.com/ContextualAI/gritlm?tab=readme-ov-file#known-issues - don't have a better solution atm than what is said there