Arete-27B ยท training curves

Learning rate, training loss and gradient norm for every one of the 1,202 steps of the values SFT run. Hover anywhere: all three panels follow the cursor.

0.98

W&B / TensorBoard-style debiased exponential smoothing, restarted at the epoch boundary so the epoch-2 step-down is not smeared.