Arete-27B · training data profile

The 28,886 examples of the values SFT run, counted exactly as the trainer tokenized them. Hover for per-bin counts.

28,886training examples
26.4Mtokens per epoch
2epochs
1,202optimizer steps
48examples per step
1e-5peak learning rate

Median 866 tokens · 95th percentile 1,633 · longest 3,642 · context window 65,536, so nothing truncates.

Examples per value category. One epoch is about 26.4M tokens; 97% are answer tokens.