Saga 15.45B
Built on 29 September directly from Saga 3B: 48 layers and doubled width. Since 8 October it has been training in the Fast Lane allocation on 32 nodes (128 GH200 GPUs), 1,048,576 tokens per update. Two records of that training follow: the stages computed the earlier way, and the continuation after the fix of 12 November.
Stages T9–T24 · the earlier way of computing
8 Oct–10 Nov 2026Loss after each stage · lower is better · a stage is 20.41 billion tokens
The chart loads from the recorded measurements.
T20 · ended 02/11/2026 · Polish validation set 2.4273 · 160 Polish windows 2.3797 · 160 English windows 1.7102.
T9–T20 lowered the loss on the Polish validation set from 2.4872 to 2.4273. T21 came out worse than T20, T22 and T23 diverged and have no end-of-stage measurement, and T24 with a new mixture did not beat T20 either — so further work starts from the end of T20.
Show the stage figures
| Stage | Ended | New Polish % | Polish replay % | English % | Polish validation | 160 PL windows | 160 EN windows | Notes |
|---|---|---|---|---|---|---|---|---|
| The table needs JavaScript; the same figures are in dane/saga15.json. | ||||||||
Continuation after the fix · change in loss against the end of T20
12–14 Nov 2026Windows the training never saw · 128 per source · below zero is better than the end of T20
The chart loads from the recorded measurements.
After 18,000 updates: translations −0.258 · DynaWord −0.135 · FinePDFs −0.055 · English −0.034 · earlier Polish text +0.010.
On 12 November a measurement showed that the gradient of the model's bottom blocks, computed in reduced precision, was rounding error. Since that day the eight bottom blocks have been frozen and computed in full precision, and the model went through the T24 mixture again, starting from the end of T20. The measurements in this chart are computed with the bottom blocks in full precision, so they are not directly comparable with the stage figures above. Loss measures text prediction, not conversation quality.
Show the measurement figures
| Updates | Translations | DynaWord | FinePDFs | English | Earlier Polish | Polish validation | 160 PL windows | 160 EN windows | Measurement job |
|---|---|---|---|---|---|---|---|---|---|
| The table needs JavaScript; the same figures are in dane/saga15.json. | |||||||||