summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Add mix.md: the complete data mixturejdj3 days2-0/+75
| | | | | Every source with its dataset, subsets, filters and license; the draw-weight schedule of every phase; batch, context and final stages.
* Boris-2 training codejdj3 days50-0/+11892
The code, configuration and data filters used to train Boris-2 (144M, 200B tokens, single V100): model, training loop, data preparation, n-gram table, V100 kernels, final stages and the exact run configs.