summaryrefslogtreecommitdiff
path: root/mix.md
Commit message (Collapse)AuthorAgeFilesLines
* mix.md: ClimbMix was not decontaminatedHEADmainjdj14 hours1-2/+6
| | | | | | | The decontamination section said every source passes the 13-gram filter. ClimbMix was tokenized in bulk shards outside prepare.py and was not filtered, as the model card already states. Add the per-source dropped counts for the filtered sources.
* Add mix.md: the complete data mixturejdj3 days1-0/+74
Every source with its dataset, subsets, filters and license; the draw-weight schedule of every phase; batch, context and final stages.