HuggingFaceFW/dclm_100BT
Viewer
•
Updated
•
89.3M
•
292
Smol-Data
Tried and tested mixes for strong pretraining
-
-
HuggingFaceFW/dclm_100BT-shuffled
Viewer • Updated • 89.3M • 12 -
HuggingFaceFW/finepdfs_100BT
Viewer • Updated • 29.9M • 2.22k -
HuggingFaceFW/finepdfs_100BT-shuffled
Viewer • Updated • 14.6M • 28 -
HuggingFaceFW/finepdfs_edu_100BT
Viewer • Updated • 17.8M • 1.7k -
HuggingFaceFW/finepdfs_edu_100BT-shuffled
Viewer • Updated • 17.8M • 144 -
HuggingFaceFW/fineweb_100BT
Viewer • Updated • 161M • 132 -
HuggingFaceFW/fineweb_100BT-shuffled
Viewer • Updated • 161M • 15 -
HuggingFaceFW/fineweb_edu_100BT
Viewer • Updated • 102M • 380 -
HuggingFaceFW/fineweb_edu_100BT-shuffled
Viewer • Updated • 102M • 167 -
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 56.1M • 10.9k -
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 56.1M • 46 -
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 62.1M • 1.32k -
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 62.1M • 24 • 2