MINT-1T-HTML mlfoundations
๐ MINT-1T:Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens ๐ MINT-1T is an open-source Multimodal INTerleaved dataset with 1 trillion text tokens and 3.4 billion images, a 10x scale-up from existing open-source datasets. Additionally, we include previously untapped sources such as PDFs and ArXiv papers. ๐ MINT-1T is designed to facilitate research in multimodal pretraining. ๐ MINT-1T is created by a team from the University of Washington inโฆ See the full description on the dataset page: https://huggingface.co/datasets/mlfoundations/MINT-1T-HTML.
- Type
- dataset
- License
- cc-by-4.0
- Language
- en
- Downloads
- 186,938
- Likes
- 97
- Access
- public
- Files
- 0