falcon-refinedweb tiiuae
๐ Falcon RefinedWeb Falcon RefinedWeb is a massive English web dataset built by TII and released under an ODC-By 1.0 license. See the ๐ paper on arXiv for more details. RefinedWeb is built through stringent filtering and large-scale deduplication of CommonCrawl; we found models trained on RefinedWeb to achieve performance in-line or better than models trained on curated datasets, while only relying on web data. RefinedWeb is also "multimodal-friendly": it contains links andโฆ See the full description on the dataset page: https://huggingface.co/datasets/tiiuae/falcon-refinedweb.
- Type
- dataset
- License
- odc-by
- Language
- en
- Downloads
- 93,564
- Likes
- 947
- Access
- public
- Files
- 0
README
--- dataset_info: features: - name: content dtype: string - name: url dtype: string - name: timestamp dtype: timestamp[s] - name: dump dtype: string - name: segment dtype: string - name: image_urls sequence: sequence: string splits: - name: train num_bytes: 2766953721769 num_examples: 968000015 dowโฆ