# Large Open Dataset Allowed?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flarge-open-dataset-allowed%2F90520%3E%5C
**Category:** 🤗Datasets\
**Created:** [June 5, 2024, 5:16pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flarge-open-dataset-allowed%2F90520 "2024-06-05T17:16:52Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![camyc](https://avatars.discourse-cdn.com/v4/letter/c/d6d6ee/32.png) [@camyc](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fcamyc)%5C
**Post date:** [June 5, 2024, 5:16pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flarge-open-dataset-allowed%2F90520%2F1 "2024-06-05T17:16:52Z")

</div>

Would a large, open source dataset where users can upload scraped and validated data (with more fine grained permissions wrt who can read and write data) comply with HuggingFace policies and terms of service? Data scraped by the users would be aggregated onto the large main dataset individually. Data would include text scraped from Reddit, Twitter/X, etc. and would be used to train models.