Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
dwablimol 's Collections
Pre-training open datasets
AI use-cases
Chart2table datasets

Pre-training open datasets

updated Dec 4, 2025

Permissivly licensed datasets for LLM pre-training.

Upvote
-

  • The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

    Paper • 2506.05209 • Published Jun 5, 2025 • 61

  • HuggingFaceFW/finepdfs-edu

    Viewer • Updated Nov 11, 2025 • 49.5M • 12.6k • 89

  • PleIAs/SYNTH

    Viewer • Updated 16 days ago • 68M • 16.7k • 265

  • allenai/dolma3_pool

    Preview • Updated Feb 24 • 56.9k • 34

  • dvdmrs09/patents

    Viewer • Updated May 7, 2024 • 10.2M • 447 • 3
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs