Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
styal 's Collections
Fine-tuning Datasets
Pre-training Datasets

Pre-training Datasets

updated Nov 14, 2025
Upvote
-

  • HuggingFaceFW/fineweb-edu

    Viewer • Updated Jul 11, 2025 • 3.5B • 520k • 1.12k

  • mlfoundations/dclm-baseline-1.0

    Preview • Updated Jul 22, 2024 • 624k • 281

  • HuggingFaceFW/fineweb-2

    Viewer • Updated Oct 27, 2025 • 4.48B • 56.9k • 812

    Note only multimodal data =(


  • HuggingFaceTB/finemath

    Viewer • Updated Feb 6, 2025 • 48.3M • 37.6k • 364

  • bigcode/the-stack-v2

    Viewer • Updated Apr 23, 2024 • 5.45B • 17.7k • 571

    Note Don't have directly text =(


  • HuggingFaceTB/issues-kaggle-notebooks

    Viewer • Updated Mar 19, 2025 • 16.1M • 2.15k • 15

    Note only 500k rows


  • math-ai/AutoMathText

    Viewer • Updated Jul 16, 2025 • 7.89M • 9.03k • 185

    Note 1.6M rows with web-0.5-to-1.0


  • Locutusque/UltraTextbooks

    Viewer • Updated Feb 2, 2024 • 5.52M • 1.73k • 199

  • tokyotech-llm/swallow-math-v2

    Viewer • Updated Nov 6, 2025 • 17.4M • 19.9k • 31

  • tokyotech-llm/swallow-code-v2

    Viewer • Updated Nov 8, 2025 • 147M • 72.4k • 38

  • HuggingFaceFW/finepdfs-edu

    Viewer • Updated Nov 11, 2025 • 49.5M • 10.8k • 89

  • HuggingFaceTB/smollm-corpus

    Viewer • Updated Sep 6, 2024 • 237M • 58.4k • 459
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs