Instructions to use HuggingFaceFW/fineweb-edu-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HuggingFaceFW/fineweb-edu-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="HuggingFaceFW/fineweb-edu-classifier")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("HuggingFaceFW/fineweb-edu-classifier") model = AutoModelForSequenceClassification.from_pretrained("HuggingFaceFW/fineweb-edu-classifier", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Commit History
-
add dataset metadata (#8)
Verified signature- add dataset metadata (d1156cd6f28d1646505dd9ddc48edc0eed277a2a) Co-authored-by: Daniel van Strien <davanstrien@users.noreply.huggingface.co>284663c
-
fix example code (#2)
Verified signature- fix example code (606df5fa509bfdd6b8800b7a72bd2c63403dccf1) Co-authored-by: Peter Szemraj <pszemraj@users.noreply.huggingface.co>6974c5d
-
Update README.md
Verified signature8538ab0 -
Update src/run_edu_bert.slurm
Verified signature15539d6 -
Update src/train_edu_bert.slurm
Verified signaturef1f90a4 -
Update src/train_edu_bert.py
Verified signature5d7bce6 -
Update src/run_edu_bert.py
Verified signatured7b750e
-
release
172e214
-
Update README.md
Verified signaturee160ef4 -
Update README.md
Verified signature63f8cb7
-
Update README.md
Verified signatureb20d047 -
Update README.md
Verified signaturebd3139f -
Create utils/prompt.txt
Verified signature3569ab4 -
Update README.md
Verified signatured72896d -
Update README.md
Verified signature9a0e0e6
-
Create README.md
Verified signature215da67
-
27000
af020c6 -
7000
aa96e7a -
initial commit
Verified signature9b9e7c8