Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-2-7b-AQLM-2Bit-8x8-hf
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
123
Text Generation
Transformers
Safetensors
llama
text-generation-inference
8-bit precision
aqlm
arxiv:
2401.06118
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
cefe7f7
Llama-2-7b-AQLM-2Bit-8x8-hf
2.18 GB
3 contributors
History:
6 commits
SpiridonSunRotator
Update README.md
cefe7f7
verified
almost 2 years ago
.gitattributes
1.52 kB
initial commit
about 2 years ago
README.md
1.66 kB
Update README.md
almost 2 years ago
config.json
2.5 kB
everything
about 2 years ago
configuration_llama_aqlm.py
421 Bytes
everything
about 2 years ago
modeling_llama_aqlm.py
65.5 kB
everything
about 2 years ago
pytorch_model.bin
2.18 GB
xet
Upload pytorch_model.bin with huggingface_hub
almost 2 years ago