How long did it take to quantize?
1
#6 opened 5 months ago
by 
stepnoy
TensorRTLLM 1.2.0rc6 Endless Stream
2
#5 opened 5 months ago
by 
mbatuhanunverdi
could we create 139B quantization with REAP for this model?
5
#2 opened 5 months ago
by 
Slach
Trying out later with 8 x RTX 5090
2
#1 opened 5 months ago
by 
crystech