tencent

/

DeepSeek-V3.1-Terminus-W4AFP8

like 15

Follow

Tencent 7.52k

@willfalco ill give it a try. got both the intel autoround and the awq-lite running now :) awq-lite big kv cache 100k+ and 200k+ with fp8 kv cache in sglang but sglang is crashing randomly so havnt dieled it in

this could be the same as Intel/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound