How to use GGUF in sglang or vllm?
#2
by
hermitg
- opened
No description provided.
This comment has been hidden
You will need to ask them in their Github issues or bot. At this moment we aren't as familiar with GGUFs in vllm or sglang
You will need to ask them in their Github issues or bot. At this moment we aren't as familiar with GGUFs in vllm or sglang
thanks a lot! I notice that vllm or sglang is not your project, I'm trying to move to llama.cpp
hermitg
changed discussion status to
closed