Visit tool
pypi.org
About Vllm Gguf Plugin
This plugin provides out-of-tree GGUF quantization support for vLLM after in-tree support deprecation. It uses vLLM's model implementations and a generic GGUF weight adapter.
Description summarised by AI from the sources listed below.
Use cases
- GGUF quantization for vLLM
Pricing
Pricing model: Unknown — we have not been able to confirm pricing from the official website, so nothing is stated here.
Pricing summarised by AI from the sources listed below.
