metadata
license: gemma
base_model:
- leon-se/gemma-3-27b-it-FP8-Dynamic
FP8-Dynamic quantization using llmcompressor. Run with:
vllm serve marcbuils/gemma-3-27b-it-FP8-Dynamic-tools --max-model-len 4096