---
license: gemma
base_model:
  - leon-se/gemma-3-27b-it-FP8-Dynamic
---

FP8-Dynamic quantization using llmcompressor. Run with:

```bash
vllm serve marcbuils/gemma-3-27b-it-FP8-Dynamic-tools --max-model-len 4096
```