Sponsor of the Day:
Jerkmate
https://huggingface.co/models?other=base_model:quantized:LilaRest/gemma-4-31B-it-NVFP4-turbo
Quantized Models for LilaRest/gemma-4-31B-it-NVFP4-turbo – Hugging Face
Explore machine learning models.
gemma 4 31bquantized modelshugging facenvfp4turbo
https://pytorch.org/blog/faster-diffusion-on-blackwell-mxfp8-and-nvfp4-with-diffusers-and-torchao/
Faster Diffusion on Blackwell: MXFP8 and NVFP4 with Diffusers and TorchAO – PyTorch
fasterdiffusionblackwellmxfp8nvfp4
https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4/
compressed_tensors_w4a4_nvfp4 - vLLM
compressed tensorsnvfp4vllm
https://huggingface.co/LilaRest/gemma-4-31B-it-NVFP4-turbo/tree/main
LilaRest/gemma-4-31B-it-NVFP4-turbo at main
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
gemma 4 31bnvfp4turbomain