Robuta

Sponsor of the Day: Jerkmate
https://huggingface.co/models?other=base_model:quantized:LilaRest/gemma-4-31B-it-NVFP4-turbo Quantized Models for LilaRest/gemma-4-31B-it-NVFP4-turbo – Hugging Face Explore machine learning models. gemma 4 31bquantized modelshugging facenvfp4turbo https://pytorch.org/blog/faster-diffusion-on-blackwell-mxfp8-and-nvfp4-with-diffusers-and-torchao/ Faster Diffusion on Blackwell: MXFP8 and NVFP4 with Diffusers and TorchAO – PyTorch fasterdiffusionblackwellmxfp8nvfp4 https://docs.vllm.ai/en/latest/api/vllm/model_executor/layers/quantization/compressed_tensors/schemes/compressed_tensors_w4a4_nvfp4/ compressed_tensors_w4a4_nvfp4 - vLLM compressed tensorsnvfp4vllm https://huggingface.co/LilaRest/gemma-4-31B-it-NVFP4-turbo/tree/main LilaRest/gemma-4-31B-it-NVFP4-turbo at main We’re on a journey to advance and democratize artificial intelligence through open source and open science. gemma 4 31bnvfp4turbomain