gguf - Robuta Search

https://benchgecko.ai/model/unsloth-qwen35-4b-gguf Qwen3.5 4B GGUF · Benchmarks, Pricing & Performance | BenchGecko Qwen3.5 4B GGUF by Unsloth. Open-source model. Context window: N/A. Compare performance across AI models. gguf benchmarks pricing performance https://graysoft.dev/local/gemma-3-4b.html Gemma 3 4B Instruct to Local GGUF Alternatives | GraySoft Run Gemma 3 4B Instruct (Google) locally. Best matching GGUF models for guIDE and llama.cpp. gemma instruct local gguf alternatives https://huggingface.co/city96/FLUX.1-dev-gguf city96/FLUX.1-dev-gguf · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face flux dev gguf https://graysoft.dev/models/rea/realoperator42-olmo-3-7b-instruct-heretic-gguf.html realoperator42/Olmo-3-7B-Instruct-heretic-GGUF - Free GGUF Download | GraySoft realoperator42/Olmo-3-7B-Instruct-heretic-GGUF GGUF downloads for local AI inference with guIDE. free download olmo instruct heretic gguf https://graysoft.dev/models/s-b/s-batman-ornith-1.0-35b-nvfp4-mtp-gguf.html s-batman/Ornith-1.0-35B-NVFP4-MTP-GGUF - Free GGUF Download | GraySoft s batman/Ornith 1.0 35B NVFP4 MTP GGUF MXFP4 + Multi Token Prediction MTP heads grafted from Qwen3.6 35B A3B https://huggingface.co/Qwen/Qwen3.6 35B A3B , pack… free download batman ornith mtp gguf https://huggingface.co/mradermacher/MT7Bi-sft-GGUF mradermacher/MT7Bi-sft-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face sft gguf https://uncensorindex.com/glossary Glossary — Abliteration, UGI, ERP, GGUF · Uncensor Index Plain definitions for uncensored-AI jargon: abliteration, Heretic, Dolphin, UGI, W/10, ERP, GGUF, score tags. uncensor index glossary abliteration ugi erp https://3k888.online/setup-gemma-4-26b-a4b-it-using-pinokio-quantized-gguf/ Setup gemma-4-26B-A4B-it Using Pinokio Quantized GGUF - 3k888 Jul 8, 2026 - For the fastest local setup of this model, enabling Win [...] setup gemma using pinokio quantized https://docs.vllm.ai/en/v0.19.1/features/quantization/gguf/ GGUF - vLLM gguf vllm https://huggingface.co/LiquidAI/LFM2-8B-A1B-GGUF LiquidAI/LFM2-8B-A1B-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face liquidai gguf https://faizanbd.online/how-to-autostart-qwen3-5-397b-a17b-fp8-quantized-gguf-2026-2027-tutorial-windows/ How to Autostart Qwen3.5-397B-A17B-FP8 Quantized GGUF 2026/2027 Tutorial Windows – Faizan how to autostart quantized gguf tutorial https://estatevia.in/category/gguf/ GGUF – Estatevia gguf https://huggingface.co/tensorblock/Viper-OneCoder-UIGEN-GGUF tensorblock/Viper-OneCoder-UIGEN-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face viper gguf https://aibadgr.com/models/qwen2-5-72b-instruct-gguf Qwen2.5-72B-Instruct-GGUF: API, GPU and serving requirements Qwen2.5-72B-Instruct-GGUF availability through Badgr, 148GB minimum estimated VRAM, Source dependent context and deployment status. instruct gguf api gpu serving https://huggingface.co/nezubn/TinyLlama-1.1B-Chat-v0.3-GGUF?local-app=docker-model-runner nezubn/TinyLlama-1.1B-Chat-v0.3-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face chat gguf https://huggingface.co/unsloth/SmolLM3-3B-128K-GGUF unsloth/SmolLM3-3B-128K-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face unsloth gguf https://eligeia.com/modelos/huggingface/city96/flux.1-dev-gguf city96/FLUX.1-dev-gguf | Texto a imagen Esta es una conversión directa a GGUF de black-forest-labs/FLUX.1-dev. Dado que este es un modelo cuantizado y no uno ajustado, todas las... texto a imagen flux dev gguf https://damlaipek.com/2026/07/22/deploy-qwen3-6-35b-a3b-mtp-gguf-fully-jailbroken-for-beginners/ Deploy Qwen3.6-35B-A3B-MTP-GGUF Fully Jailbroken For Beginners – My Blog for beginners my blog deploy mtp gguf https://horebdigital.co.uk/gemma-4-12b-it-gguf-on-copilot-pc-offline-setup/ gemma-4-12b-it-GGUF on Copilot+ PC Offline Setup – Horeb Digital Technology digital technology gemma gguf copilot offline https://graysoft.dev/local/gemini-2-5-flash-reasoning-04-2025.html Gemini 2.5 Flash Preview (Reasoning) to Local GGUF Alternatives | GraySoft Run Gemini 2.5 Flash Preview (Reasoning) (Google) locally. Best matching GGUF models for guIDE and llama.cpp. gemini flash preview reasoning local https://secretai.io/models/ibm-granite/granite-4.2-3b-GGUF ibm-granite/granite-4.2-3b-GGUF - Secret AI Secret AI is a secure private LLM chatbot that runs entirely on your device - your chats stay 100% private with zero data collection, no servers, no account... ibm granite gguf secret https://www.drpriyankachauhan.in/qwen3-5-4b-gguf-for-low-vram-6gb-8gb/ Qwen3.5-4B-GGUF For Low VRAM (6GB/8GB) - Dr Priyanka Chauhan - Nishtha ENT Clinic Jul 22, 2026 - The Qwen3.5-4B-GGUF model is a powerhouse for natural language processing tasks, striking an impressive balance between performance and efficiency. With its dr priyanka gguf low vram chauhan https://metatext.ai/models/deepreinforce-ai-ornith-1.0-9b-gguf deepreinforce-ai/Ornith-1.0-9B-GGUF model by deepreinforce-ai | Metatext deepreinforce-ai/Ornith-1.0-9B-GGUF — a text-generation model on the Hugging Face Hub. ornith gguf model metatext https://aibadgr.com/models/qwen3-8-27b-abliterated-3-69bpw-12gb-mtp-gguf qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf: API, GPU and serving requirements qwen3.8-27b-abliterated-3.69bpw-12GB-MTP.gguf availability through Badgr, 58GB minimum estimated VRAM, Source dependent context and deployment status. abliterated mtp gguf api gpu https://comfyui-wiki.com/en/custom-nodes/ComfyUI-KJNodes/nodes/ggufloader-kj GGUF Loader KJ (GGUFLoaderKJ) - ComfyUI-KJNodes | ComfyUI Wiki Its core functionality is to load a main GGUF model, and optionally load and fuse a second additional model, such as a VACE module. gguf loader comfyui wiki https://nednex.com/th/what-are-safetensors/ Safetensors, CKPT, ONNX, GGUF และฟอร์แมตโมเดล AI ที่สำคัญอื่นๆ [2025] | NEDNEX Jul 5, 2025 - Save and Share: การเติบโตของปัญญาประดิษฐ์ (AI) และแมชชี… Continue reading Safetensors, CKPT, ONNX, GGUF และฟอร์แมตโมเดล AI ที่สำคัญอื่นๆ [2025] safetensors ckpt onnx gguf https://baddiinfra.org/how-to-run-qwen3-vl-2b-instruct-windows-11-quantized-gguf-2026-2027-tutorial/ How to Run Qwen3-VL-2B-Instruct Windows 11 Quantized GGUF 2026/2027 Tutorial – Baddi Infra how to run instruct windows quantized https://huggingface.co/lovedheart/Qwen3-Coder-Next-REAP-48B-A3B-GGUF/tree/main lovedheart/Qwen3-Coder-Next-REAP-48B-A3B-GGUF at main We’re on a journey to advance and democratize artificial intelligence through open source and open science. coder next reap gguf main https://huggingface.co/keyvan-ai/german-ocr-2b-gguf keyvan-ai/german-ocr-2b-gguf · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face keyvan german ocr gguf https://unsloth.ai/docs/fr/notions-de-base/dynamic-3.0-ggufs GGUF dynamiques 3.0 d'Unsloth | Unsloth Documentation gguf dynamiques unsloth documentation https://graysoft.dev/models/mra/mradermacher-doppelganger-twist-24b-i1-gguf.html mradermacher/Doppelganger-Twist-24B-i1-GGUF - Free GGUF Download | GraySoft free download doppelganger twist gguf https://aibadgr.com/models/qwen2-5-7b-instruct-gguf Qwen2.5-7B-Instruct-GGUF: API, GPU and serving requirements Qwen2.5-7B-Instruct-GGUF availability through Badgr, 18GB minimum estimated VRAM, Source dependent context and deployment status. instruct gguf api gpu serving https://huggingface.co/keyvan-ai/Mankei-1B-Chat-GGUF keyvan-ai/Mankei-1B-Chat-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face keyvan chat gguf https://www.healequ.com/index.php/2026/07/22/how-to-install-gemma-3-270m-locally-via-lm-studio-quantized-gguf-local-guide/ How to Install gemma-3-270m Locally via LM Studio Quantized GGUF Local Guide – healequ how to install lm studio local guide gemma locally https://huggingface.co/bartowski/Qwen2.5-0.5B-Instruct-GGUF/blob/main/Qwen2.5-0.5B-Instruct-Q4_0_4_4.gguf Qwen2.5-0.5B-Instruct-Q4_0_4_4.gguf · bartowski/Qwen2.5-0.5B-Instruct-GGUF at main We’re on a journey to advance and democratize artificial intelligence through open source and open science. instruct gguf bartowski main https://benoit.gouthiere.be/guides/gpu-cloud-ia/llm-open-source-europe/quantisation-gguf-awq-reduire-vram/ Quantisation LLM : GGUF ou AWQ pour réduire la VRAM et le prix Sep 27, 2026 - GGUF, AWQ, GPTQ, FP8 : la mémoire que chaque format de quantisation fait gagner, la qualité qu'il coûte selon les mesures publiées, et la carte qui suffit. quantisation llm gguf awq pour https://fmsnz.com/zero-click-run-qwen3-6-35b-a3b-gguf-on-amd-nvidia-gpu-with-native-fp4-5-minute-setup/ Zero-Click Run Qwen3.6-35B-A3B-GGUF on AMD/Nvidia GPU with Native FP4 5-Minute Setup - fmsnz Jun 30, 2026 - Setting up this model locally is incredibly fast if you use the native CMD prompt. Execute the commands and steps outlined below. Everything happens... zero click nvidia gpu run gguf amd https://huggingface.co/DevQuasar/ArliAI.GLM-4.5-Air-Derestricted-GGUF?local-app=docker-model-runner DevQuasar/ArliAI.GLM-4.5-Air-Derestricted-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face glm air derestricted gguf https://aibadgr.com/models/qwen3-coder-30b-a3b-instruct-gguf Qwen3-Coder-30B-A3B-Instruct-GGUF: API, GPU and serving requirements Qwen3-Coder-30B-A3B-Instruct-GGUF availability through Badgr, 64GB minimum estimated VRAM, Source dependent context and deployment status. coder instruct gguf api gpu https://deviconinv.com/how-to-launch-gemma-3-1b-it-glm-4-7-flash-heretic-uncensored-thinking_gguf-on-amd-nvidia-gpu-uncensored-edition-local-guide/ How to Launch Gemma-3-1B-it-GLM-4.7-Flash-Heretic-Uncensored-Thinking_GGUF on AMD/Nvidia GPU... how to nvidia gpu launch gemma glm https://replicate.com/andreasjansson/llama-2-13b-gguf/examples Examples – andreasjansson/llama-2-13b-gguf | Replicate examples andreasjansson llama gguf replicate https://vibecodingthailand.com/blog/qwen3-8-flash-next-local Qwen3.8-Flash-Next GGUF รันในเครื่องได้ฟรี ถ้าเครื่องคุณรองรับไฟล์ขนาด 72.5 GB | Vibe Coding... Aug 28, 2026 - Qwen3.8-Flash-Next เปิดให้โหลดไฟล์ GGUF ไปรันบนเครื่องได้ฟรี แต่ไฟล์เล็กสุดมีขนาด 72.5 GB สรุปให้ดูว่าต้องมีเครื่องแบบไหนถึงรันไหว และใครยังไม่ต้องรีบโหลด vibe coding flash next gguf https://tenzro.com/models/qwen-image-gguf Qwen-Image 2512 (GGUF Q5_K_M) — Tenzro Qwen-Image 2512 text-to-image, Q5_K_M GGUF transformer qwen image gguf https://tsimport.pl/gemma-4-26b-a4b-it-qat-gguf-100-private-pc-full-speed-npu-mode/ gemma-4-26B-A4B-it-qat-GGUF 100% Private PC Full Speed NPU Mode - TSIMPORT - Import samochod贸w z... Jul 5, 2026 - Using a native PowerShell script is the absolute quickest way to install this model. Simply follow the directions outlined below. Hands-free setup: the system... full speed gemma qat gguf private https://modelscope.cn/models/unsloth/Qwen3-8B-GGUF Qwen3-8B-GGUF - ModelScope 魔搭社区 Qwen3-8B-GGUF - unsloth 在 ModelScope 开源的模型。 gguf modelscope https://xutrom.com/2026/07/10/how-to-install-gemma-4-e4b-it-quantized-gguf-complete-walkthrough/ How to Install gemma-4-E4B-it Quantized GGUF Complete Walkthrough – Xutrom how to install gemma quantized gguf complete https://kblip.com/releases/i-built-a-single-c99-inference-engine-that-runs-both-bitnet-Q0IvS6w I built a single C99 inference engine that runs both BitNet (ternary) and regular GGUF models - no... A developer released Project Zero, an inference engine written from scratch in pure C99 that runs both 1.58-bit ternary BitNet models and standard dense GGUF... a single inference engine built runs bitnet https://huggingface.co/voodooquant/Qwen3.5-2B-MTP-Voodoo/blob/main/Qwen3.5-2B-MTP.Voodoo60_IQ4_XS.gguf Qwen3.5-2B-MTP.Voodoo60_IQ4_XS.gguf · voodooquant/Qwen3.5-2B-MTP-Voodoo at main We’re on a journey to advance and democratize artificial intelligence through open source and open science. mtp gguf voodoo main https://man1kapuashulu.sch.id/install-qwen3-30b-a3b-instruct-2507-gguf-windows-11-step-by-step/ Install Qwen3-30B-A3B-Instruct-2507-GGUF Windows 11 Step-by-Step install instruct gguf windows step https://dev.modelhub.org.cn/bartowski/FuseChat-Llama-3.1-8B-Instruct-GGUF/src/branch/main/FuseChat-Llama-3.1-8B-Instruct-Q5_K_L.gguf FuseChat-Llama-3.1-8B-Instruct-GGUF/FuseChat-Llama-3.1-8B-Instruct-Q5_K_L.gguf at main -... FuseChat-Llama-3.1-8B-Instruct-GGUF - Model synced from source: bartowski/FuseChat-Llama-3.1-8B-Instruct-GGUF k l llama instruct gguf main https://aibadgr.com/models/neohorse-1-4b-gguf NeoHorse-1-4B-GGUF: API, GPU and serving requirements NeoHorse-1-4B-GGUF availability through Badgr, 12GB minimum estimated VRAM, Source dependent context and deployment status. gguf api gpu serving requirements https://www.endorlabs.com/ai-model/bartowski-phi-3-5-mini-instruct-gguf bartowski/Phi-3.5-mini-instruct-GGUF | Endor Labs bartowski/Phi-3.5-mini-instruct-GGUF AI model with 52653 downloads bartowski phi mini instruct gguf https://sparknlp.org/api/python/reference/autosummary/sparknlp/annotator/embeddings/auto_gguf_embeddings/index.html sparknlp.annotator.embeddings.auto_gguf_embeddings — Spark NLP 7.0.0 documentation spark nlp annotator embeddings auto gguf https://graysoft.dev/local/qwen3-vl-30b-a3b-reasoning.html Qwen3 VL 30B A3B (Reasoning) to Local GGUF Alternatives | GraySoft Run Qwen3 VL 30B A3B (Reasoning) (Alibaba) locally. Best matching GGUF models for guIDE and llama.cpp. reasoning local gguf alternatives https://samudratoys.co.id/2026/07/10/how-to-deploy-qwen3-6-35b-a3b-fp8-using-pinokio-quantized-gguf-full-method-windows/ How to Deploy Qwen3.6-35B-A3B-FP8 Using Pinokio Quantized GGUF Full Method Windows –... how to deploy using pinokio quantized gguf https://eligeia.com/modelos/huggingface/quantstack/flux.1-krea-dev-gguf QuantStack/FLUX.1-Krea-dev-GGUF | Texto a imagen Conversión directa a formato GGUF del modelo black-forest-labs/FLUX.1-Krea-dev. Es una versión cuantizada de un modelo de texto a imagen basado en la... texto a imagen flux krea dev gguf https://huggingface.co/DevQuasar/ArliAI.GLM-4.5-Air-Derestricted-GGUF?local-app=hermes-agent DevQuasar/ArliAI.GLM-4.5-Air-Derestricted-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face glm air derestricted gguf https://aibadgr.com/models/qwen3-8-4b-distill-gguf Qwen3.8-4B-Distill-GGUF: API, GPU and serving requirements Qwen3.8-4B-Distill-GGUF availability through Badgr, 12GB minimum estimated VRAM, Source dependent context, apache-2.0 licence and deployment status. distill gguf api gpu serving https://aibadgr.com/models/gemma-2-2b-it-abliterated-gguf gemma-2-2b-it-abliterated-GGUF: API, GPU and serving requirements gemma-2-2b-it-abliterated-GGUF availability through Badgr, 8GB minimum estimated VRAM, Source dependent context and deployment status. gemma abliterated gguf api gpu https://chatgpt5.app/news/gguf-format-kak-szhimayut-bolshie/ GGUF формат: как сжимают большие модели до компактного вида Sep 15, 2026 - GGUF — стандарт квантизации, позволяющий снизить вес моделей в 4-8 раз без значительной потери качества. gguf https://pgxxx.shop/how-to-setup-qwen3-6-27b-gguf-offline-on-pc-windows/ How to Setup Qwen3.6-27B-GGUF Offline on PC Windows - pgxxx Jul 14, 2026 - Running this model locally is fastest when deployed thr [...] how to setup pc windows gguf offline https://www.modelscope.cn/models/unsloth/GLM-5.3-Flash-GGUF GLM-5.3-Flash-GGUF - ModelScope 魔搭社区 GLM-5.3-Flash-GGUF - unsloth 在 ModelScope 开源的模型。 glm flash gguf modelscope https://ayinedjimi-consultants.fr/cve/cve-2026-5760-sglang-gguf-rce CVE-2026-5760 : RCE via GGUF malveillant dans SGLang (9.8) Oct 5, 2026 - Faille critique SGLang CVE-2026-5760 CVSS 9.8 : RCE via modele GGUF malveillant exploitant une SSTI Jinja2 dans le reranking endpoint des frameworks LLM. cve rce via gguf malveillant https://www.zerosuniverse.com/tools/local-llm-vram-calculator/ Local LLM VRAM & Ollama Speed Calculator (2026) — GGUF Sizing | ZerosUniverse Calculate GPU VRAM and Apple Silicon Unified Memory needed for local LLMs (1.5B–671B) across FP16, Q8_0, Q4_K_M, and Q3_K_M with KV-cache and tokens/sec. local llm vram ollama speed calculator https://modelfit.io/quant-compare/qwen3.6-27b Qwen3.6 27B GGUF Quantization Compared Every Qwen3.6 27B GGUF quant with real file sizes: Q4_K_M is 16.75 GB and fits 24 GB of memory. KV-cache math, fit verdicts per tier gguf quantization compared https://huggingface.co/LiquidAI/LFM2-350M-PII-Extract-JP-GGUF LiquidAI/LFM2-350M-PII-Extract-JP-GGUF · Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. hugging face liquidai pii extract gguf https://graysoft.dev/models/ma7/ma7ee7-qwen3.8-4b-distilled-gguf.html Ma7ee7/Qwen3.8_4B_Distilled_GGUF - Free GGUF Download | GraySoft Qwen3.8 4B Distilled — GGUF GGUF quantizations of Ma7ee7/Qwen3.8 4B Distilled https://huggingface.co/Ma7ee7/Qwen3.8 4B Distilled for use with llama.cpp, LM Stu… free download distilled gguf https://graysoft.dev/models/and/andreaborio-qwen3.6-35b-a3b-ds4-gguf.html andreaborio/Qwen3.6-35B-A3B-DS4-GGUF - Free GGUF Download | GraySoft Qwen3.6 35B A3B DS4 GGUF releases This repository keeps the versioned Qwen3.6 35B A3B DS4 releases for andreaborio/ds4 https://github.com/andreaborio/ds4 . Its… free download gguf https://graysoft.dev/models/mra/mradermacher-qwen3.8-14b-instruct-turbo-gguf.html mradermacher/Qwen3.8-14B-Instruct-Turbo-GGUF - Free GGUF Download | GraySoft free download instruct turbo gguf https://graysoft.dev/models/abt/abteexailab-lumynax-infused-olmo2-7b-1124-gguf.html AbteeXAILab/lumynax-infused-olmo2-7b-1124-gguf - Free GGUF Download | GraySoft LumynaX Infused OLMo 2 1124 7B Instruct GGUF Legacy release · Outdated research artifact This model card documents an early LumynaX experiment. It is no longer… free download infused gguf https://hfviewer.com/JonathanColetti/Qwen3.8-27B-Uncensored-GGUF Architecture graph for JonathanColetti/Qwen3.8-27B-Uncensored-GGUF | hfviewer JonathanColetti/Qwen3.8-27B-Uncensored-GGUF: text-generation model with Grouped-query attention (GQA), Linear attention (gated DeltaNet), QK-Norm. architecture graph uncensored gguf https://seedvr2.net/blog/tutorials/seedvr2-v25-installation-guide-2026 SeedVR2 ComfyUI Install: 3B INT8 convrot.safetensors, GGUF seedvr2_3b_int8_convrot.safetensors in ComfyUI/models/diffusion_models; seedvr2_ema_vae_fp16.safetensors in models/vae. GGUF vs INT8, missing nodes, OOM fixes. comfyui install safetensors gguf