Sponsor of the Day:
Jerkmate
https://docs.vllm.ai/projects/recipes/en/latest/Llama/Llama3.1.html
Quick Start Recipe for Llama 3.1 on vLLM - vLLM Recipes
A collection of recipes and guides for using vLLM with a variety of models.
llama 3 1quick startvllm recipes
https://docs.vllm.ai/projects/recipes/en/latest/DeepSeek/DeepSeek-OCR.html
DeepSeek-OCR Usage Guide - vLLM Recipes
A collection of recipes and guides for using vLLM with a variety of models.
deepseek ocrusage guidevllm recipes
https://docs.vllm.ai/projects/recipes/en/latest/Tencent-Hunyuan/HunyuanOCR.html
HunyuanOCR Usage Guide - vLLM Recipes
A collection of recipes and guides for using vLLM with a variety of models.
usage guidevllm recipes
https://recipes.vllm.ai/
vLLM Recipes
How do I run model X on hardware Y? Pick a model, get a working vllm serve command.
vllm recipes