https://www.nvidia.com/en-gb/glossary/disaggregated-serving/
What Is Disaggregated Serving? | NVIDIA Glossary
Disaggregated serving processes the prefill and decode phases of AI inference on dedicated GPUs, enabling targeted optimization of compute-bound and...