https://friendli.ai/blog/friendli-tcache-flexible-multimodal-prefix-caching
Friendli TCache: Flexible Multimodal Prefix Caching
Friendli TCache expands prefix caching beyond text, enabling support for multimodal inputs like image and video embeddings. This unlocks faster inference and...
friendlitcacheflexiblemultimodalprefix