https://openreview.net/forum?id=laZJQhzIIS
ChameleonLLM: Batch-Aware Dynamic Low-Rank Adaptation via Inference-Time Clusters | OpenReview
Recent advances in large language models (LLMs) have shown remarkable performance across diverse tasks. However, these models are typically deployed with fixed...