https://openreview.net/forum?id=YqYcm0mpFp
Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models | OpenReview
Adapting large language models to multiple tasks can cause cross-skill interference, where improvements for one skill degrade another. While methods such as...
representation fine tuninglarge language modelscompositionalsubspace