Uni-LoRA: One Vector is All You Need

TL;DR

Low-Rank Adaptation (LoRA) has become the de facto parameter-efficient fine-tuning (PEFT) method for large language models (LLMs) by constraining weight updates to low-rank matrices…

Opening excerpt from the authors’ abstract. source