ORCIDGitHubLinkedIn
RSS Curriculum Vitae TR

LoRA

Turkish equivalent: Düşük dereceli uyarlamaDomain: Machine Learning

Low-Rank Adaptation, a parameter-efficient fine-tuning method that learns small low-rank update matrices while keeping most pretrained weights frozen.

Boundaries

LoRA is one parameter-efficient adaptation technique and should not be treated as synonymous with all PEFT methods.

  • PEFT
  • Fine-Tuning
  • Quantization
  • Adapter

Source

  • https://arxiv.org/abs/2106.09685

Updated:

Related concepts

Machine Learning