Fine-Tuning
Additional training of a pretrained model on task-specific, domain-specific, or instruction data to adapt its behavior or representation.
Boundaries
Fine-tuning changes model parameters; it should not be used as a substitute for retrieval when the requirement is to access fresh or auditable external facts.
Related Concepts
- PEFT
- LoRA
- Instruction Tuning
- Retrieval-Augmented Generation