Fine-Tuning, Instruction Tuning, LoRA, QLoRA and PEFT
Adapt a pretrained model to your task; parameter-efficient methods (LoRA/QLoRA) train small adapter weights.
Advanced
QLoRA fine-tunes large models on a single GPU by quantising the frozen base to 4 bits.
Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.
Discussion (0)
Sign in or join free to ask questions and discuss this topic.