PEFT, TRL, bitsandbytes, DeepSpeed and Accelerate
Hugging Face's fine-tuning stack plus memory and distributed-training tools.
Advanced
bitsandbytes provides 8/4-bit quantisation; DeepSpeed and Accelerate scale training across GPUs.
Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.
Discussion (0)
Sign in or join free to ask questions and discuss this topic.