Fine-tuning vs Prompting vs RAG: LoRA and QLoRA Cheatsheet

A practical cheatsheet for choosing between prompting, retrieval and fine-tuning, and for doing parameter-efficient fine-tuning well when you need it: how LoRA and QLoRA work, the hyperparameters...