Learn the vocabulary of fine-tuning a large model by training only a small inserted adapter instead of every weight.
0 / 5 completed
1 / 5
A teammate explains that instead of updating all of a pre-trained language model's billions of weights during fine-tuning, a small pair of low-rank adapter matrices is inserted alongside each frozen weight matrix, and only those tiny adapter matrices are trained, with QLoRA additionally quantizing the frozen base weights to four-bit precision to shrink the memory footprint further. What parameter-efficient fine-tuning technique is being described?
LoRA, low-rank adaptation, freezes a pre-trained model's original weight matrices and instead trains a small pair of inserted low-rank adapter matrices alongside each one, cutting the number of trainable parameters by orders of magnitude, while QLoRA additionally quantizes the frozen base weights to four-bit precision, so a model that would otherwise need many high-end GPUs to fine-tune can be adapted on a single consumer GPU. A DNS zone transfer is an unrelated concept about replicating name server records. This freeze-the-base-train-a-small-adapter approach is exactly why LoRA and QLoRA are why fine-tuning a large open-weight model has become accessible on a single GPU instead of requiring a full training cluster.
2 / 5
During a design review, the team adopts LoRA / QLoRA fine-tuning for adapting a seventy-billion-parameter open-weight model to a narrow customer-support domain on a single consumer GPU, specifically so the memory footprint stays small enough to fit without needing a multi-GPU cluster. Which capability does this provide?
LoRA / QLoRA fine-tuning here provides dramatically reduced trainable-parameter count and memory footprint, since only the small inserted adapter matrices are trained and, under QLoRA, the frozen base weights are stored in four-bit precision. Full fine-tuning, which updates every one of the seventy billion original weights and requires storing full-precision gradients and optimizer state for all of them is the alternative this avoids. This behavior is exactly why LoRA / QLoRA fine-tuning is favored in this kind of scenario.
3 / 5
In a code review, a dev notices a team attempts full fine-tuning of a seventy-billion-parameter model on a single consumer GPU, running out of memory before training even starts, instead of inserting small LoRA adapter matrices and training only those. What does this represent?
This is a missed LoRA / QLoRA fine-tuning-opportunity, since LoRA would train only a small fraction of the parameters, fitting comfortably in the GPU's memory instead of running out. A cache eviction policy is an unrelated concept about discarded cache entries. This pattern is exactly the kind of gap a reviewer flags once the tradeoffs are understood.
4 / 5
An incident report shows a fine-tuning job repeatedly ran out of GPU memory and crashed before completing a single training step, because it attempted to update and store optimizer state for all seventy billion of the base model's original weights. What practice would prevent this?
Switching to LoRA, or QLoRA for an even smaller footprint, so only a small inserted adapter is trained and the memory-heavy optimizer state is kept for a tiny fraction of the parameters. Continuing the prior approach regardless of the risk it has already caused is exactly what led to the incident described here. This fix is the standard remedy once the root cause is confirmed.
5 / 5
During a PR review, a teammate asks why the team reaches for LoRA / QLoRA fine-tuning instead of full fine-tuning of every weight. What is the reasoning?
LoRA trades a small amount of adaptation capacity, since the low-rank adapter cannot capture every possible weight update a full fine-tune could, for a massive reduction in trainable parameters and memory footprint, while full fine-tuning can capture any possible weight update but requires memory and compute proportional to the entire model. This is exactly why LoRA / QLoRA fine-tuning is favored when the available hardware is limited or the adaptation task is narrow enough that a low-rank update captures it well, while full fine-tuning of every weight remains acceptable when unlimited compute is available and the task requires reshaping the model's behavior more broadly than a low-rank adapter can express.
What does the "LoRA / QLoRA Fine-Tuning Vocabulary" vocabulary exercise cover?
This exercise tests real IT vocabulary related to lora / qlora fine-tuning vocabulary through 5 multiple-choice questions, each built from realistic workplace sentences rather than abstract definitions.
Is this vocabulary exercise free to use?
Yes. Every exercise on CoderSlingo, including this one, is completely free — no account, sign-up, or payment required.
How many questions does this exercise have?
This exercise has 5 questions. Each one shows a real-world sentence or scenario with multiple-choice options and an explanation once you answer.
What happens after I answer a question?
You'll see immediate feedback showing whether your answer was correct, along with a short explanation of why — then a button to move to the next question, and a full results screen at the end.
Can I retry the exercise if I get questions wrong?
Yes. Once you reach the results screen, click "Try again" to reset your answers and go through the exercise from the start as many times as you like.
Do I need to create an account to take this exercise?
No account is needed. Your answers are scored in your browser during the session — nothing is saved to a server, so you can jump straight in.
Is my progress saved if I leave the page?
No — progress within an exercise resets if you navigate away or reload. Each exercise is short enough to complete in a few minutes in one sitting.
Are these vocabulary exercises connected to other topics?
Yes — browse the full vocabulary exercises hub to find related modules covering adjacent IT topics and roles.
How is this different from reading a glossary or blog article?
Exercises like this one are active recall drills — you have to choose the correct term or phrasing yourself, which builds retention faster than passively reading a definition.
Where can I find more vocabulary exercises?
Browse the full Vocabulary exercises hub for hundreds of modules covering Agile, DevOps, security, databases, architecture, and more — organised by IT role and skill.