Learn the vocabulary of aligning a model by having it critique its own drafts against a written set of principles.
0 / 5 completed
1 / 5
A teammate explains that instead of relying solely on human raters to rank responses, a model is given a written set of principles and asked to critique and revise its own draft responses against those principles, generating its own preference data that a reward model is then trained on, reducing how much human labeling the alignment process needs. What model-alignment training technique is being described?
Constitutional AI gives a model a written set of principles, a 'constitution,' and has it critique and revise its own draft responses against those principles, generating self-supervised preference data that trains a reward model, reducing reliance on large volumes of human-labeled rankings while still steering the model's behavior toward the stated principles. A DNS zone transfer is an unrelated concept about replicating name server records. This self-critique-against-written-principles approach is exactly why Constitutional AI is a key reason a model's alignment process can scale without requiring human raters to label every single training example by hand.
2 / 5
During a design review, the team adopts Constitutional AI for scaling an alignment process for a rapidly iterating model, specifically so most of the preference data needed to train a reward model does not require a human rater to label every single example by hand. Which capability does this provide?
Constitutional AI here provides scalable self-supervised preference generation, since the model critiques and revises its own drafts against written principles instead of requiring a human label for every example. Relying exclusively on human raters to manually rank every single training example, which does not scale as the volume of needed preference data grows is the alternative this avoids. This behavior is exactly why Constitutional AI is favored in this kind of scenario.
3 / 5
In a code review, a dev notices a team's alignment pipeline requires a human rater to manually label every single preference example, becoming a bottleneck as the volume of needed training data grows, instead of having the model critique and revise its own drafts against a written set of principles. What does this represent?
This is a missed Constitutional AI-opportunity, since Constitutional AI would let the model generate much of its own preference data instead of bottlenecking on human labeling capacity. A cache eviction policy is an unrelated concept about discarded cache entries. This pattern is exactly the kind of gap a reviewer flags once the tradeoffs are understood.
4 / 5
An incident report shows an alignment team's iteration speed stalled for weeks because every new preference-data batch required human raters to manually label each example one at a time, and rater throughput could not keep pace with how quickly the team wanted to retrain. What practice would prevent this?
Adopting Constitutional AI so the model generates much of its own preference data by critiquing and revising its own drafts against a written set of principles, reducing the human-labeling bottleneck. Continuing the prior approach regardless of the risk it has already caused is exactly what led to the incident described here. This fix is the standard remedy once the root cause is confirmed.
5 / 5
During a PR review, a teammate asks why the team reaches for Constitutional AI instead of pure RLHF relying entirely on human-labeled preference rankings. What is the reasoning?
Constitutional AI trades some risk that the model's self-critique inherits its own existing blind spots for far greater scalability, since it needs far fewer human-labeled examples, while pure RLHF relies on human judgment for every example, which is more reliably grounded but does not scale as easily. This is exactly why Constitutional AI is favored when the volume of needed preference data outpaces what human raters can label, while pure RLHF relying entirely on human-labeled preference rankings remains acceptable when the highest possible fidelity to human judgment is needed on a smaller, well-resourced labeling budget.
What does the "Constitutional AI Vocabulary" vocabulary exercise cover?
This exercise tests real IT vocabulary related to constitutional ai vocabulary through 5 multiple-choice questions, each built from realistic workplace sentences rather than abstract definitions.
Is this vocabulary exercise free to use?
Yes. Every exercise on CoderSlingo, including this one, is completely free — no account, sign-up, or payment required.
How many questions does this exercise have?
This exercise has 5 questions. Each one shows a real-world sentence or scenario with multiple-choice options and an explanation once you answer.
What happens after I answer a question?
You'll see immediate feedback showing whether your answer was correct, along with a short explanation of why — then a button to move to the next question, and a full results screen at the end.
Can I retry the exercise if I get questions wrong?
Yes. Once you reach the results screen, click "Try again" to reset your answers and go through the exercise from the start as many times as you like.
Do I need to create an account to take this exercise?
No account is needed. Your answers are scored in your browser during the session — nothing is saved to a server, so you can jump straight in.
Is my progress saved if I leave the page?
No — progress within an exercise resets if you navigate away or reload. Each exercise is short enough to complete in a few minutes in one sitting.
Are these vocabulary exercises connected to other topics?
Yes — browse the full vocabulary exercises hub to find related modules covering adjacent IT topics and roles.
How is this different from reading a glossary or blog article?
Exercises like this one are active recall drills — you have to choose the correct term or phrasing yourself, which builds retention faster than passively reading a definition.
Where can I find more vocabulary exercises?
Browse the full Vocabulary exercises hub for hundreds of modules covering Agile, DevOps, security, databases, architecture, and more — organised by IT role and skill.