Practice prompt iteration vocabulary: A/B testing prompt variants, reducing hallucinations, system prompt versioning in git, and prompt regression test suites.
0 / 5 completed
1 / 5
'We A/B tested two prompt _____.' What are the two things being compared called?
'Prompt variants' is the standard term for the different versions of a prompt being compared in an A/B test to determine which performs better.
2 / 5
'The second version reduced _____ by 15%.' What LLM failure mode was improved?
Hallucinations — instances where the model generates false or fabricated information — are a key quality metric. Reducing them is a major goal of prompt iteration.
3 / 5
'We version our prompts in _____.' Where are prompts stored like code?
Storing prompts in git enables version history, diffs, code review, and rollback — treating prompts with the same discipline as application code.
4 / 5
What is a 'prompt regression test suite'?
A prompt regression test suite is a set of input/expected-output pairs that run automatically when a prompt changes, catching quality regressions before deployment.
5 / 5
'Iterating on the system prompt' means:
Iterating on the system prompt involves making targeted changes to the system instructions and measuring their effect on output quality — the core prompt engineering workflow.