Practice English vocabulary for experimentation platforms: randomization, assignment consistency, exposure events, and feature flag configuration.
0 / 5 completed
1 / 5
What does 'the exp platform handles randomization' mean?
Proper random assignment is foundational to A/B testing. The experimentation platform uses a hash function (typically on user ID + experiment ID) to deterministically but pseudo-randomly assign each user to a variant, ensuring unbiased, balanced groups.
2 / 5
What does 'the assignment is consistent (same user always gets same variant)' mean?
Consistent assignment (also called sticky assignment) is achieved by hashing the user ID. The same user ID always produces the same variant, so users have a consistent experience and assignment doesn't change between sessions.
3 / 5
What is 'the exposure event' that 'fires when the user sees the change'?
The exposure event (or assignment event) is logged when a user is actually exposed to the variant (e.g., sees the new button). Only users who were exposed are included in the analysis. This prevents the dilution effect from users who were assigned but never reached the experiment.
4 / 5
What does 'the experiment configuration is in the feature flags' mean?
Many teams implement experiments through their feature flag system. The flag's targeting rules (% of users, specific segments) define variant assignment. This allows changing experiment exposure without deploying new code and enables instant kill switches.
5 / 5
What is a 'guardrail metric' in experimentation platform vocabulary?
Guardrail metrics (like page load time, error rate, or revenue per user) protect against experiments that improve one metric at the cost of another. If the treatment improves conversion but crashes error rates past a threshold, the guardrail triggers a stop.