Practice English vocabulary for measuring experiment uplift: treatment groups, marginal lift, relative vs absolute lift, incremental revenue, and lift decomposition.
0 / 15 completed
1 / 15
What does 'the treatment group saw a 7% uplift in conversion' mean?
Uplift (or lift) is the improvement in a metric for the treatment group relative to the control. A '7% uplift' most commonly means the treatment's conversion rate was 7% higher in relative terms — e.g., control 10%, treatment 10.7%.
2 / 15
What is 'marginal lift over the control'?
Marginal lift isolates the causal impact of the treatment. If the control converts at 10% and the treatment at 11%, the marginal lift is 1 percentage point (or 10% relative). This separates the treatment's effect from baseline behavior.
3 / 15
What is the difference between 'relative vs. absolute lift'?
Absolute lift: treatment rate minus control rate (e.g., 12% - 10% = +2pp). Relative lift: absolute lift divided by control rate (2pp / 10% = 20% relative lift). Both matter — absolute lift is easier to understand in business terms; relative lift is useful for comparison across different baseline rates.
4 / 15
What is 'incremental revenue from the experiment'?
Incremental revenue is the business impact of the experiment: (treatment conversion rate - control conversion rate) × number of users × average order value. This translates statistical significance into a financial justification for the decision.
5 / 15
What is 'lift decomposition'?
Lift decomposition breaks down the aggregate uplift into contributions from different segments (device, user cohort, geography). It reveals whether the overall lift masks negative lift in some segments, guiding decisions about targeted rollouts.
6 / 15
Code Review Comment: Sarah comments on a PR: 'The A/B test showed a 15% uplift in click-through rate for users exposed to the redesigned button. However, the treatment group also saw an increase in bounce rate – approximately 8%. Does this indicate a potential issue with the new design's usability or something else?'
The key here is understanding that 'uplift' isn't just about positive changes. A successful uplift measurement considers both the increase and any accompanying negative effects. Simply seeing a higher CTR doesn't automatically mean the change is beneficial; it needs to be analyzed in conjunction with metrics like bounce rate, which can signal usability problems. Option 3 incorrectly assumes statistical significance without further context.
7 / 15
Slack Message: Alex sends a message to the team: 'Just ran the final uplift report for feature X. We observed a 2.3% absolute lift in daily active users, which translates to roughly $18k in incremental revenue over the last month.'
'Absolute lift' refers to the raw difference in a metric between the treatment and control groups. A 2.3% absolute lift means that the feature increased daily active users by 2.3 percentage points compared to the control group. It's crucial to understand this terminology when discussing uplift results, as it clarifies the magnitude of the change relative to the original baseline.
8 / 15
PR Description: 'Implemented A/B test for redesigned login flow. The primary metric is conversion rate. Initial results show a 9% relative lift in successful logins compared to the standard flow.'
'Relative lift' calculates the percentage change in a metric compared to its baseline value. It's a standardized measure that allows for comparison across different datasets or experiments with varying baselines. This is often preferred because it provides context about how much better the new treatment is relative to what was already happening.
The 'incremental revenue' is derived from the 'lift' value multiplied by the baseline metric (daily active users). In this case, a lift of 0.05 (or 5%) applied to the 12000 daily active users in the control group results in an incremental revenue increase of $7500. Understanding the relationship between these values is crucial for interpreting uplift data.
10 / 15
Standup Update: 'We ran an experiment on user onboarding and saw a 3% lift in completion rates. We decomposed the lift to see that the primary drivers were personalized tutorial recommendations – they increased completion by 2% – and simplified checkout flow, contributing another 1%.'
'Lift decomposition' breaks down the overall uplift into its component parts – identifying which specific changes (e.g., personalized recommendations, simplified checkout) contributed most significantly to the positive outcome. This granular analysis is invaluable for understanding what's working and prioritizing future improvements based on concrete evidence.
11 / 15
Code Review Comment: Sarah comments on a PR: 'The A/B test showed a 15% uplift in click-through rate for users exposed to the redesigned button. However, the treatment group also saw an increase in bounce rate – approximately 8%. Does this indicate a potential issue with the new design's usability or something else?'
The key here is understanding that 'uplift' isn't just about positive changes. A successful uplift measurement considers both the increase and any accompanying negative effects. Simply seeing a higher CTR doesn't automatically mean the change is beneficial; it needs to be analyzed in conjunction with metrics like bounce rate, which can signal usability problems. Option 3 incorrectly assumes statistical significance without further context.
12 / 15
Slack Message: Alex sends a message to the team: 'Just ran the final uplift report for feature X. We observed a 2.3% absolute lift in daily active users, which translates to roughly $18k in incremental revenue over the last month.'
'Absolute lift' refers to the raw difference in a metric between the treatment and control groups. A 2.3% absolute lift means that the feature increased daily active users by 2.3 percentage points compared to the control group. It's crucial to understand this terminology when discussing uplift results, as it clarifies the magnitude of the change relative to the original baseline.
13 / 15
PR Description: 'Implemented A/B test for redesigned login flow. The primary metric is conversion rate. Initial results show a 9% relative lift in successful logins compared to the standard flow.'
'Relative lift' calculates the percentage change in a metric compared to its baseline value. It's a standardized measure that allows for comparison across different datasets or experiments with varying baselines. This is often preferred because it provides context about how much better the new treatment is relative to what was already happening.
The 'incremental revenue' is derived from the 'lift' value multiplied by the baseline metric (daily active users). In this case, a lift of 0.05 (or 5%) applied to the 12000 daily active users in the control group results in an incremental revenue increase of $7500. Understanding the relationship between these values is crucial for interpreting uplift data.
15 / 15
Standup Update: 'We ran an experiment on user onboarding and saw a 3% lift in completion rates. We decomposed the lift to see that the primary drivers were personalized tutorial recommendations – they increased completion by 2% – and simplified checkout flow, contributing another 1%.'
'Lift decomposition' breaks down the overall uplift into its component parts – identifying which specific changes (e.g., personalized recommendations, simplified checkout) contributed most significantly to the positive outcome. This granular analysis is invaluable for understanding what's working and prioritizing future improvements based on concrete evidence.
What will I practise in "Uplift Measurement Vocabulary"?
Practice English vocabulary for measuring experiment uplift: treatment groups, marginal lift, relative vs absolute lift, incremental revenue, and lift decomposition.
How many exercises are in this module?
This module has 15 multiple-choice exercises, each with instant feedback and a full explanation of the correct answer.
Is this exercise free to use?
Yes. Every exercise on CoderSlingo, including this one, is free to use with no account, sign-up, or paywall.
Do I need to create an account to do these exercises?
No account is required. Just click an option to answer — your score for this session is tracked automatically in the progress bar above.
What happens if I choose the wrong answer?
You'll immediately see which answer was correct, plus a full explanation covering the vocabulary and reasoning behind it — mistakes are where most of the learning happens.
Can I retry the exercises if I want a higher score?
Yes — use the "Try again" button on the results screen to reset and go through all the questions again.
Is my progress saved if I close the page?
No. Progress is tracked only for your current visit; reloading or leaving the page resets the counter. This keeps the exercise simple and account-free.
Where can I find more Growth & Experimentation Language exercises?
Browse the full Growth & Experimentation Language hub for related drills, or check the "Next up" link below to continue with a connected topic.
How is this different from reading an article on the same topic?
Articles explain vocabulary and concepts in prose; this exercise tests and reinforces that vocabulary through active recall with immediate feedback — the two work best together.
Who writes these exercises?
Every exercise is written by the CoderSlingo team, drawing on real workplace English used in IT roles, then reviewed for accuracy and clarity.