Master statistical reporting vocabulary for technical writing: p-value, confidence intervals, effect size, statistical vs. practical significance, null hypothesis, Type I/II errors, and correct use of 'significant'.
0 / 10 completed
1 / 10
What does a p-value of 0.03 mean in the context of statistical reporting, and how should it be written in a research paper?
p-value reporting conventions: use p = .03 (not p = 0.03 in APA style, no leading zero), or p < .001 for very small values. The p-value answers: 'If the null hypothesis were true, how often would we see data this extreme by chance?' p = .03 means this would happen 3% of the time by chance. Common errors: (1) 'The p-value is the probability the null hypothesis is true' — incorrect. (2) Reporting p < .05 without effect size. (3) Treating p = .049 as categorically different from p = .051.
2 / 10
What is a confidence interval and why is it more informative than a p-value alone in technical reporting?
CI reporting: 'The mean response time improved by 120ms (95% CI [45ms, 195ms]).' This tells you: the best estimate is 120ms, and the plausible range is 45–195ms. A p-value of .03 alone tells you the effect is unlikely to be zero — the CI tells you its practical size. Wide CI (e.g., [-10ms, 250ms]) signals imprecision and overlaps zero. Narrow CI signals precision. Report CIs alongside p-values: 'The difference was statistically significant (p = .03) with a mean improvement of 120ms (95% CI [45, 195]).'
3 / 10
What is the distinction between 'statistical significance' and 'practical significance' (effect size) in technical writing?
Example: A/B test with 1 million users finds a 0.1% conversion rate improvement (p < .001, Cohen's h = 0.002). Statistically significant (large N), but practically negligible (tiny effect). Conversely, a small pilot study with 20 users finds a 30% improvement (p = .08, Cohen's d = 0.9). Not statistically significant (small N), but the effect size is large and worth further investigation. Writing: 'Although statistically significant, the effect was small (d = 0.12), suggesting limited practical importance.' Effect size conventions: Cohen's d: small 0.2, medium 0.5, large 0.8.
4 / 10
What are Type I and Type II errors in hypothesis testing and how should they be discussed in a limitations section?
Limitations language: 'By using alpha = .05, we accept a 5% Type I error rate — approximately 1 in 20 tests would appear significant by chance.' 'Given our sample size of n = 30, our study may have insufficient power (estimated power = 0.61) to detect small effects, increasing the risk of a Type II error.' In multiple comparisons (testing many hypotheses), Type I error accumulates — address with Bonferroni correction or FDR adjustment: 'We applied Bonferroni correction to control the family-wise Type I error rate.'
5 / 10
When is it appropriate to use the word 'significant' in technical and academic writing, and what are common misuses?
Misuses of 'significant': (1) 'There was a significant improvement in user satisfaction' in a qualitative study — no statistics were performed. Use 'marked improvement' or 'substantial improvement.' (2) 'The difference was not significant' meaning 'not important' rather than 'did not reach p < .05.' (3) 'Highly significant' (p = .001) implying a large effect — significance level does not indicate effect size. Correct usage: 'The difference in error rates was statistically significant (p = .02, d = 0.6), representing a practically meaningful reduction.' Always pair statistical significance with effect size.
6 / 10
John from the Data Science team just sent a PR with the following comment: 'The A/B test showed a p-value of 0.03 for feature X. This is significant!' What's the best way for you to respond, considering your role as a senior backend developer reviewing this code?
The core issue here is that simply stating a p-value isn't enough. While it indicates statistical significance, it doesn't convey the magnitude of the effect. A confidence interval provides a range within which the true population parameter likely falls, and discussing 'significant' without this context can be misleading. It's important to prompt for more information about the practical impact.
7 / 10
You're drafting a Slack message to your team after receiving an API response detailing the results of a user engagement experiment. The response includes a 95% confidence interval for conversion rate increase: [0.02, 0.05]. Which statement best summarizes this information for a less statistically-minded audience?
A confidence interval represents a range of plausible values for the population parameter (conversion rate increase) based on our sample data. 95% signifies that if we were to repeat this experiment many times, 95% of the resulting confidence intervals would contain the true conversion rate increase. It's crucial to avoid misinterpreting the probability as a certainty.
8 / 10
During a standup meeting, the Product Manager asks: 'Did we find any evidence that redesigning the login flow improved user retention?' You've just reviewed the data and found a p-value of 0.10 with a confidence interval of [0.01, 0.03]. How should you respond to this question?
While the p-value is below the conventional threshold (typically 0.05), the small effect size (confidence interval of [0.01, 0.03]) suggests that any observed difference in retention might not be substantial enough to justify a redesign based on this experiment alone. 'Statistical significance' doesn't automatically equate to 'practical significance.'
9 / 10
You're writing the limitations section of a technical report describing a performance test. You want to be precise about potential errors related to your statistical analysis. Which of the following statements accurately reflects the appropriate language to use?
Acknowledging the possibility of Type I and Type II errors is vital in any scientific report. However, stating outright confidence is misleading. A more accurate phrasing recognizes that there's a chance of making incorrect conclusions due to inherent uncertainties in statistical testing – this demonstrates transparency and responsible reporting.
10 / 10
A junior developer asks: 'Should we use the word 'significant' when describing the results of our A/B test in this report?' What's your advice?
The word 'significant' is often overused and can be misleading in technical contexts. While defining it clearly (as statistically significant) is necessary, aiming for more precise terminology – like quantifying effect size or confidence intervals – provides a clearer and less ambiguous communication of your findings.
What will I practice in "Statistical Reporting Vocabulary — p-values, Confidence Intervals & Effect Size"?
This is a Research English exercise set. It walks through 10 scenario-based multiple-choice questions built around real usage of research english terminology that IT professionals encounter on the job.
Is this exercise free to use?
Yes. Every exercise on CoderSlingo, including this one, is free to complete with no account, sign-up, or paywall.
How many questions are in this exercise?
This set contains 10 questions. Each one shows immediate feedback and a detailed explanation after you answer, so you learn the correct usage right away rather than waiting for a final score.
Do I need prior experience to complete this exercise?
No prior experience is required. Each question includes a full explanation covering the reasoning behind the correct answer, so the exercise itself teaches the research english vocabulary as you go.
Can I retry the exercise if I get questions wrong?
Yes — use the "Try again" button on the results screen to reset your answers and go through all the questions again. There is no limit on attempts.
Is my progress saved?
Your answers and score for the current session are tracked in the browser as you go. No account or login is needed, and there is nothing to install.
What if I don't understand a term used in a question?
Read the explanation shown after you answer each question — it breaks down the correct term in plain English with a real-world example. You can also check the site Glossary for quick definitions.
How is this different from reading a blog article on the topic?
Exercises like this one are interactive drills that test and reinforce specific vocabulary through multiple-choice questions, while blog articles explain concepts in prose. Practising here after reading builds active recall, not just passive recognition.
Where can I find more Research English exercises?
See the Research English exercises hub for the full set of related pages, or browse all exercise categories from the main Exercises index.
Can I use this exercise to prepare for a technical interview?
Yes — research english vocabulary comes up often in technical discussions and interviews. Pair this exercise with our dedicated Interview Preparation section for role-specific practice.