Practise vocabulary for tuning recommendation ranking: candidate generation vs ranking, learning to rank, NDCG, and feature signals.
0 / 10 completed
1 / 10
The first stage that narrows millions of items down to a few hundred is ___.
Candidate generation (retrieval) cheaply selects a shortlist; the expensive ranking model then orders only those candidates.
2 / 10
Training a model to order items by predicted relevance is called ___.
Learning to rank (LTR) optimises the ordering of results, using signals like clicks and dwell time as training labels.
3 / 10
A metric that rewards putting relevant items higher in the list is ___.
Normalised Discounted Cumulative Gain (NDCG) discounts relevance by position, so ranking good items near the top scores higher.
4 / 10
Inputs to the ranker like recency, popularity, and user affinity are ___.
Ranking features (signals) feed the model; tuning often means adding, weighting, or removing these to improve relevance.
5 / 10
Recommending mostly near-duplicate items hurts list ___.
Without a diversity term, ranking can collapse into very similar items; tuning balances relevance with diversity for a better experience.
6 / 10
During a code review of the search ranking implementation, Alice comments to Ben: 'I'm seeing that the results for 'database performance tuning' are consistently ranked lower than those for 'SQL query optimization'. Shouldn't we be prioritizing items directly related to fixing database issues?' Which of the following best describes what Alice is likely referring to in this context?
Alice is discussing *relevance tuning*, which involves adjusting a ranking model's parameters to better align with user intent. The system isn't simply looking at keyword frequency; it needs to understand the *context* of the search query and prioritize results that directly address the problem described (database performance). Options A, C, and D represent other common issues in ranking systems but don't capture Alice's specific concern.
7 / 10
You're working on a recommendation engine for e-commerce products. The API response shows the following score for a user's request: `{'score': 0.85, 'reasoning': 'high_purchase_intent, related_products'}`. What does this primarily indicate?
The API response indicates a 'score' of 0.85, but crucially, it also includes 'reasoning'. This signifies that the ranking model isn't just providing a number; it's explaining *why* a particular product was ranked highly. The system is indicating it needs more user interaction to refine its predictions based on this reasoning, thus requiring tuning.
8 / 10
During a standup meeting, David says: 'We're seeing a drop in the click-through rate for our top-ranked search results. I suspect the model isn't accurately capturing the user's *query intent*.' Which of the following is David most likely suggesting needs to be addressed?
David's concern about 'query intent' directly points to the need for *feature engineering*. The ranking model relies on features that accurately represent what the user is trying to achieve. If those features aren't well-designed, the model won't be able to understand and prioritize relevant results. Options A, C, and D are potential problems but don't directly address this specific issue.
9 / 10
Sarah is writing a PR description for a change to the search ranking algorithm. She explains: 'We've added recency scores to prioritize more recent articles and blog posts in search results. This helps ensure users see the latest information.' What is Sarah primarily focusing on?
Sarah's description highlights the use of 'recency scores' as an *input signal* to the ranking algorithm. This demonstrates a key technique in tuning: incorporating external factors (like date) to influence how results are ordered. This is a deliberate choice designed to improve relevance.
10 / 10
The team is discussing the performance of their recommendation engine. They've noticed that frequently recommending items almost identical to those already purchased by a user significantly reduces list diversity. What is this primarily impacting?
The issue described – recommending almost identical items – directly impacts *list diversity*. If the training data isn't regularly updated, the model will continue to reinforce existing patterns and fail to suggest novel or different products. This is a classic example of data drift negatively affecting recommendation systems.
What will I practice in "Ranking & Relevance Tuning Vocabulary"?
This is a Recommendation Systems Language exercise set. It walks through 10 scenario-based multiple-choice questions built around real usage of recommendation systems language terminology that IT professionals encounter on the job.
Is this exercise free to use?
Yes. Every exercise on CoderSlingo, including this one, is free to complete with no account, sign-up, or paywall.
How many questions are in this exercise?
This set contains 10 questions. Each one shows immediate feedback and a detailed explanation after you answer, so you learn the correct usage right away rather than waiting for a final score.
Do I need prior experience to complete this exercise?
No prior experience is required. Each question includes a full explanation covering the reasoning behind the correct answer, so the exercise itself teaches the recommendation systems language vocabulary as you go.
Can I retry the exercise if I get questions wrong?
Yes — use the "Try again" button on the results screen to reset your answers and go through all the questions again. There is no limit on attempts.
Is my progress saved?
Your answers and score for the current session are tracked in the browser as you go. No account or login is needed, and there is nothing to install.
What if I don't understand a term used in a question?
Read the explanation shown after you answer each question — it breaks down the correct term in plain English with a real-world example. You can also check the site Glossary for quick definitions.
How is this different from reading a blog article on the topic?
Exercises like this one are interactive drills that test and reinforce specific vocabulary through multiple-choice questions, while blog articles explain concepts in prose. Practising here after reading builds active recall, not just passive recognition.
Where can I find more Recommendation Systems Language exercises?
See the Recommendation Systems Language exercises hub for the full set of related pages, or browse all exercise categories from the main Exercises index.
Can I use this exercise to prepare for a technical interview?
Yes — recommendation systems language vocabulary comes up often in technical discussions and interviews. Pair this exercise with our dedicated Interview Preparation section for role-specific practice.