iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more
Use a ranking question when you need respondents to put a defined set of options in priority order. Use a rating question when you need an independent score for each option, including how strongly someone feels about it. Neither format is universally better: choose the one that gives you evidence for the decision you need to make.
What ranking and rating questions tell you
Ranking shows relative priority
A ranking question asks respondents to order items against one another. It can show which option comes first, second, or last, but not how large the differences are. A respondent might rank one feature first because it is only slightly more important than the rest, or because it matters far more; the ranking alone cannot distinguish those cases. The University of Tennessee, Knoxville, puts the distinction succinctly: “Ranking generates relative position, not absolute meaning.” University of Tennessee, Knoxville
Rating shows an independent evaluation
A rating question asks respondents to evaluate each item separately on a scale, such as “Not important at all” to “Extremely important.” The resulting scores can reflect the strength of each evaluation and allow several items to receive the same score. Ratings are useful for constructs such as importance, satisfaction, confidence, or perceived value, provided the question and scale labels make clear which one respondents should assess.
Do these 3 things before closing this tab:
1Repair Windows errors before they cause bigger problems2Scan for outdated or missing drivers - takes under a minute3Clear out junk files and repair common Windows errorsWhich format should you choose?
| What you need to learn | Better fit | What the result can tell you |
|---|---|---|
| Which options should take priority relative to the others? | Ranking | Their order within the defined list, not the intensity of preference. |
| How positively or strongly is each option evaluated on its own? | Rating | An item-level evaluation that can show strong scores for multiple options. |
| Whether options can be equally acceptable or important | Rating | Respondents can give the same score to more than one item. |
| A strict order for a decision that requires choosing among competing options | Ranking | A relative priority order, if respondents can make a meaningful comparison. |
Choose ranking when the decision requires an order
Use ranking when respondents are choosing among a manageable set of alternatives and the decision will act on their relative priority—for example, deciding which of several initiatives should receive limited places. Ranking is a poor substitute for measuring strength of preference: it forces positions even when respondents see several items as equally important.
#1 Best Overall
- RCRF-02 Programmable Response Card Clicker by Turning Technologies
- New batteries Included
- Credit Card Size
Choose rating when each item needs its own score
Use rating when you need to compare evaluations item by item, rather than force every option into a unique position. A rating scale can show that several services are highly satisfying or several features are important, while also identifying differences in intensity. Make the scale specific to the construct: importance, satisfaction, and quality are not interchangeable.
Use both only when both answers matter
If the decision needs both an evaluation and a final priority order, you can ask for ratings and then a limited prioritization. This adds work and can introduce order effects, so test the sequence and wording instead of assuming the combined task is harmless.
Rank #2
- Two AAA batteries included
- 200 feet (400 ft. coverage)
- Battery Life Indicator - Answer Choice - Response Confirmation
- Cell phone style entry
How effort and survey mode affect the choice
Ranking asks respondents to compare items and keep their relative positions straight. A 2018 peer-reviewed U.S. mail-survey experiment by Smyth, Olson, and Burke compared two layouts: writing rank numbers in boxes, and selecting the most and second-most important items in a grid. The numbering layout produced more usable data, but one-third of respondents using it still did not follow its instructions correctly; the researchers also found difficulty with both formats among respondents with less education. These findings apply to those mail layouts, not every ranking question or online interface. Smyth, Olson, and Burke, International Journal of Market Research
A 2018 preprint by Sengupta, Srebro, and Evans compared continuous ratings, binary choices, and pairwise comparisons across three simple tasks: perceived safety of Google Street View images, artwork likeability, and animal-GIF hilarity. In those experiments, continuous ratings best predicted individual assessments but took the most time and effort. Binary choices were quick and performed well for aggregate assessments but poorly for personalized preferences, while pairwise comparisons performed well for personal assessments and poorly for aggregate assessments. These results concern the tested tasks; they do not establish a universal winner between ranking and rating. Sengupta, Srebro, and Evans
Design questions that respondents can answer reliably
Keep the task clear and the list manageable
State what respondents should do in plain language, and keep the list short enough to compare. A long list can increase effort and make instruction-following harder. Pilot the actual items and response control, not just the wording in isolation.
Label rating scales for the thing being measured
Specify what respondents should evaluate and what the endpoints mean. For example, if the question is about satisfaction, label the scale as satisfaction rather than importance. Unclear anchors make scores harder to interpret.
Rank #4
- Iclicker student remote answering device
Account for answer-order effects
Answer order can influence selections. Pew Research Center notes that telephone respondents more often select options heard later (recency), while respondents completing self-administered surveys tend to select options near the top (primacy). Randomizing unordered options can distribute these effects. Keep ordinal rating scales in their meaningful order; in some designs, the direction can be reversed across respondents. Pew Research Center, “Writing Survey Questions”
Quick wins for a faster PC:
Clear out junk files and repair common Windows errorsFree Scan →Fix the driver behind crashes, sound loss and screen glitchesFind Drivers →Repair Windows errors before they cause bigger problemsFix Now →Pretest the wording, device, and response control
Cognitive interviews, focus groups, and survey pretests can reveal whether people understand the question and can use the response format as intended. Test the real wording, item count, device, and interface before fielding the survey.
Best Value
- comprehensive and helpful information
- handy to have for referencing and furthering your knowledge of your pet
- Add to your librarby to increase your families knowledge of your pets
Keep trend questions comparable
When tracking change over time, keep wording consistent and pay attention to question position and context. Changing from a rating scale to a ranking task—or changing the scale itself—can complicate comparisons with earlier survey waves.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Why wording and response options matter
Response format can affect what people report, so a difference in answers should not automatically be read as a difference in opinion. In a Pew Research Center example from a poll conducted after the 2008 U.S. presidential election, 58% selected “the economy” when it appeared as a closed-ended option, compared with 35% who volunteered it in an open-ended question. That example concerns offered versus volunteered answers, not a ranking-versus-rating comparison; it illustrates why question wording and available responses need careful interpretation.
Quick Recap
A practical decision check
- Start with the decision. Write down what someone will do with the results.
- Ask what evidence that decision needs. If it needs a relative order, use ranking; if it needs an independent evaluation for each item, use rating.
- Check whether ties are meaningful. If several options could genuinely receive the same evaluation, do not force a unique order unless the decision requires one.
- Test the task as respondents will see it. Pilot the wording, list length, response order, and interface with the intended survey mode and audience.
- Protect comparisons over time. If this is a trend survey, preserve the wording, scale, and relevant question context wherever possible.
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.
