How to select options when building a shortlist
Learn how to select and rank options for a shortlist by setting criteria, weighting them, scoring each option, and testing the order before you commit.
Contents
- Start with criteria, not candidates
- Give each criterion a weight
- Score every option on the same scale
- Put shortlist ranking into a table
- Check the order before you commit
- Trim the list to a working shortlist
- Keep the record usable over time
- Questions About Shortlisting and Ranking
- How do I rank options when two of them score almost the same?
- Should I pick the criteria before or after I see the options?
- What is criteria weighting and why does it matter?
- How many options should a shortlist contain?
- What do I do with an option that fails a must-have but scores high?
- How do I keep a shortlist ranking honest when new details arrive?
Selecting options for a shortlist means turning a long set of candidates into a ranked few you can act on. You do it by naming the criteria that matter, giving each criterion a weight, and scoring every option against the same yardstick. The result is an option selection you can explain and revisit.
- Write your criteria before you look at any option, so the list is not shaped by what happens to be available.
- Give each criterion a weight that reflects its importance to the outcome you want.
- Score every option on the same scale and against the same criteria.
- Run a sensitivity check to see whether a small weight change would move the ranking.
- Keep the details of each option side by side so the shortlist stays readable.
Start with criteria, not candidates
Criteria are the qualities an option must have to serve your purpose. Writing them down first keeps the decision process honest, because the yardstick does not shift as you learn about each candidate. A shortlist built this way reflects your needs rather than the loudest listing.
Split criteria into must-haves and nice-to-haves. A must-have is a threshold an option either meets or fails, such as a required capability. Nice-to-haves are the qualities you trade off against each other, and they are the ones that carry weights.
Keep the list of criteria short enough to apply to every candidate. Each extra criterion adds work and invites double counting, where two entries measure the same thing. Merge related criteria until each one stands for a distinct quality.
Give each criterion a weight
Criteria weighting turns a flat list into a scale that mirrors what you value. Weights let you compare a criterion that matters a great deal with one that matters only slightly. Without weights, every criterion would count the same, which rarely matches the real need.
A simple approach assigns weights on a small scale, such as one to five, and then checks that the total makes sense to you. The absolute numbers matter less than the ratios between them. What counts is that a criterion twice as important gets roughly twice the weight.
Ask whether any must-have has crept onto the weighted list. A requirement that cannot be traded belongs in the pass or fail check, not in the weighted score. Mixing the two hides the fact that some options should be dropped outright.
Score every option on the same scale
Option selection works only when every candidate is scored the same way. Pick a fixed scale, define what each point on it means, and apply it to all options. Consistent scoring is what makes the totals comparable.
Base scores on stated evidence rather than impressions. Write a short note for each score that says what it rests on, so a reader can follow the reasoning later. Where evidence is missing, mark the gap instead of guessing.
Multiply each score by the weight of its criterion, then add the results to get a weighted total. Keep the raw scores visible next to the totals, because a total hides which criteria pulled it up or down. The table below shows the shape of that record.
Put shortlist ranking into a table
A shortlist ranking is easiest to trust when it sits in one table with criteria as columns and options as rows. Side-by-side detail lets you see at a glance why one option sits above another. The table also shows where two options differ by only a hair.
Include a column for each criterion weight and a final column for the weighted total. Add a notes column for the evidence behind each score, however brief. Readers who did not build the shortlist can then retrace the logic.
Keep the table to the criteria that carry real weight, and move the rest to a note. A crowded table is harder to read and easier to misread. The goal is a record you can defend, not a complete transcript of every thought.
Check the order before you commit
A ranking is a tool, not a verdict, and a sensitivity check shows how firm it is. Change one weight by a modest step and see whether the order of options moves. If a top option drops after a small change, its lead is fragile.
Look at ties and near ties as well. Two options with close totals deserve a closer look at the criteria where they differ. The scores may point to a deciding factor you have not yet named.
Revisit any option that fails a must-have, whatever its weighted score says. A high total does not rescue an option that cannot meet a hard requirement. The shortlist should contain only options that pass the threshold first.
Trim the list to a working shortlist
Shortlisting means cutting the field to a number you can actually examine in depth. The right size depends on how much time and evidence each option demands. A short list you can study beats a long one you cannot.
Drop options that fail a must-have, then remove those whose totals sit far below the leading group. Keep one or two outsiders only if they offer a quality the leaders lack. An outsider on the list should have a stated reason to be there.
Record why each dropped option left the list, in one line. That trail protects you if circumstances change and an old candidate becomes relevant again. It also keeps the selection process transparent to anyone who joins later.
Keep the record usable over time
A decision record earns its keep when new information arrives after the shortlist is set. Store the criteria, weights, scores and notes together so a revision is a small edit rather than a fresh start. The structure of the original work is what makes that possible.
Set a point at which you recheck the list, such as when a key assumption changes. Rechecking means re-scoring only the criteria affected, not rebuilding the whole table. The rest of the record still stands as evidence.
Share the table with anyone who will act on the shortlist. A reader who can see the criteria and the weights can challenge a score with a specific point. That challenge improves the ranking more than a vague disagreement about favorites.
Questions About Shortlisting and Ranking
How do I rank options when two of them score almost the same?
Ranking options with near-equal totals calls for a closer look at the criteria where they differ. Check whether one criterion carries a weight that was set before you saw the candidates. If the tie still holds, treat both as viable and let a further test decide.
Should I pick the criteria before or after I see the options?
Pick the criteria before you examine the options, so the yardstick is not shaped by what is on offer. Criteria written first reflect your needs and make the later scoring easier to defend. You can refine the wording later, but keep the substance intact.
What is criteria weighting and why does it matter?
Criteria weighting assigns each criterion a number that shows how much it counts toward the final score. Weighting matters because it stops a minor quality from counting as much as a decisive one. The ratios between weights carry more meaning than the numbers themselves.
How many options should a shortlist contain?
A shortlist should contain as many options as you can examine in real depth. The number depends on the time and evidence each candidate demands. Cutting to a short list you can study gives a firmer ranking than keeping a long list you cannot.
What do I do with an option that fails a must-have but scores high?
An option that fails a must-have should leave the shortlist, however high its weighted total. Must-haves act as a threshold, and a score cannot compensate for a missing requirement. Record the failure so the decision is easy to revisit.
How do I keep a shortlist ranking honest when new details arrive?
Keep the criteria, weights, scores and notes in one place so a revision is a small edit. When new details arrive, re-score only the criteria they affect. The rest of the record stays as the evidence behind the original order.