A scoring rubric for executive director candidates
A good rubric turns a room full of opinions into a decision the whole board can explain. Here is how a search committee can build one in a single meeting, with a template to start from.
Why a search committee needs a rubric
Most executive director searches go wrong in the same quiet way. Each committee member reads the applications with a different picture of the job in their head. One is looking for a fundraiser, another for a steady manager, a third for someone who reminds them of the founder. When the committee meets, the loudest picture wins, and nobody can say afterward why the shortlist looks the way it does.
A scoring rubric fixes that by doing three things:
- It forces agreement on the job before anyone reads a resume. The argument about what matters happens once, in the open, instead of candidate by candidate.
- It makes ratings comparable. When every member scores the same criteria on the same scale, a 4 from the treasurer means roughly what a 4 from the program chair means.
- It gives the board a record. If a staff member, a donor, or an unsuccessful internal candidate asks how the decision was made, the answer is written down and it is about the work.
Step 1: Pick four to six criteria from the job, not the resume
Start with the priorities your board agreed the next leader must deliver in their first two years. If you have not written those down yet, do that first; our search committee checklist covers it. Each criterion should be something you can actually see evidence of in an application or an interview. Common criteria for an executive director or CEO search include:
- Fundraising and revenue. Evidence of raising money at roughly your budget size, from the sources you depend on (individual donors, grants, government contracts, earned revenue).
- Leading and developing staff. Has managed managers, built a team, and handled hard personnel decisions.
- Financial and operational management. Has owned a budget, worked with an audit, and kept an organization compliant.
- Board partnership. Has reported to a board or a senior leader and knows the difference between governance and management.
- Mission and community knowledge. Understands the people you serve, your sector, or your region well enough to be credible on day one.
- Strategy and change. Has led an organization through a plan, a pivot, a merger, or a growth phase like the one ahead of you.
Pick the ones that matter for this search, at this moment in your organization's life. A turnaround needs different weights than a founder succession. Leave out vague traits like "culture fit" or "presence." They are where bias hides, because nobody can say what evidence would earn a 5.
Step 2: Weight the criteria
Not every criterion matters equally. Give the committee 100 points to split across the criteria, have each member allocate them privately, then average the results and discuss any criterion where members are far apart. A typical result for a mid-sized nonprofit might look like this:
| Criterion | Weight | What evidence looks like |
|---|---|---|
| Fundraising and revenue | 30% | Raised a comparable budget; named the sources; grew giving over time |
| Leading and developing staff | 25% | Managed managers; built or rebuilt a team; retention |
| Financial and operational management | 20% | Owned a budget; clean audits; systems they put in place |
| Board partnership | 15% | Reported to a board; worked through a governance change |
| Mission and community knowledge | 10% | Direct experience with the people or sector you serve |
Your weights will be different. The point is that the committee chose them together, before seeing a single name.
Step 3: Define what each score means
A 1 to 5 scale is enough, as long as every point has a plain-words definition. Without definitions, one member's 3 means "fine" and another's means "not for us." Use the same definitions for every criterion:
- 5, Exceptional. Clear, specific evidence they have done this at your scale or larger, with results.
- 4, Strong. Clear evidence they have done this, at a somewhat smaller scale or in a closely related setting.
- 3, Adequate. Some relevant experience, but partial, indirect, or without described results.
- 2, Limited. Little evidence. Would need significant support to succeed here.
- 1, None. No evidence in the application, or evidence of the opposite.
Two rules keep the scale honest. First, score only what is in front of you: if the application does not mention budgets, that criterion gets a 2 or a 1 at the screening stage, not a hopeful 3. You can ask about it later. Second, write one sentence of evidence next to every 5 and every 1. Those are the scores that move a candidate, so they should be the easiest to defend.
Step 4: Score independently, then compare
The order matters more than the rubric itself. Every member scores every application alone, before the committee meets. If members talk first, the first confident opinion in the room anchors everyone else, and you lose the benefit of having several people read.
To get a total, multiply each criterion's score by its weight and add them up. A candidate who scores 4, 5, 3, 4, 3 on the weights above lands at 4.0 out of 5. Then average the totals across members.
When the committee meets, do not start at the top of the list. Start with the candidates where members disagree most, for example where one person gave a total near 4.5 and another near 2.5. Those gaps usually mean someone noticed something the others missed, or two members read a criterion differently. Talking those through is where a committee actually earns its keep.
Step 5: Carry the rubric into interviews
The same criteria should shape your interview questions. For every criterion where a finalist scored a 3 or lower on paper, write one question that would let them show evidence you could not see in the resume. Our list of interview questions for executive director and CEO candidates is organized by these same areas, so you can pick from it directly.
After each interview round, rescore the finalists on the same rubric. Keep the screening scores alongside the interview scores so you can see who rose and who fell, and why.
Common mistakes to avoid
- Writing the rubric after reading applications. It will describe the candidate someone already likes.
- Too many criteria. Past six, volunteers start giving everything a 3.
- Letting the total decide. A rubric informs the decision; the committee still makes it. Two candidates within a few tenths of a point are a tie, and should be treated as one.
- Scoring proxies instead of evidence. A well-known previous employer or an advanced degree is not the same as having done the job.
- Skipping the blind first pass. Hiding names and personal details while scoring helps the rubric do its job. See how to do blind resume review on a small team.
Running your rubric in SealedApply
SealedApply gives a search committee one private place to apply its rubric. Paste or upload your job description with the criteria and weights written into it. Each member you invite rates every applicant from 1 to 5 and leaves notes with their evidence. SealedApply averages the ratings and flags split votes, where members are two or more points apart, so the committee knows which conversations to have first. Turn on a scorecard for the search and enter your criteria (it starts from your must-haves): each member then scores every criterion from 1 to 5, and you see everyone's scores side by side with the criteria where the committee splits highlighted. Weights stay in your rubric document; the scorecard does not total them for you. You can turn on blind review to hide names and contact details during the first pass, and move candidates through stages the whole committee can see.
On paid searches, the AI hiring advisor reads every application against your job description and gives each one a summary, strengths and gaps, a 0 to 100 fit score with plain-English reasons, and three interview questions aimed at the gaps. It is advice, not a decision: your committee does the scoring and makes the call. Read how the AI works.
Common questions
How many criteria should an executive director scoring rubric have?
Four to six. Fewer than four and the rubric cannot tell strong candidates apart. More than six and volunteers stop using it, or every criterion ends up rated a 3.
Should the committee use a 1 to 5 scale or a 1 to 10 scale?
A 1 to 5 scale works best for volunteer committees. Each point can be described in plain words, so two people reading the same application land on the same number more often. A 10-point scale invites false precision.
Should every committee member score every candidate?
Yes, at least for the first review. If members only score a share of the pile, you cannot compare their ratings, and one generous or harsh reviewer can decide who advances.
Does a rubric replace the committee's judgment?
No. A rubric makes the committee's judgment visible and consistent. The final decision still comes from discussion, interviews, references, and the full board's vote.
When should the committee build the rubric?
Before the job is posted, and before anyone reads an application. A rubric written after reading resumes tends to describe the candidate someone already likes.
Keep reading