What Philanthropic Evaluation Is Being Asked to Carry
And Why Reporting Alone Cannot Hold It
To evaluate is to ascertain value. Not merely to count what was produced nor only confirm that outputs matched deliverables. It is also not to simply document that funds were used as specified. To evaluate, in a philanthropic context, is to ask whether the evidence can support the claim being made from the investment.
That distinction matters because philanthropic capital often moves in response to what evaluation makes visible. A report can confirm activity and a dashboard can organize progress. And a grant summary can document compliance, but all of that work has value. None of it is the same as answering whether what was funded produced the change the funder believed the investment would support. That is the question philanthropic evaluation is being asked to carry. And reporting alone cannot hold it.
The evaluation field has built something genuinely significant over the past forty years. Rigorous methodology with professional standards; an awesome body of knowledge about how to design inquiry, collect evidence, interpret findings, and report with integrity. And I write this piece from inside the evaluation field, not outside it. It is a professional home I respect, and one I believe can also handle a harder question in philanthropic contexts.
Because I am speaking from inside the field, I want to be precise about the domain I am naming. I am not speaking for every context in which evaluation operates in; I am speaking about philanthropic evaluation.
That is the land where I have lived professionally and as a practitioner for two decades. It is the place where evaluation practice meets philanthropic capital, where findings are expected to help funders understand what their investments are producing, and where the gap between reporting and evaluative judgment becomes especially consequential.
The question reporting can answer
Most philanthropic evaluation is built to answer the question that can be asked most readily: Did the funded work produce what it said it would produce?
Funders should know whether activities were completed, participants were served, dollars were deployed, partnerships were formed, and deliverables were met. A field that did not care about those things would not be rigorous. It would be careless. But philanthropic capital is usually makes a deeper claim than activity.
A foundation does not invest in an issue only because units or number served can be counted. It invests becauses it beleives it will produce a better world and make an impact on the lives of others. And the report can show what happened as a result of those fund. The harder question is whether what happened carried the weight of what was intended. That is where philanthropic evaluation has to become sharper than reporting.
The question is not only whether the program or intiative ran well. It is whether the link between what was funded and what was intended can withstand honest examination. It asks whether the evidence supports the inference the funder is being asked to make. Also it asks whether the work produced the conditions the investment was meant to create, not simply whether the grantee completed the activities attached to the grant.
That is a harder question. It is also the one philanthropic evaluation that is increasingly being asked to answer. The rising donor class is asking more difficult questions that get beyond the first order results.
Why does the gap exist
I do not think this gap exists because evaluators lack skill, or because funders lack seriousness, or because organizations are unwilling to tell the truth. The gap is structural.
Evaluation as a discipline was shaped in academic, institutional, and programmatic contexts where the central purposes often included program improvement, accountability, learning, and knowledge generation. Those origins produced important strengths. They shaped the questions the field learned to ask well, the methods it developed to answer them, and the audiences it learned to serve.
But philanthropic capital creates a particular kind of evaluative demand. The funder is not only asking whether something happened. The funder is making a decision about whether to continue, expand, redesign, end, or deepen an investment. That decision depends on more than completed activities. It depends on whether the funded work is producing movement toward the change the investment was designed to support.
That decision cannot rest on activity alone. It requires an inference about contribution: whether the funded work is producing movement toward the change the investment was designed to support, and whether the evidence is strong enough to justify the next capital decision.
That difference is the gap.
The field has strong tools. The field has serious practitioners. The field has methodologies that can hold complexity. But in philanthropic contexts, those tools have to be aimed at the question the capital is actually asking. Does this investment do what we believe it does? That question is simple enough to say. It is not simple to answer.
What AI changes and what it cannot carry
Artificial intelligence will make it harder to avoid this distinction. This distinction matters now because the reporting function is about to become easier to produce at scale.
Artificial intelligence will not create that shift on its own, but it will accelerate it. The parts of evaluation that organize, summarize, classify, compare, and track reported information will become faster. In some cases, they will become dramatically faster.
That will not make philanthropic evaluation less important. It will make it harder to avoid evaluative judgment.
AI is already changing what outcomes tracking can do. It can surface patterns across large datasets. It can compare stated goals against reported activities. It can map alignment across multi-year grant portfolios. It can summarize narratives, detect repetition, organize documents, and make visible connections that would have taken human teams far longer to identify.
Those capabilities will improve. And as they improve, the countable parts of evaluation will become easier to automate, accelerate, and scale. That does not make evaluation less important. It makes judgment more important.
This is evaluative judgment. And in philanthropic evaluation, judgment is not decorative. It is the work. It is the disciplined ability to examine whether the evidence supports the decision the funder is being asked to make. It is the ability to distinguish between activity and movement, between completion and contribution, between reporting confidence and real understanding.
The future of philanthropic evaluation is not simply better tracking; it is a better examination.
What philanthropic evaluation is being asked to carry
Philanthropic evaluation is being asked to carry more than a record of what happened. It is being asked to carry the question of whether what happened mattered in the way the investment intended.
That requires methodology, but not methodology alone. It requires strong research methods, but not methods detached from use. It requires data, but not data mistaken for understanding. It requires reporting, but not reporting is treated as the endpoint.
It requires evaluators who can ask whether the evidence is strong enough, honest enough, and aligned enough to support the decision in front of the funder. That is the work, I believe, that philanthropic evaluation is capable of doing.
The methodologies already exist. The research disciplines already exist. The field already has practitioners trained to ask rigorous questions, examine evidence, and interpret meaning across context. The task is not to abandon what the field has built. The task is to orient that strength toward what philanthropic capital most needs to know.
Not only: Did the grantee do what it said it would do? Also: Did the investment move toward the change it was meant to support?
Not only: Can the outcomes be reported? Also: Can the evidence carry the decision being made from those outcomes?
Not only: What happened during the grant period? Also: What can be honestly understood about what the investment produced?
That is the harder question. And that is the question philanthropic evaluation is being asked to carry.
I am saying this boldly because the vantage point I occupy makes it visible. I am an evaluator formed by the field and a philanthropic practitioner shaped by rooms where capital decisions are made. Those two positions do not always ask the same questions. But the bridge between them is where this work becomes clearest.
That is why reporting alone cannot hold what philanthropic evaluation is now being asked to carry. But the harder work is determining whether any of those visible products can support the decision philanthropy is trying to make. That is where the field’s next contribution sits. Not away from rigor but deeper into it.
Rhonda Williams, Ph.D., is an evaluator, philanthropic practitioner, and founder of Evidence 2 Decision. Her writing examines how capital moves toward or away from intended outcomes.
This essay is part of Evidence 2 Decision, where she traces the distance between capital deployed and change produced. Her forthcoming book, Bridgework, introduces Second Order Methodology™, the method used in the work of Evidence 2 Decision.
Explore the work at evidence2decision.com.