I brought that line into We All Count’s Talking Data Equity series when I presented this framework. What was striking was not that the idea felt new, but that it was immediately recognizable across contexts. That kind of recognition points to something structural: the work that makes evidence usable is widely experienced, but rarely named or accounted for within evaluation itself.

Many people knew the work and the spaces between what gets counted and what has to be understood. They knew the moment when a dashboard satisfied the reporting requirement, but left the real question untouched. They knew the quiet labor that happens before the report arrives, before the findings deck is shared, before the clean chart appears in front of a board, a funder, or a leadership team. That is the work I wanted to name and share at this talk: Not evaluation as a method alone, but evaluation as a decision infrastructure.

Evidence does not become decision-ready because it has been counted. It becomes decision-ready because someone has done the invisible labor of making the evidence honest, usable, and aligned with the decision it is meant to inform.

Where the work actually happens

The following examples demonstrate the invisible work evaluation does to examine evidence and hold the questions no one wants to ask.

Local Arts Nonprofit

An organization working with middle school students had a funder focused on learning outcomes, program staff who understood the work as identity formation and belonging, and community members whose relationship to the program was cultural in ways neither framework fully captured. Each perspective was legitimate, but they were not measuring the same thing.

The visible outcome was a report. It included the number of students served, performances attended, and the hours of instruction. Those numbers were real, but they could not carry the full meaning of the work on their own.

The invisible labor was translation.

The work was not to force everyone into one flat story, but to build a framework in which different stakeholders could recognize their own understanding within the same body of evidence without pretending those understandings were identical.

That meant staying inside the tension long enough to ask the question the dashboard could not answer: what is the closest honest proxy for what this work produces, and what do we need to say clearly about what that proxy cannot capture? The report did not show that labor, but everything built from it depended on it.

The question the room has not asked

International Health Organization

The organization had screened tens of thousands of people for a disease. The number was large, the coverage documented, and the funder report showed scale. Everyone in the relationship had reason to be satisfied.

The question the evaluator held back from asking was this: of the positive screens, how many received treatment? Of those who received treatment, how many completed it?

The data were fragmented across clinic records, community health worker logs, and follow-up documentation, but they had never been pulled together. Nobody had asked for it in that form, but the outcome question was sitting there not outside the evaluation but inside of it.

The moment of judgment was not only methodological. It was professional, relational, and structural. Is it the evaluator’s job to ask a question no one in the relationship has required?

That is where invisible labor stops sounding soft.

A number that satisfied everyone in the room except the question is not a finding. It is a gap wearing the shape of a finding.

The evaluator’s job is not to embarrass the room or turn every engagement into a confrontation, nor to punish organizations for measuring what they were asked to measure. But evaluation cannot serve decision-making if it only protects the questions the room already knows how to hold. That is the distinction that matters.

The invisible labor of holding the questions no one wants to ask is the work of pushing against that current. Without it, evidence can look complete while remaining decision-poor. A dashboard can be accurate and still not be useful. A finding can satisfy a relationship and still fail the question the investment was always asking.

That is why the invisible labor matters. Not because evaluators need to be praised for what no one sees, though many have carried this work without naming it, but because the labor is part of the evaluation’s actual value. Serious evaluation has to name the labor, not just the methodology. It has to measure toward intent, not toward ease, and hold the question long enough for evidence to become more than proof that activity occurred.

Evidence should help capital move toward what it intends to produce. That requires more than data collection. It requires an evaluator in the room willing to do the invisible work behind visible outcomes.

Rhonda Williams, Ph.D. is an evaluator and philanthropic practitioner examining how capital deploys toward or away from the outcomes it intends to produce.

This essay is part of Evidence 2 Decision, where I trace the distance between capital deployed and change produced. Explore the work at evidence2decision.com.

Subscribe now

That gap operates everywhere significant capital meets intended change. I have spent my career watching it surface inside philanthropic work, especially when the thing being counted stands in for the thing the investment was meant to change. The question does not stay in philanthropy. It follows the capital. And it sharpens considerably when it reaches housing.

When funders commit significant resources to housing and name housing as the foundation everything else sits on, housing stops functioning as a single program area and becomes civic infrastructure. That shift makes a claim that requires examination deeper than most current measurement systems are built to reach. The trees illustrate the principle. Housing is where the principle meets its highest stakes.

Where measurement stops and examination begins

Most housing investment is measured at the level of what was produced: units built, dollars deployed, partnerships formed, policies advanced. These are outputs. They answer the question of whether the investment did something, and they are real. Serious housing investment should be accountable to those numbers, and many institutions are doing that accountability work with genuine rigor.

But output measurement does not answer the question that the foundational claim requires. If housing is the thing everything else depends on, then the measurement has to follow the logic chain past what was produced and into what changed. And what changed, in housing, operates at three distinct levels that demand fundamentally different examination.

At the individual level:

Has a person’s housing situation changed in a way that produces stability rather than just placement?

Occupying a unit and building a stable foundation are not the same outcome. Current reporting counts the first. The question that matters asks about the second.

At the household level:

Did the housing change produce downstream conditions across the household system?

Employment continuity. Educational stability for children. Health access. The beginning of wealth-building rather than the perpetuation of cost burden. Housing as foundation means the household is where the theory of change either holds or does not. If the foundational claim is real, the evidence has to be visible here.

At the neighborhood level:

Did the aggregate of individual and household changes produce community conditions that hold across time?

Sustained affordability. Economic diversity. Institutional investment that compounds rather than extracts. Neighborhood-level stability that does not reverse with the next market cycle. This is where the foundational claim is ultimately tested, and where the measurement architecture is most absent.

Each level reveals something that the level above it cannot see. A housing investment can look successful at the output level and still not have answered whether the individual lives within those units have actually changed in the ways the investment was designed to produce.

The field is beginning to name the same gap

This question is already present across social impact work, even when it has not been named directly. Practitioners are encountering it wherever investment claims to produce change that outlasts the activity it funds.

Sonia Ben Jaafar, CEO of the Abdulla Al Ghurair Foundation, recently wrote in the Stanford Social Innovation Review that philanthropy judges capital by what it builds while it is building, when it should judge by what stands after the capital withdraws. She draws a distinction between capital that supports activity within existing systems and capital that changes the underlying operating logic so that what was built persists structurally. Her examination is education, not housing. Her geography is international, not domestic. And she is arriving at the same structural gap this series has been examining from the beginning.

When practitioners across continents and sectors independently surface the same missing dimension, it is no longer one evaluator’s framework. It is the field’s unfinished work.

The standard

When practitioners across contexts are surfacing the same missing dimension, the standard has to move with the insight. It is no longer enough to ask what capital built, funded, or counted while the work was active. The harder question is what changed after the investment entered the system, and whether that change held at the level where the claim was made. In housing, that means people, households, and neighborhoods. Across the field, it means building the examination capacity to follow impact beyond the first thing we can count.

If impact is harder to prove, then serious investment has to stay with the question past the point where counting becomes easy.

Rhonda Williams, Ph.D. is an evaluator and philanthropic practitioner examining how capital deploys toward or away from the outcomes it intends to produce.

This essay is part of Evidence 2 Decision, where I trace the distance between capital deployed and change produced. Explore the work at evidence2decision.com.

Subscribe now

I know this from the inside. For nearly two decades I have practiced collective giving in three distinct institutional forms, not as a researcher studying philanthropy from a distance, but as a practitioner making allocation decisions with real dollars and real accountability. My view is built upon community voice and grantmaking, not individual wealth. But I am also the evaluator who was in those rooms and this is where this dual positioning revealed itself.

What the three forms taught me

The Village Giving Circle at Communities Foundation of Texas was founded in 2017 by nine Black women who believed that collective resources, directed by people with lived proximity to a community, produce something scattered individual giving cannot. Today, the circle has nearly 70 members and has awarded more than $1.6 million to 50 local nonprofits. As the Former Chair of this circle, I watched what happens when a room full of donors who share both purpose and proximity examine a grant request together. The questions that surface are different. The candor and the standard are different. When you are accountable to peers who share your values and your community, comfortable findings don’t survive the way they do when accountability runs only to yourself.

Rising GENerosity, housed at The Dallas Foundation, is designed not just to pool giving but to cultivate the judgment required to give well over time. Its architecture builds something durable: a generation of philanthropic practitioners in a region who learn alongside each other, whose confidence in where and how to invest compounds collectively rather than in isolation. Serving on its steering committee has shown me what intentional philanthropic formation looks like when it is treated as infrastructure, not left to accumulate by accident. The calendar of site visits, lunch-and-learns, and community engagements isn’t programming. It is the systematic development of philanthropic judgment.

The Junior League represents a third form: collective giving embedded inside a governance structure with fiduciary accountability. I joined as a teacher in Jacksonville, Florida; paused during doctoral study; transferred to the Junior League of Dallas; and have served on the board of both leagues as Finance Vice President. Twenty years. Two cities. Two board roles. The giving is not separated from governance; it is governed. And that distinction matters more than most donors realize until they are sitting inside it.

Each context produces the same structural reality: the evidentiary bar rises when judgment is pooled.

Why the bar is actually higher

When one person gives, their confidence is the standard. The emotional narrative that moves a single donor carries enormous weight in that context. Individual giving is personal. It runs at the speed of one person’s conviction.

Collective giving runs at the speed of shared conviction. That is a different thing entirely.

In a collective deliberation, the emotional narrative has to survive a roomful of people. It has to hold up when someone asks about the data behind the story. It has to answer the question that individual donors rarely ask aloud: Does what this organization does actually produce what it says it produces?

The organizations that navigate collective giving most effectively understand that the evidentiary standard has shifted. The room is asking a coherence question, not just an inspiration question.

The honest tension

Collective giving is slower than individual giving. For urgent community needs, that friction has real costs. Capital that could move in weeks takes months to move. This is not a flaw to fix. It is a structural tradeoff worth naming honestly. The same friction that slows collective giving down is what makes its decisions stronger.

The question for collective giving is not how to eliminate the friction. It’s whether the deliberation is honest enough to let the friction function the way it’s supposed to. Polite consensus is not the same as shared conviction. Collective giving structures that mistake one for the other don’t produce what they are capable of producing.

What it builds that individual giving cannot

Individual giving builds relationships between donors and organizations. Collective giving builds something larger: a community of donors whose confidence in a sector compounds together over time. When the Village Giving Circle awards a grant, 70 women carry that investment forward as advocates, connectors, and informed voices. The grant is not the end of the relationship. It is the beginning of a collective endorsement that individual philanthropy cannot replicate.

This is what I mean when I say that generosity, when intentional and impact-driven, has the power to transform communities. Not generosity as an impulse, not generosity as a transaction, but generosity as a practiced discipline, built collectively, sustained over time, and examined honestly enough to know whether it is producing what it intends. That is what collective giving builds that individual giving cannot.

Rhonda Williams, Ph.D. is an evaluator and philanthropic practitioner examining how capital deploys toward or away from the outcomes it intends to produce.

Subscribe now

In 2017, I wrote my first piece for AEA365, which is the American Evaluation Association’s daily blog read by practitioners across the field. I was a new evaluator, figuring out the mechanics. The piece was titled Tricks for Getting Started and Unstuck. The title says everything about where I was intellectually. The question I was asking was simple: how do I do this well when the path forward isn’t clear?

That’s the right question for a new evaluator. It just isn’t the most important one.

The evolution looked like progress

Over the years, the questions got more sophisticated. A later AEA365 piece examined how to steer evaluation inside a new organization by connecting the formal and informal, building stakeholder relationships, and aligning evaluation design to strategic context. The question had shifted from how do I execute to how do I connect evaluation to what the organization actually needs.

Then came the work on collaboration and storytelling. A 2023 AEA365 contribution explored how evaluation findings become useful only when collaboration is built into the process and when storytelling bridges the gap between data and decision. Around the same time, I developed an Introduction to Focus Groups eLearning course for the American Evaluation Association. Because focus groups, done rigorously, are one of the most powerful tools for elevating voice and nuance that quantitative data alone cannot capture.

Each step felt like growth. Better methodology. Sharper tools. More intentional process. More compelling stories. And it was growth and I am not walking any of it back.

But something was missing from the frame. Serving on the boards of the American Evaluation Association and the Texas Evaluation Network gave me a front row seat to what the field was celebrating. It also gave me a clear view of what it was missing. And I couldn’t see it clearly until I looked at the same work through a different lens entirely.

The lens I wasn’t using

I came to evaluation post-PhD, with a research and evaluation methodology background, through organizational work, philanthropic engagement, and the kind of applied learning that happens when you’re already inside the rooms where decisions get made before you have the formal title to match. That entry point shaped everything I see in the work.

Alongside my evaluation career, I have spent two decades as a philanthropic practitioner, directing my own charitable resources, leading giving circles, serving on philanthropic steering committees, and sitting in the rooms where funders make allocation decisions.

That dual positioning created a tension I couldn’t resolve with evaluation tools alone. There were specific, uncomfortable moments when I looked at rigorous, well-designed evaluation work, and something didn’t sit right. The methodology was sound. The collaboration was genuine. The story was compelling. And yet I kept returning to a question the evaluation framework wasn’t asking:

Does what we’re evaluating actually track toward what the funder intended to produce?

Not whether the evaluation was rigorous. Not whether the story was compelling. Not whether the collaboration was genuine or the focus groups were well-designed. Those are questions about the quality of the evaluation practice.

The harder question is one order deeper: Does the program being evaluated actually create the conditions for the outcome the funder believes they’re funding? A beautifully executed evaluation of an incoherent investment is still an evaluation of an incoherent investment.

The difference is not in the quality of the measurement. It is in whether anyone was willing to interrogate the logic before the resources were committed and the story was already written. The rigor of the measurement doesn’t repair the gap in the theory of change.

What nearly a decade of practice actually taught me

The tools matter! Rigorous collaboration matters and compelling storytelling matters. Focus groups that elevate voice and nuance also matter. Every piece of craft I developed across those years of evaluation practice matters. But craft in service of the wrong question produces polished findings that do not move the pressing issues deeply.

The question I wasn’t asking; the one the evaluation field largely still isn’t asking at the level. Whether what gets funded actually does what it claims to do in a way that produces what the funder actually intends. That is not a methodology question and it requires standing simultaneously within the evaluation framework and within the philanthropic decision, holding both at once to see them clearly.

I could not write that AEA365 piece in 2017, the formation was not complete yet. The dual lens was not fully operational. The question was not yet visible to me with sufficient precision. It is now.

That is what a decade of practice taught me, that evaluation practice alone could not: that the most important question in philanthropic evaluation is not how well we measure what happened. It is whether what happened honestly tracks toward what the investment was designed to produce.

Everything I write here starts from that question.

Rhonda Williams, Ph.D. is an evaluator and philanthropic practitioner examining how capital deploys toward or away from the outcomes it intends to produce.

Subscribe now

Leave a comment

I was in the room recently when the leaders behind Children’s Health Foundation shared what that investment is actually building in Dallas. What struck me, as both an evaluator and someone who has spent two decades directing philanthropic capital, wasn’t the number. It was the logic underneath it.

They aren’t funding a building. They’re funding the system’s capacity to meet demand that doesn’t fully exist yet, but will. That distinction is the whole thing.

The difference between construction and capacity

Most infrastructure investment in fast-growing regions follows the same pattern: wait until the need is undeniable, respond to the pressure, and build to current demand. The result is perpetual catch-up. The region grows. The infrastructure lags. The gap between what the population needs and what exists becomes the permanent condition.

What the Children’s Health Foundation is doing is structurally different. They’re building to a population curve that hasn’t fully arrived, designing capacity for the Dallas-Fort Worth metro that a fast-growing region will require, not the one it currently has.

This isn’t a subtle distinction. It’s the difference between reactive infrastructure and anticipatory infrastructure. Between funding what is and funding what the evidence says is coming.

The honest evaluator’s question is whether the investment logic actually holds. Does the capital deployment match the stated intention? Does building this campus now, at this scale, actually create the conditions for the outcome being claimed?

In this case, the answer is yes, and here’s why: the population data supports it. The region’s growth trajectory is documented. The pediatric care gap is measurable. The decision to build ahead of the demand curve rather than behind it has a rigorous logical foundation. This isn’t faith in a vision. It’s a capital decision anchored in demographic evidence and structural analysis.

The longer arc

There’s a harder question underneath the construction question. Not just whether the building gets built, but whether the capacity it creates actually produces the outcomes the investment intends over time.

Does a regional pediatric care system built to scale with population growth actually improve health outcomes for children in fast-growing communities? Does anticipatory infrastructure investment change what families in those communities can access? Does the logic chain hold from capital deployment through construction to capacity to access to outcome?

These are second-order questions. They can’t be answered at the ribbon cutting. They require the long arc, the willingness to follow an investment through its full logical chain rather than stopping at the output that’s easiest to count.

Most evaluations stop at the building. How many beds? How many patients served? How many procedures were performed? Those numbers are real, and they matter. But they don’t answer the question a serious funder should be asking: does what we built actually create the conditions for what we intended to change?

Why this matters beyond one hospital system

The Children’s Health investment is exceptional in scale. The underlying principle is not. Every significant philanthropic capital deployment faces the same structural question: are we funding the thing, or are we funding what the thing is supposed to produce? Are we building the building or building the capacity? Are we counting outputs, or are we honestly examining whether those outputs create the conditions for the outcomes we care about?

Fast-growing regions either build for the future they can see coming or spend decades closing the gap. The same logic applies to every domain where philanthropic capital meets community need: education, housing, workforce development, and health infrastructure.

The investment that thinks one order deeper than the immediate output is the one that actually changes the trajectory.

Worth funding. Worth examining honestly, before, during, and long after the ribbon is cut.

Rhonda Williams, Ph.D., is an evaluator and philanthropic practitioner examining how capital is deployed toward, or away from, the outcomes it intends to produce.