What Gets Measured Doesn’t Always Matter

By |2022-06-06T23:05:44-04:00June 8th, 2022|Categories: Research & Evaluation|Tags: , , |0 Comments


In one of my earlier evaluation projects, I spoke with a program participant, who received a grant from my client organization to use towards a community-based event focused on community-level breastfeeding education.

She felt that their event had not been successful because, in her eyes, the event wasn’t well attended. I believe the attendee goal was around 75-100 attendees, but maybe less than half of that number showed up.

Putting on my social worker hat, we talked through their feelings on why a large turnout mattered.

“The more people that show up, the greater my impact is”, she said. “More people will know about breastfeeding, how to get support, and also where to go for formula in case breastfeeding isn’t working out.”

While she was frustrated that the intended number of attendees didn’t show, she also highlighted an unintended outcome: The attendees that did show actively participated and stayed the entire day. They filled out the post-event evaluation survey (which can often be a struggle to do after an event), and they’ve stayed in contact to learn more about how they can advocate for positive breast and chest feeding experiences in their community, and advocate for formula support.

A bonus: Her supervisor promoted her. Years later, she now runs her own nonprofit, focusing on breastfeeding and chest feeding awareness.

It may be tempting to think higher numbers mean more impact. This is likely due to organizations being motivated to be data driven as someone is requesting this. Most likely, a funder.

When we think about the people behind the numbers, it’s important to consider the WHY behind the numbers we’re focusing on.

From the number of social media followers you have, to the number of people that show up to your event, it’s easy to pay attention to the optics.

But sometimes what we’re measuring doesn’t always matter.

(more…)