Research & Evaluation Archives - Page 2 of 8

7 Jun, 2023

Ask Nicole: Should Research Come Before Evaluation?

By Nicole Clark, LMSW|2023-06-07T11:07:37-04:00June 7th, 2023|Categories: Research & Evaluation|Tags: Ask Nicole, evaluation, Research|0 Comments

Have a question you’d like to be featured? Let me know.

This question comes from Larissa, a graduate student in Arizona. Larissa write:

Hi Nicole,

I’m a graduate student currently taking a class about research and evaluation. I also just finished a course in evaluations within education and training.

My first assignment is to distinguish between evaluation and research and I must say that your post [“Ask Nicole: What’s the Difference Between Research and Evaluation?”] has given me the clearest examples of the difference. Thank you for that!

My question to you is can you please elaborate on when circumstances are more appropriate for research than evaluation? Having more of an evaluation background now, I tend to lean towards evaluation first. Is it just that research should be done before evaluation?

I’d love to hear your thoughts!

In “Ask Nicole: What’s the Difference Between Research and Evaluation?“, I explained that how research and evaluation are both data collection and analysis tools. While research focuses on gaining or contributing new knowledge on a topic based on previous theories, evaluation is used to understand the effectiveness of a program for decision-making.

To answer Larissa’s question of whether research should be done before an evaluation, the answer is: It depends on the context (which is a very evaluator response.)

(more…)

15 Mar, 2023

Try This: Move Away from Funder-Driven Evaluation

By Nicole Clark, LMSW|2023-03-15T14:54:50-04:00March 15th, 2023|Categories: Research & Evaluation|Tags: Data Sense-Making, Evaluative Thinking, program design, Try This|0 Comments

Try this out and let me know how it goes for you.

I was a panelist on a recent webinar, discussing community and structural interventions to support maternal health equity.

During the conversation, I shared an evaluation struggle:

Evaluation is used to meet funder expectations, instead of serving as a learning tool for organizations.

A few years ago, I worked with an organization that received funding to build their evaluation capacity.

It was fun because I felt like a professor, creating an easy to understand curriculum on evaluation. Also, the staff who self-selected into this process were tasked with training departmental staff in building their evaluation capacity.

Unfortunately, organizations aren’t oriented to see evaluation in this way. Program evaluation is viewed as a means to an end, a funder request to confirm that funding was spent as intended. They’re asked to conduct “rigorous” evaluations on “evidence-based” programs, without any conversation on what rigor and evidence-based actually mean to an organization.

Before an evaluation begins, I recommend working with programming staff to clarify the program’s purpose AND what program success looks like for staff. Then, you use this to create an evaluation process that balances staff priorities and funder expectations.

This activity is ideal for:

Anyone responsible for leading data collection and sense making processes
Anyone interested in applying evaluative thinking into their work

What you’ll need:

A setup conducive to capturing ideas (laptop, pen and paper, whiteboard, etc.). Make sure your notes are kept in a place where you can refer back to

The steps:

The goal of this activity is explore what it means to move away from funder-driven evaluation.

A funder-driven evaluation centers funder priorities over staff and program participants. In order to move away from funder-driven evaluation, these commitments are needed:

(more…)

8 Jun, 2022

What Gets Measured Doesn’t Always Matter

By Nicole Clark, LMSW|2022-06-06T23:05:44-04:00June 8th, 2022|Categories: Research & Evaluation|Tags: Data, Data Driven, Evaluative Thinking|0 Comments

In one of my earlier evaluation projects, I spoke with a program participant, who received a grant from my client organization to use towards a community-based event focused on community-level breastfeeding education.

She felt that their event had not been successful because, in her eyes, the event wasn’t well attended. I believe the attendee goal was around 75-100 attendees, but maybe less than half of that number showed up.

Putting on my social worker hat, we talked through their feelings on why a large turnout mattered.

“The more people that show up, the greater my impact is”, she said. “More people will know about breastfeeding, how to get support, and also where to go for formula in case breastfeeding isn’t working out.”

While she was frustrated that the intended number of attendees didn’t show, she also highlighted an unintended outcome: The attendees that did show actively participated and stayed the entire day. They filled out the post-event evaluation survey (which can often be a struggle to do after an event), and they’ve stayed in contact to learn more about how they can advocate for positive breast and chest feeding experiences in their community, and advocate for formula support.

A bonus: Her supervisor promoted her. Years later, she now runs her own nonprofit, focusing on breastfeeding and chest feeding awareness.

It may be tempting to think higher numbers mean more impact. This is likely due to organizations being motivated to be data driven as someone is requesting this. Most likely, a funder.

When we think about the people behind the numbers, it’s important to consider the WHY behind the numbers we’re focusing on.

From the number of social media followers you have, to the number of people that show up to your event, it’s easy to pay attention to the optics.

But sometimes what we’re measuring doesn’t always matter.

(more…)

27 Oct, 2021

Try This: Prioritizing Data Findings

By Nicole Clark, LMSW|2021-10-27T14:58:54-04:00October 27th, 2021|Categories: Research & Evaluation|Tags: Data Sense-Making, Stakeholders, Try This|0 Comments

Try this out and let me know how it goes for you.

On the road to becoming grassroots and data driven, it’s tempting to start collecting data as soon as possible to determine your impact.

From funders and program participants to community leaders and policy makers, data you’ve gleaned from focus groups, informant interviews, and surveys juggle voices and perspectives of many stakeholders.

But once you have all this data, what do you do with it? And how do you prioritize these voices?

Here are 3 ways (from easy-to-do to more time-consuming) to prioritize your data findings.

This activity is ideal for:

Anyone responsible for leading data sense making processes
Anyone interested in participating in data sense making processes
Anyone interested in applying evaluative thinking into their work

Here’s what you need:

Whatever setup you use to capture your ideas (laptop, pen and paper, whiteboard, etc.) but make sure it’s kept in a place that you can refer back to

The steps:

(more…)

20 Oct, 2021

Be Grassroots and Data Driven

By Nicole Clark, LMSW|2021-10-20T09:29:41-04:00October 20th, 2021|Categories: Research & Evaluation|Tags: Evaluative Thinking, Grassroots, Nonprofits|0 Comments

*Starting with a simple question can lead to bigger impact.*

What does it mean to be data-driven as a nonprofit or smaller grassroots organization?

You’re navigating being responsive to the communities you serve, providing services and programming that provide a more just and equitable world, while also being responsive to demands on your organizational capacity.

Despite anecdotes and maybe a survey here or there that generally confirms you’re doing a good job, there’s still a demand for more proof, and it usually comes from whoever is holding the purse strings.

Being data-driven is bigger than the numbers you see and the stories you hear.

It’s also bigger than taking the numbers and molding them into stories that not only speak to hearts and minds, but generate research ideas and influences policy change.

So much of being data-driven prioritizes the demands and requests of external stakeholders, particularly funders.

In fact, many evaluation projects I’ve led started with the client organization seeking an external evaluator. They mentioned doing an external evaluation their grant as a deliverable, and now it’s anticipated by their funder.

Even with this as a deliverable, interpersonal barriers to being data-driven persists.

Being data-driven means moving beyond decision-making that primarily benefit funders and external stakeholders. It means making intentional learning investments that champion questioning, reflection, and action that directly benefit your staff AND stakeholders.

So how can nonprofits and small grassroots organizations become more data-driven? Here’s one simple, accessible way to get started:

(more…)

Ask Nicole: Should Research Come Before Evaluation?

Try This: Move Away from Funder-Driven Evaluation

What Gets Measured Doesn’t Always Matter

Try This: Prioritizing Data Findings

Be Grassroots and Data Driven

This Is A Custom Widget