Over the past year, I’ve become intentional in transitioning away from focusing solely on designing and implementing evaluations to working with my clients on building their capacity to do it all themselves.

And sometimes, I like to offer aspect of my services for free as a way of establishing a connection with a potential client. From a skills perspective, this helps me keep everything sharp. From a networking perspective, this puts me on the radar for future paid consulting work and referrals.

Recently, I offered to revised an evaluation tool for an organization providing small grants to community groups seeking to reduce abortion stigma. They want to develop an easy-to-understand evaluation tool that measures stigma pre and post grantee project interventions and measures overall project success.They are finding their current tool–a survey requiring grantees to provide open-ended answers–to be challenging for most of their grantees to understand, and want something that makes the process of giving feedback easier to obtain and to analyze.

In my work with past and current evaluation clients, some themes I’ve observed related to evaluation are A) a level of anxiety around evaluation as a whole given that evaluation tends to get a bad reputation, B) an interest in developing engaging ways to gather feedback that builds confidence in evaluation, and allows them to do the necessary follow-up with staff and the stakeholders, C) a question in how to implement feedback, or D) a mixture of A, B and C.

I see this more so with clients who are more grassroots or have a community organizing background as they ultimately go by direct community engagement for feedback, rather than on evaluations. Also, there is a sense of feeling protective of their programs, services, and campaigns, and no one wants to see that what they’re doing isn’t resonating with the communities they serve. So, finding a way to gather meaningful feedback and be objective of feedback that may be interpreted as negative is a balancing act.

For some background information, grantees receive small grants to develop a project/intervention that speaks to a level of abortion stigma: individual, community, institutional, media, and policy. Grantees have free reign to create what they want, with support from the organization, I made some preliminary edits to the organization’s evaluation tool, and provided some additional feedback:

First, before starting any process, understand what you want to evaluate. In this organization’s case, the current tool focuses more on the process the grantees went through in developing their project/intervention from conception to implementation. This is called a process evaluation.

An impact evaluation, on the other hand, would focus on the impact the grantees’ interventions had on their target audience(s). If a grantee expects A to occur as a result of their target audience(s)being exposed to their projects, did it really happen? If not, what factors may have contributed to this and how can they be addressed.

(more…)