22 Mar, 2019

Try This: I Like, I Wish, I Wonder

By |2021-08-19T20:27:39-04:00March 22nd, 2019|Categories: Workshop, Program, & Curriculum Design|Tags: , , |0 Comments

This this activity out and let me know how it goes for you.

I’ve used “I Like, I Wish, I Wonder” as a way to get quick feedback from my program and workshop participants.

Adapted from the Stanford Design School’s “I Like, I Wish, How to” process, I first used “I Like, I Wish, I Wonder” during an evaluation project with the New York City Department of Health and Mental Hygiene’s sexual and reproductive justice campaign. The campaign’s Community Engagement Group facilitated local gatherings in the five boroughs to gather insights into how various demographics were advancing Reproductive Justice in their communities.

Due to the gatherings being large in scope and attendance, we 1) needed something quick for the participants to fill out before leaving, and 2) wanted to develop an easy-to-understand evaluation process that was easy for DOHMH staff to volunteers to administer onsite (as I was not able to be at all gatherings) and for participants to not have much of a problem completing. Also, it was a lesson learned in developing an evaluation tool that generates honest constructive feedback AND helping staff and volunteers learn how to look for generated themes by a variety of participants.

This activity is ideal for:

  • Staff responsible for developing and overseeing the implementation of programs, services, and strategies
  • Gathering quick feedback in a time-crunch
  • Breaking out of the standard survey construction model
  • Staff interested in building their skills and confidence in qualitative data collection and analysis

Here’s what you need:

There are two ways to implement this process:

  • Option 1: Sheets of paper, writing utensils
  • Option 2: Butcher paper or a white board, a marker, writing utensils, post-its

The process:

For option 1: Have participants divide their sheets into four quadrants labeled “I Like”, “I Wish”, “I Wonder”. (You can also have sheets that already have the labels typed out. You’ll have an empty quadrant, and I’ll explain what to do with it later.

(more…)
20 Feb, 2019

Try This: Increase Your Staff and Stakeholders’ Engagement and Collaboration

By |2021-08-19T20:25:18-04:00February 20th, 2019|Categories: Research & Evaluation|Tags: |0 Comments

When a program is developed, it’s done so for various reasons, including based on current and relevant research, anecdotal and collected feedback and evidence from participants, funders, and more.

But even the most well-developed programs can suffer if your staff and stakeholders aren’t engaged enough to care about how the program is designed to work beyond focusing on outcomes and impact only.

As I’ve continued to shift more into engaging my clients in a more participatory way, we’ve been working together to develop a more collaborative process that generates a culture of learning about how they’re developing their programs and how their program recipients are responding to it, rather than merely meeting metrics commissioned by someone else.

Compared to previous Try This posts, what I’m sharing today is more of a process rather than actual activities. And for the purposes of today’s post, I’m labeling this process the “staff and stakeholder engagement and collaborative process“. The actual name depends on the client project I’m working on (for example, with one client, it’s called the “evaluation working group” while the process is called the “evaluation working group” with another client).

Regardless of the name, the process is the same: Bringing together staff and stakeholders to develop program goals, discover insights into how participants are engaging with the program, and develop a strategy for routine program evaluation and course-correction and generating buy-in among your staff and stakeholders.

This activity is ideal for:

  • Nonprofit and social services staff interested in developing more engagement and collaboration between staff and stakeholders (i.e. program participants, board members, and other supporters)
  • Nonprofit and social services staff that are responsible for developing and overseeing the implementation of programs, services, and strategies

Here’s what you need:

(more…)
23 Jan, 2019

Try This: The Identity Wheel

By |2021-08-19T20:23:16-04:00January 23rd, 2019|Categories: Workshop, Program, & Curriculum Design|Tags: |0 Comments

What is identity? More importantly, how do our various identities impact how we view the world, and how the world views us?

For people in the social work field and other helping professions, self awareness aids us in how to prepare for encounters with clients whose thoughts, attitudes, and lived experiences are different from ours. With my own consulting clients, we’ve had conversations about how our identities impact how we gain access to the communities we work with. The conclusion is this:

Just because we share similar identities doesn’t mean we share the same lived experiences.

Here’s an activity, adapted from the University of Michigan College of Literature, Science, and the Arts’ Inclusive Teaching Initiative called The Identity Wheel.

This activity is ideal for:

  • Encouraging reflection on the ways we identify personally and socially, and how we perceive the world and how the world perceives us
  • Identify settings and situations in which our identities are felt the most
  • Identify ways in which our identities afford us privilege

Here’s what you need:

  • White sheets of paper
  • Markers, pens, or pencils
  • Rulers, if needed
  • Round color-coding labels in four colors (like these)

The steps:

  1. Pass out the sheets of paper and writing utensils to participants. On the sheets, draw a circle and divided into 8 sections (using rulers, if needed), like this:

2. Have participants label each section with an identity they closely identify with. Here’s an example of my identities:

(more…)
10 Oct, 2018

Try This: Brainwriting for Rapid Engagement

By |2021-08-19T20:20:56-04:00October 10th, 2018|Categories: Workshop, Program, & Curriculum Design|Tags: , |0 Comments

No, that’s not a typo.

But since you’re thinking of brainstorming, let’s identify how it’s different from our focus for today, brainwriting.

When it comes to generating ideas, brainstorming typically consists of getting a group of people together to generate an idea on how to approach a particular problem. During this process, a few things may happen:

  • It’s a drawn out process
  • Sometimes the most vocal of the group tend to dominate the conversation
  • There’s one person documenting the ideas (and can’t fully participate because they’re too busy writing down everyone’s ideas)
  • The person documenting typically has the most power in how the idea looks when written down
  • There are a lot of ideas, but fewer suggestions on what to do with these ideas
  • There’s a greater chance for boredom

In comparison, brainwriting addresses these concerns by:

  • Limiting the amount of time the group generates ideas
  • Everyone participates equally rather than the most vocal of the group
  • Everyone is writing down their ideas instead of one person
  • Everyone decides how their idea looks written down
  • Everyone has the opportunity to provide a variation of the ideas, which promotes for creativity and insights into next steps
  • It’s more engaging

Brainwriting is a more effective process because it allows for more individuality in generating ideas rapidly, rather than conforming to groupthink. Rather than focusing on one person at a time, this method reduces the amount of talking that occurs during brainstorming, which can take time away from idea generation.

This activity is ideal for:

  • Understanding how an idea looks from multiple perspectives
  • Understanding how problem can be solved based on multiple perspectives
  • Having a more engaging process for group work within a training or workshop
  • Including more creative exercises within a focus group
  • Creating a more equitable way for introverts and extroverts people to participate

Here’s what you need:

  • Sheets of paper
  • Pens or pencils 

The steps:

(more…)

8 Aug, 2018

Try This: Curb Your Evaluation Anxiety

By |2021-08-19T20:15:34-04:00August 8th, 2018|Categories: Research & Evaluation|Tags: , , |0 Comments


With my program and evaluation clients, I offer the Evaluation Capacity Measure. It’s an assessment created by Ann Price of Community Evaluation Solutions , and I’ve revised it a bit to include some open-ended questions. The assessment assesses an organization’s current capacity to evaluate its programs, strategies and services and assesses its current support around evaluative thinking. Everyone from organizational leadership to board of director members are encouraged to take the assessment.

This assessment helps me to see what the current needs are, and it also gives clients a sense of what we can work on together in the evaluation capacity building process. I offer it to clients first as a baseline, then towards the end of our partnership together. Whether it’s a short-term or long-term project, clients like knowing their staff’s general views on evaluation, and how the process can be aligned with their respective roles and organizational mission and strategy. (At times, they may notice that what they expected to score lower on is higher than expected, and vice versa).

I recently administered the assessment for a new client, whose staff works remotely and is comprised of several departments that work individually and collectively on several programs and strategies. Leading up to sending the assessment to her colleagues, the staff member leading the project with me shared her nervousness about what the results may reveal about her staff, but is excited to see how the results can influence how they can proceed with their evaluation priorities.

The goal of program evaluation is to 1) see if your program is performing in the way it’s intended to and 2) facilitate organizational learning and improvement.  In general, people tend to experience anxiety when they’re being evaluated. It’s like when you waited in a line with your classmates to see which kickball team captain would choose you for their team. You want the best players on your team, and the captains are sizing you up. Who is known to kick the farthest? Who has the capability to catch the ball mid-air? Who can run the fastest?

And when you’re last to be picked, it makes you feel a way. “Why wasn’t I one of the earlier picks?”, you asked. More often the not, the team captains probably chose their team based on who they’re friends with, but there’s a lot of emotional reactions that may come up.

You get into the real world of adulting, and the feeling is still there. This time, it surfaces when you’re meeting with your supervisor for you mid-year or annual review. You think you’re performing well in most areas, until you discover (through someone else’s perspective) that you’re not.

In “Strategies for Managing Evaluation Anxiety: Toward a Psychology of Program Evaluation” (American Journal of Evaluation, Vol. 23 Issue 3, 2002), Stewart Donaldson, Laura E. Googler, Michael Striven dubbed the term “excessive evaluation anxiety” (or XEA). Symptoms of XEA include:

  • Lack of access to important information and data
  • Compliance and cooperation problems
  • False reporting
  • Effects on bias and validity
  • Reduced utilization of evaluation findings.

This can lead to stakeholders behaving in ways that can destroy the credibility of evaluation findings (and of evaluators). When the findings of a program’s evaluation yield that it’s not performing in the way it was intended, the blame game can happen. Instead of falling victim to XEA, how can you and your staff become more open to viewing the process as a learning experience?

To give you a taste of the Evaluation Capacity Measure I give to my clients (and to help jumpstart the conversation with your staff around evaluation anxiety), here are some questions you can walk your staff through:

Here’s what you need:

  • Flip chart paper, chalkboards, or walls
  • Note cards
  • Pens or pencils 

Designate five open areas around the room. Each area will have one question at the top of the flip chart paper, chalkboard, or wall.

Give staff enough time to answer the questions thoughtfully . When time is up, have staff place their note cards under the designated question.

Next, divide up your staff so that each question has several eyes on it. Have staff place the note cards into themes, grouping similar responses together.

Last, have staff do a “walk-around”, where they can view the themes for each question. To close out the exercise, discuss the themes with staff and create an action plan to address the themes.

The steps:

Have your staff answer the following questions alone on note cards:

(more…)

This Is A Custom Widget

This Sliding Bar can be switched on or off in theme options, and can take any widget you throw at it or even fill it with your custom HTML Code. Its perfect for grabbing the attention of your viewers. Choose between 1, 2, 3 or 4 columns, set the background color, widget divider color, activate transparency, a top border or fully disable it on desktop and mobile.
Go to Top