Community broadcasters tune in to measuring social change

But as the recent Making Change Visible: Insights into Effective Impact Measurement webinar revealed, the real power of measurement lies in the stories it tells, the learning it fosters, and the trust it builds between funders and grantees.

Hosted by Philanthropy Ireland, the session was chaired by its head of communications and relationships, Hazel Hennessy, who reminded participants that philanthropy is as much about reflection as it is about giving: “Impact isn’t only about what happens out there in communities, it’s also about how we evolve as funders.”

The heart of the discussion came from a case study presented by SmartyGrants chief impact officer Jen Riley and the Community Broadcasting Foundation’s (CBF’s) Kate Randall. CBF supports more than 400 grantees, including First Nations, multicultural, LGBTQIA+ and youth broadcasters.

The CBF journey: From counting outputs to capturing change

Before 2022, CBF’s reporting leaned heavily on outputs: how many grants were awarded, the size of the audiences reached, the number of stations funded. Occasionally, powerful stories would surface about a youth-led broadcast tackling local misinformation or a First Nations radio station amplifying community voices, but there was no consistent way to capture and compare these stories across the portfolio.

The turning point came with a strategic restructure, reducing nine funding programs to three and introducing a shift towards outcomes and impact reporting. This meant asking new questions: What difference are we making? Who is experiencing that change? How do we know?

Implementing the shift was no small feat. As Riley explained, “CBF wanted better insight without making reporting feel like a second full-time job for grantees.” Many recipient organisations were volunteer-run, with varied data literacy. The solution was a flexible approach: allowing grantees to select up to four priority outcomes, align them with CBF’s framework, and keep their own metrics at first.

Workshops on “theory of change” helped identify crucial “middle outcomes”, the tangible shifts between immediate outputs and long-term goals. Advisory committees simplified the language and added well-being outcomes, ensuring the framework reflected the sector’s values. Over 12 months, Randall and her team developed a monitoring, evaluation and learning (MEL) framework that trimmed 200-plus indicators down to fewer than 100 and produced seven core evaluation questions, some focused on unexpected outcomes and broader contributions.

For those already implementing impact measurement

If you already have impact measurement systems in place, the CBF story offers practical ways to go deeper:

• Identify “middle outcomes”: Capture the meaningful shifts that happen before big-picture change.
• Align grantee and funder objectives: Let grantees set their own priorities first.
• Iterate continually: Review frameworks regularly, streamlining where possible.
• Blend data types: Mix metrics with narrative case studies for richer insights.
• Share data: Give grantees access to dashboards or reports for transparency and shared learning.

For those considering impact measurement for the first time

Starting from scratch can feel daunting, but the advice from the webinar was clear:

• Start with purpose: Decide why you’re measuring and who will use the findings.
• Begin small: Choose a handful of indicators you can manage well.
• Minimise the reporting burden: Especially for smaller organisations.
• Use neutral language: Avoid terms like “success indicators”, and use plain English phrases to reduce pressure.
• Build capacity: Offer training, resources and peer support as part of your grantmaking offering.

MEL for funders: Looking in the mirror

The session closed with a reminder that monitoring and evaluation isn’t just for grantees –it’s equally vital for funders. Hennessy summed up the feeling: “We should be asking ourselves the same hard questions we ask of others.”

It’s important to:

• Assess applicant experience: Measure clarity of guidelines, perceived fairness, and accessibility.
• Use real-time feedback: Dashboards and check-ins can flag issues early.
• Ask reflective questions: What worked? What didn’t? What was unexpected?
• Foster a culture of curiosity: Treat data as a learning tool, not a compliance checkbox.

By embedding these approaches, grantmakers can strengthen relationships, enhance transparency, and ensure that every euro invested creates measurable, meaningful change.

A version of this article was first published by Philanthropy Ireland, for a joint presentation with SmartyGrants.