The Future of AI Depends on Who Builds It: Why Representation Matters

When I stepped into the world of AI ethics and nonprofit strategy, I didn’t arrive because I loved technology.

I arrived because I care about people and I could see how quickly the systems shaping our future were being built without them.

In nearly every room where decisions were being made about data, design, and deployment, the voices guiding those conversations looked remarkably similar.

Too few of them were women.

Even fewer represented the communities that nonprofits serve every day.

I come from a sector where women lead.

In the nonprofit world, women make up the majority of the workforce — holding the frontline knowledge of what human-centered systems look like.

They already understand collaboration, trust, and care at a scale technology has yet to replicate.

And yet, when it comes to AI — the force reshaping how we all work — those same women are largely absent from the design table.

The Numbers Tell the Story

Globally, women hold only 22 to 29 percent of roles in AI (World Economic Forum, Deloitte, Randstad 2024).

That means three out of every four people shaping this technology are men.

At leadership levels, the gap widens: women account for just 12 percent of STEM executives, despite earning more than a third of STEM degrees.

This is about access, pathways, and power.

Even as progress is made, women are still less likely to receive AI training, less likely to feel confident in their skills, and more likely to leave the field due to lack of inclusion or opportunity.

It’s a pattern that mirrors the same inequities AI has the potential to either solve or scale.

When Representation Shapes Reality

AI systems learn from their creators.

When development teams lack diversity, their outputs often reproduce bias — invisibly, but powerfully.

We’ve already seen examples:

• Healthcare algorithms that underdiagnose women’s conditions.

• Hiring tools that learned to filter out female applicants.

• Facial recognition systems that misidentify women with darker skin up to 34 percent more often than white men.

These are not isolated technical flaws.

They’re reflections of who was (and wasn’t) in the room.

Why Women in the Nonprofit Sector Matter to AI

The nonprofit sector is one of the most women-led ecosystems in our economy.

These leaders understand how technology intersects with equity, consent, and community impact — because they live those realities every day.

Their experience is exactly what ethical AI needs:

• The ability to balance innovation with values.

• The instinct to ask, Who might this leave out?

• The courage to make technology serve human wellbeing, not the other way around.

As AI begins to influence how social programs are delivered, how funding is allocated, and how outcomes are measured, it’s critical that these voices help guide its evolution.

Otherwise, the systems meant to amplify human good may end up automating the very inequities nonprofits work to dismantle.

Building the Table, Not Just Sitting at It

Representation in AI is about design integrity.

If we want technology that reflects diverse human experience, we have to design it that way from the start.

That means inviting women — especially those from mission-driven sectors — not just to participate, but to shape, critique, and lead.

It means consulting the people who understand trust, context, and care as much as they understand data.

Because the future of AI won’t be defined by how powerful the tools become.

It will be defined by who they’re built for — and who builds them.

Reflection I support Canadian nonprofit leaders to adopt AI in ways that protect trust, strengthen human connection, and keep people at the centre.

Beyond teaching systems or tools, when I help organizations adopt AI ethically -

I’m helping teams remember what good leadership looks like in an age of automation.

Women in the nonprofit world already know how to hold that balance — between innovation and integrity, between efficiency and empathy.

Their wisdom belongs in every conversation about the future of AI.

The technology we build now will shape decades of social systems to come.

Let’s make sure it reflects the full intelligence of the world we actually live in.

Because the future of AI depends on who builds it - and women have always been builders of the human kind.

About

Sarah Downey Sarah Downey is a Canada-based consultant helping nonprofits adopt AI safely, ethically, and confidently through governance clarity and policy development.