Questions

AI ethics

Who is accountable when AI makes a mistake?

Accountability for AI-assisted hiring decisions can extend to both the company using the system and its supplier, depending on the case.

Engraving: blindfolded Justice, with a sword and scales, sits on a throne between Peace and a soldier.
Justice, on the frontispiece of a 1773 edition of Hugo Grotius’s On the Law of War and Peace. Public domain. Wikimedia Commons

Why it matters

The issue has already reached courts and legislation: a court accepted that an AI supplier can be liable as an employer’s agent, and the EU AI Act requires human oversight and records for recruitment systems. But assigning a person to review a recommendation does not guarantee that they will challenge it.

What the evidence shows

  1. In Mobley v. Workday, the judge accepted the theory that the supplier can be liable as an agent of employers, without that being a final ruling on the discrimination allegations.Mobley v. Workday, Inc. · N.D. Cal., no. 3:23-cv-00770, N.D. California, 2023
  2. The EU AI Act classifies systems for recruiting, selecting and evaluating workers as high-risk, with duties including human oversight and records of what they do.Regulation (EU) 2024/1689, the AI Act · European Union, 2024
  3. In a hiring study, researchers found that even participants who rated the AI poorly followed its biased recommendations.No Thoughts Just AI: Biased LLM Hiring Recommendations Alter Human Decision Making and Limit Human Autonomy · Kyra Wilson et al., AIES 2025, 2025

What I would do

“The human is always responsible because, ethically, the human is the only one who is conscious, as far as we know.”

Why I think so:

  • “Technology is not neutral: it carries the choices of those who build it and those who use it.”
  • “AI without evaluation is a bet: measure before you promise.” where it comes from
  • “A serious AI says only what it knows, shows where it got it, says when it does not know, and calls a person.” where it comes from

People also ask

  • Who is responsible when AI gets it wrong?
  • Can a company blame the AI?
  • What is AI accountability?

Read next