Questions

Technology

Does good writing still prove anything with AI?

With AI, polished writing alone is no longer a reliable sign of a candidate’s ability. A more tailored cover letter does not necessarily help distinguish who can do the work.

Colored illumination: a man in a robe writes in a book, surrounded by open books and lecterns.
Jean Miélot, a scribe, at his desk, in a 15th-century illumination. Public domain. Wikimedia Commons

Why it matters

An AI tool can improve letters without making candidates easier to assess: in one study, the initial advantage in getting callbacks disappeared as use spread. Delegating the reading to AI also requires care, because models can favor text they produced themselves.

What the evidence shows

  1. A preliminary study found a 79% drop in the link between a tailored cover letter and a job offer after an AI tool was introduced.Signaling in the Age of AI: Evidence from Cover Letters · J. Cui, G. Dias, J. Ye, arXiv, 2025
  2. In a preliminary study’s simulated selection process, candidates who used the same AI model as the evaluator had a 23% to 60% better chance of making the shortlist.AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights · Jiannan Xu, Gujie Li, Jane Yi Jiang, arXiv; resumo estendido na AIES 2025, 2025

What I would do

I would assess what candidates can do and explain rather than reward increasingly polished letters, and test any AI used in selection.

Why I think so:

People also ask

  • Do cover letters still matter with AI?
  • How do you judge candidates when everyone writes with AI?

Read next