A Lawyer Paid $5,000 to Learn That ChatGPT Makes Things Up
New Mexico's Supreme Court has fined attorney Stephen Aarons $5,000 and held him in contempt after his AI-generated appeal brief in a murder case contained invented witnesses, fabricated police testimony, and false descriptions of a shooter's appearance, according to The Verge.
Aarons admitted to using ChatGPT and expecting it to produce a "bulletproof summary" of the trial. Justice C. Shannon Bacon's response was pointed: "Counsel, do you watch the news? Do you listen to the radio? Do you read anything about what's going on in the world?"
This is not new territory. Two law firms were sanctioned last year for filing briefs packed with false citations, and lawyers for Mike Lindell were fined for AI-generated misquotes. The pattern is clear and courts are running out of patience.
The core problem is what AI researchers call hallucination: when a language model generates text that sounds authoritative but is simply wrong. Think of it like a very confident intern who, rather than saying "I don't know," invents an answer that sounds exactly like the real thing.
Aarons described it as "an honest mistake." Courts are making clear that honest mistakes with AI carry real consequences.
If you use AI tools to draft anything that gets submitted formally, such as a legal document, a job application or a report, verify every factual claim against the original source before it leaves your hands.
Sources

