Skip links

Lawyer Penalized for Using ChatGPT to Cite Fabricated Witness Testimonies

Lawyer Faces Disciplinary Action for AI-Generated Misrepresentation in Court

In a notable case highlighting the intersection of artificial intelligence and the legal profession, attorney Aarons has come under scrutiny for inaccurately citing witness testimonials in a court brief. Although Aarons did not fabricate cases, he misrepresented real testimonies and included fictitious individuals in his arguments.

During a hearing at the New Mexico Supreme Court on August 21, Aarons revealed that he used a computer-generated transcript from a murder trial alongside other case documents fed into ChatGPT. This AI tool then produced misleading quotes presented in his legal brief.

“It’s of little comfort to know that my stupidity is what brings us together this afternoon,” Aarons expressed during the proceedings. He acknowledged that his brief referenced “several witnesses who were never called at trial” and a “witness who was indeed called, but misidentified.” Additionally, the brief failed to accurately portray relevant legal precedents.

Utilizing a version of ChatGPT powered by the OpenAI o3 model, released earlier in 2025, Aarons had assumed the AI would produce an impeccable summary. He believed its reliability stemmed from the increasing reliance on AI technology in both legal and medical settings.

As a result of these serious infractions, Aarons has been temporarily prohibited from practicing before the New Mexico Supreme Court while further investigations unfold. He has been fined $5,000, which will go to the State Bar of New Mexico Client Protection Fund, with the potential for additional penalties pending disciplinary hearings.

The court has also directed the public defender’s office to assign a new attorney to the defendant’s case, invalidating all previous briefs while indicating that the case will advance in the court’s 2026-27 term.

Judicial Criticism: “You Buried Your Head in the Sand”

During the August hearing, justices expressed their astonishment at Aarons’s lack of awareness regarding the fallibility of AI-generated content. They emphasized the responsibility attorneys bear to ensure the accuracy of all information in their briefs, regardless of its source, whether from AI tools, law students, or colleagues.

Editor’s Take

This incident raises crucial concerns about the integration of AI in legal practices. As reliance on AI tools grows, legal professionals must remain vigilant about verifying information. This case serves as a wake-up call for lawyers to embrace an ethically responsible approach in leveraging technology, ensuring that AI becomes a tool for enhancement rather than a crutch leading to inaccuracies.

Source: arstechnica.com

Leave a comment