AI

AI hallucinated — and now an elite law firm is profusely apologizing to a federal judge

The facade of the Sullivan & Cromwell law firm
A lawyer from the elite law firm has apologized to a bankruptcy judge for AI errors. DAVID DEE DELGADO/Reuters
Read in app

A partner at the elite Wall Street law firm Sullivan & Cromwell wrote an apology letter to a federal bankruptcy judge for a court filing that contained AI hallucinations.

Andrew Dietderich, co-head of Global Finance & Restructuring at the firm, said in the April 18 note that a prior filing contained inaccurate citations and other errors, including AI hallucinations.

"'Hallucinations' are instances in which artificial intelligence tools fabricate case citations, misquote authorities, or generate non-existent legal sources," Dietderich's letter said. "We deeply regret that this has occurred."

A chart attached to the letter showed that the motion contained incorrect case names and numbers and apparently fabricated quotes from cases.

Dietderich said the errors by Sullivan & Cromwell, which represented the bankrupt firm Prince Global Holdings, were caught by the law firm Boies Schiller Flexner, which represented creditors, and that he'd thanked them and apologized.

He said Sullivan & Cromwell — a 140-year-old firm with more than 1,000 attorneys — has comprehensive policies when it comes to using AI and that there are safeguards to avoid this exact scenario. The firm's policies weren't followed, and the errors also made it past the firm's review process for citations, he said.

Dietderich wrote to Manhattan-based Chief Judge Martin Glenn that he and the firm were "keenly aware of our responsibility to ensure the accuracy of all submissions."

"I take responsibility for the failure to do so," he said, adding they would submit a corrected version of the filing.

A representative for the firm and Dietderich did not respond to inquiries from Business Insider. A representative for the judge also did not respond.

When it comes to AI hallucinations in legal work, Sullivan & Cromwell has company.

Fake legal citations have become more common since 2023, according to legal researcher Damien Charlotin, who keeps a public database of AI hallucinations in legal cases.

Read next

Kelsey Vlamis's face on gray background.
Kelsey Vlamis
Kelsey Vlamis is a senior reporter for Business Insider, where she covers business and tech news. She also writes business stories about travel, luxury, and culture. Previously, she covered the environment, outdoors, and indigenous issues.Her feature story "Disaster at 18,200 feet" received awards from the New York Press Club and the North American Travel Journalists Association, as well as honorable mention from the Society of American Travel Writers. She has also received an American Journalism Online Award for her coverage on missing and murdered Indigenous people in Wyoming.She's appeared on CBS, NPR, NBC, and other outlets to discuss her reporting. She previously worked on the world news desk at the BBC in London and received a master's in journalism from Northwestern University.She can be reached by email at kvlamis@bjinnox.com or via the encrypted-messaging app Signal at kelseyv.21.