New online tool will check lawyers' sloppy AI-written briefs since they can't seem to be bothered

For lawyers who love to use AI to write legal briefs, there's just one problem: bots hallucinate and make things up.

Fortunately, a new tool, CiteProof, promises to crawl over briefs and filings for fabricated case citations and misquoted court opinions before they result in sanctions, fines, or just plain embarrassing dressing downs from a judge.

This is hardly a new problem, with lawyers relying on AI to do their work for several years with predictably horrible results.

Even if GPT-4 was capable of passing a bar exam in 2023, that doesn’t mean it wasn’t hallucinating case law.

OpenAI models aren’t alone in getting lawyers in trouble, either - Claude was actually thrown under the bus by Anthropic’s own lawyers last year when defending the company from a music publishing copyright lawsuit.

A declaration in the case from an Anthropic data scientist contained a pair of Claude-formatted citations that pointed to improper records, and lawyers didn’t catch it in review.

The lawyers blamed Claude for the issue.

Stories of AI hallucinations winding up in legal briefs are everywhere nowadays, and have had serious consequences beyond professional rebukes: A Georgia court decision was even vacated last year after a court order was found to contain fictional citations.

In short, AI and the legal world, which demands precision and accuracy, don’t always mix, so a fact checker that can do a better job than apparently absent-minded human reviewers is needed.

CiteProof wants to be that fact checker.

Free users can run individual checks through CiteProof to look for citations or statutes, while paid users can run in-depth scans that include more detailed verification reports, quotation checking, bulk scanning, and the like.

CiteProof admitted that, as a small operation, some vibe-coding was involved in the creation of the platform, but no AI is involved in checking legal briefs for AI.

“You cannot reliably catch AI hallucinations with more AI guesswork,” a CiteProof spokesperson told us.

“This is the foundational principle of CiteProof.” There aren’t any LLMs or probabilistic models under CiteProof’s hood, we’re told, with queries instead relying on direct, deterministic searches of public court records to look for evidence that what AI is citing for lawyers isn’t being completely made up.