When AI Invents the Citation
AI can produce convincing but inaccurate citations, treatments and figures. Secure Law and Secure Accounting reduce that risk by grounding work in approved sources and keeping professional review at the centre of the process.
A fabricated authority can enter a filing, memo or advice note if a polished AI answer is accepted without checking the source. Accountants face the same risk with treatments and figures. Firms need a process that makes supporting material visible and requires a professional to verify it.
This paper explains how Secure Law and Secure Accounting are designed to work with authorised firm material and approved sources. Lawyers and accountants check those sources and remain accountable for anything that leaves as advice or a filing.
1The pattern the profession already knows
By mid-2026, a public tracker of court decisions had recorded on the order of 1,800 cases worldwide where filings contained AI-fabricated citations or quotations, a number that has climbed steeply, with the large majority arising in US courts.1 The exact count moves as researchers add new matters. The direction does not.
Courts have imposed fines, costs, referrals and other sanctions. The consistent professional failure is reliance on a polished answer without checking the real source.
Accountants face the same pattern. An invented treatment or incorrect figure can appear reliable when it is expressed with confidence. The documents differ, but the need for source checking and professional review is the same.
2Two paths: invent, or check
Many sanction cases share one pattern. A person accepts AI-generated text and files it without checking each authority against a real source. A safer process introduces source checks and human approval before the work leaves the firm.
3Five controls make invention harder to miss
No single control prevents inaccurate output. Risk falls when the assistant works from authorised material, shows supporting sources and leaves clear review points for a lawyer or accountant. The firm also needs a deliberate process for checking updates before adding them to approved knowledge.
What each habit means in practice
Start from the firm’s own files. Secure Law and Secure Accounting work with authorised matter or engagement files and approved firm knowledge. Secure Law can also use a firm-controlled library of statutes, regulations and case law for the jurisdictions in which the firm practises.
Show the source. Being able to check is the whole game. A link or reference back to a real passage turns a polished paragraph into something a senior can open, compare, and reject. Without sources, review collapses into “does this sound right?”: exactly the trap courts are punishing.
Do not rely on unsupported claims. If the available files do not support a point, the reviewer should conduct further research. A fluent answer is not a substitute for an authority or source.
Check before it becomes “firm knowledge.” Material found outside the firm (online research, a public chatbot’s suggestions) must not quietly become “what we know” just because it sounded fluent. It stays on hold until a person checks the real sources and signs off. The same discipline keeps the legislation library current: updates are brought in on purpose, verified, and published. See The Research-to-Knowledge Pipeline for the fuller process.
A lawyer or accountant signs off. AI prepares; people decide. No tool replaces the duty to review before advice or a filing leaves the firm. The reviewer must check the source, its current status and its application to the matter.
4Grounded output can still be wrong
Sources make review possible. They do not remove the need for professional judgement.
- The wrong document can still be used. If the assistant pulls up the wrong file, an answer tied to that file is still wrong.
- A source can be misread. A confident paraphrase may not match the document. Showing the source helps, but only if someone opens it.
- Public AI tools can still invent. When the firm uses a public model under controlled conditions (for example Frontier Mode), that output is help for review: never something to treat as a citation or a figure of record.
- Skipping human review defeats everything. These habits reduce risk; they do not survive a culture that rubber-stamps AI drafts.
5Law and accounting share the same answer
For lawyers, the material is matter files and approved firm knowledge. For accountants, it is workpapers, standing treatments, and firm knowledge beside the systems that already hold the official record. The five habits are the same:
The product pages for Secure Law and Secure Accounting state the business case and this posture in short form. This paper is the fuller partner briefing, and the diagrams you can take into a risk conversation.
6Five questions to ask any AI vendor
- Does the assistant answer from the firm’s own material, with sources a person can open?
- What does the interface show when the available sources do not support a claim?
- How does outside research become approved firm knowledge without a person checking the real sources?
- Who must sign off before advice or a filing leaves, and can that step be skipped in the tool?
- Is output from a public AI tool treated as help for review, or as something you can cite?
Clear answers help the firm distinguish source-based assistance from output that is difficult to verify.
Notes & further reading
- Damien Charlotin, AI Hallucination Cases database (damiencharlotin.com). Counts move as cases are added; IntelekIQ’s Governance Imperative cited on the order of 1,800 documented court decisions as of July 2026. Treat any single headline number as a snapshot, not a permanent statistic.
- For readers who want the deeper notes: Grounded Retrieval (A5), Research-to-Knowledge (A6), Roles & Sign-off (A8), and the accounting parallels in the SAIA series.
- Related paper on where AI reads client text: Sealed Desktop, or Sealed Inference? (SC1).