Lawyers could face ‘severe’ penalties for fake AI-generated citations, UK court warns

The High Court of England and Wales emphasized the necessity for lawyers to enhance their vigilance against the misuse of artificial intelligence in their legal work. In a significant ruling that consolidates two recent cases, Judge Victoria Sharp highlighted that generative AI tools, such as ChatGPT, are not reliable for conducting legal research. Judge Sharp pointed out that while these AI tools can generate responses that appear coherent and plausible, they can often be fundamentally incorrect. "These responses might confidently present false information," she stated. Although the use of AI in legal research is permissible, the judge underscored the imperative for lawyers to verify the accuracy of such information against authoritative sources before utilizing it professionally. The judge's comments arose from a growing number of instances where lawyers, including those representing major AI platforms, have cited what seem to be AI-generated inaccuracies. This trend prompted Judge Sharp to call for improved adherence to professional standards, and she indicated that her ruling would be communicated to legal professional bodies such as the Bar Council and the Law Society. In one notable case, a lawyer representing a client seeking damages from two banks submitted a filing containing 45 citations. Alarmingly, 18 of these cases were found to be non-existent, and many others were either misquoted or irrelevant. Similarly, another lawyer involved in a case regarding an eviction from a London property cited five fictitious cases in her court filing, although she denied using AI, suggesting instead that the sources might have originated from AI-generated summaries found online. While the court opted not to pursue contempt proceedings in these instances, Judge Sharp warned that this should not be interpreted as a precedent. "Lawyers who fail to meet their professional responsibilities in this area face the risk of severe penalties," she cautioned. Both lawyers involved have been referred to professional regulatory bodies for further review. Judge Sharp reminded that the court possesses a range of punitive measures for non-compliance, from public admonishments to potential criminal referrals.