Weekly take: Fake judgment row shouldn’t spark AI concern
Managing IP is part of Legal Benchmarking Limited, 4 Bouverie Street, London, EC4Y 8AX
Copyright © Legal Benchmarking Limited and its affiliated companies 2024

Accessibility | Terms of Use | Privacy Policy | Modern Slavery Statement

Weekly take: Fake judgment row shouldn’t spark AI concern


A New York lawyer could face sanctions after citing fake judgments generated by ChatGPT, but that doesn’t mean practitioners should shy away from AI

Many posts have been circulating on social media about the dangers of using artificial intelligence tools after it emerged that a US-based practitioner relied on non-existent judgments generated by ChatGPT at a court hearing.

The opposing counsel pointed out during arguments that they couldn’t find the cited judgments.

Upon examination, the US District Court for the Southern District of New York found that they were in fact fake citations.

The court then asked the responsible attorney to show cause why he shouldn’t be sanctioned for relying on fake cases to support his arguments.

The lawyer, Steven Schwartz, an attorney at Levidow, Levidow & Oberman in New York, said he was unaware that content provided by ChatGPT could be false and that he was at fault for not confirming the information.

The current case doesn't concern intellectual property, but there is a lesson or two to be learned for the entire legal industry, including the IP sector.

I understand why the incident may have led to increased scepticism towards ChatGPT, but that doesn’t mean that the tool is the only one to blame or that lawyers should stop using AI systems completely.

To me, the case highlights what you shouldn’t do as a lawyer more than it points to the fallibility of a tool launched just six months ago and which has yet to reach its full potential.

According to reports, Schwartz asked ChatGPT to verify whether the cases it found were real and the tool assured him that they were.

If a first-year associate had conducted the same research, the lawyer in charge would probably have verified the citations themselves.

Why shouldn’t the same level of due diligence apply to AI-generated research?

No shortcuts

AI, as it stands, is perhaps not that different from a first-year associate. It’s taking baby steps into a whole new world and is bound to make mistakes.

It is, therefore, incumbent on the users of such tools to ensure that they diligently verify all work it produces and not blindly rely on it.

If someone wants to take the shortcut to success by relying on generative AI without any due diligence on their part, they must take the fall if things backfire.

In this case, ChatGPT provided research that could have been easily verified.

But there are bound to be circumstances that will be more complex.

For example, IP service providers have now started using AI tools to enhance their offering – such as generating names that are not trademarked or assessing chances of success in IP oppositions or infringement cases.

The AI tools analyse thousands of datasets to provide such information.

It could be virtually impossible for a human to physically scan through all those datasets to confirm if the results were accurate.

If a tool can generate fake results, is there any way to make sure it has scanned through all the relevant data provided to it to generate answers?

To my knowledge, the answer is no.

This, again, demonstrates why lawyers must place limited reliance on AI tools.

Hard graft

At the same time, I don't support boycotting AI systems altogether.

Blaming the tool for human errors isn’t the right approach to dealing with this new technology.

AI is growing at an unprecedented rate, and it could help IP lawyers with several tasks, including preparing first drafts of licensing agreements, trademark and patent specifications, and even coming up with available names for new products.

But expecting it to do all your work is unreasonable.

Lawyers must see AI as a tool that can scale up but not replace human effort.

For now, this means using AI only to assist with initial research, preparing working drafts, or ruling out possibilities. But one must put in the necessary hours to review the generated work products for accuracy and suitability.

If more users did that, the conversation within the legal profession would probably shift from the dangers posed by AI to the opportunities it presents.

more from across site and ros bottom lb

More from across our site

The FRAND rate is only 5 cents higher than the per-device rate determined at first instance in 2023
We provide a rundown of Managing IP’s news and analysis from the week, and review what’s been happening elsewhere in IP
Nearly four months after joining Crowell & Moring, Edward Taelman reflects on starting afresh, new clients, and firm culture
Firms discuss the ebb and flow of life sciences IP work and explain how they help professionals pivot between specialities
Mercedes-Benz, Dolby Laboratories, and Panasonic discuss the merits and drawbacks of the USPTO's terminal disclaimer proposal
In-house counsel believe Chinese domestic firms are becoming as sophisticated as international firms, but they may not shift their portfolios just yet
The Court of Appeals for the Federal Circuit is looking to renew a ban that has prevented Judge Pauline Newman from hearing cases
The list of the top representative firms at the UPC may yield few surprises but their success did not come free
The German firms have accounted for 26% of all infringement actions, while US corporations appear interested in litigating at the forum, a report has revealed
Vincent Brault tells us how he fits kitesurfing into his lunchtime routine and why IP is no longer seen as ‘nerdy’
Gift this article