Coverage Attorney 1, ChatGPT 0

Insurance coverage counsel, take heart. In the most recent issue of his Coverage Opinions newsletter , Attorney Randy Maniloff published the results of an insurance coverage exam he recently administered to the ChatGPT AI engine. The results of the five question exam? “ChatGPt got 4 out of 5 wrong,” wrote Maniloff, “but not just wrong — dead wrong.”

ChatGPT, Esquire managed to answer only one question correctly concerning the non -insurability of punitive damages under Oklahoma law. The Bot botched the four remaining questions regarding aspects of the duty to defend, the pollution exclusion, and the insurer’s obligation to pay pre-tender defense costs.

Maniloff mercifully gave ChatGPT a bonus question which it also answered correctly. It is bad faith for an insurer to make a coverage determination using a Magic 8 ball, ChatGPT said. In three decades of practice, however, I’ve thankfully never been asked for a legal opinion on that particular question.

I caught up briefly with Randy after enjoying his piece, which like all of his writing, came with ample amounts of both wit and insight. “ChatGPT may – and that’s a may – have some value for general discussion of the law concerning a coverage issue,” Maniloff told me. “But coverage determinations are not made based on general discussions of legal issues,” he added.

The amusing exercise does offer a serious take-away. The analysis of insurance coverage questions requires highly specialized insight, and the ability to not only understand the import of policy provisions, but the nuance of the facts to which those provisions are applied. While AI might progress to some levels of further competence on the subject, it is not there currently.

Not today, ChatGPT. Not today…..


Author: CJ Haddick

C.J. Haddick is a Director with the law firm of Dickie, McCamey, & Chilcote, PC, based in Pittsburgh, Pa. He has advised and represented insurers in insurance coverage and bad faith litigation for more than three decades, and written and spoken throughout the United States on insurance coverage and bad faith prevention and litigation. He is Managing Director of the firm's Harrisburg, Pa. office. Reach him at or 717-731-4800.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: