In Latest Test of Its Prowess, ChatGPT Bot Passes Law School Exam

I have recently begun following the developments related to ChatGPT (Chat Generative Pre-trained Transformer),  a chatbot launched by OpenAI this past November. The New York Times hailed it as “the best artificial intelligence chatbot ever released to the general public.”

I also noted that the chatbot passed a Wharton Business School test as well as the US Medical Licensing exam . . . it is that good.

In the latest test of its prowess, it has just passed a law school exam….at the bottom of the class, though.

A chatbot powered by reams of data from the internet has passed exams at a U.S. law school after writing essays on topics ranging from constitutional law to taxation and torts…..Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test faced by students, consisting of 95 multiple-choice questions and 12 essay questions.In a white paper titled “ChatGPT goes to law school” published on Monday, he and his coauthors reported that the bot scored a C+ overall.While this was enough for a pass, the bot was near the bottom of the class in most subjects and “bombed” at multiple-choice questions involving mathematics.”In writing essays, ChatGPT displayed a strong grasp of basic legal rules and had consistently solid organization and composition,” the authors wrote.But the bot “often struggled to spot issues when given an open-ended prompt, a core skill on law school exams.”

In light of such results, educators are becoming increasingly concerned about cheating. But with challenges come opportunities.

The maker of ChatGPT is trying to curb its reputation as a freewheeling cheating machine with a new tool that can help teachers detect if a student or artificial intelligence wrote that homework.The new AI Text Classifier launched Tuesday by OpenAI follows a weeks-long discussion at schools and colleges over fears that ChatGPT’s ability to write just about anything on command could fuel academic dishonesty and hinder learning.OpenAI cautions that its new tool – like others already available – is not foolproof. The method for detecting AI-written text “is imperfect and it will be wrong sometimes,” said Jan Leike, head of OpenAI’s alignment team tasked to make its systems safer.“Because of that, it shouldn’t be solely relied upon when making decisions,” Leike said.

There have been some discussions about the types of jobs that ChatGPT and other advanced chatbots could replace. There is some good news to be had there. In addition to progressive social media writers, human resources and press offices could also be impacted.

David Autor, an MIT economist who specializes in labor, pointed to some mid-level white-collar jobs as functions that can be handled by AI, including work like writing human resources letters, producing advertising copy and drafting press releases.”Bots will be much more in the realm of people who do a mixture of intuitive and mundane tasks like writing basic advertising copy, first drafts of legal documents. Those are expert skills, and there is no question that software will make them cheaper and therefore devalue human labor,” Autor said.

In conclusion: The excellent team of lawyers and contributors here is unlikely to be replaced soon!

Tags: Technology

CLICK HERE FOR FULL VERSION OF THIS STORY