Four law professors at the University of Minnesota Law School asked ChatGPT to “take” a four-subject exam last fall and then scored it “blindly” along with the exams of real students.
ChatGPT, on the other hand, has a C+ average, which is lower than the B+ average of other students. Still, if applied to the entire course, that’s enough for a chatbot to earn a law degree. Although the 21st largest university in the United States is likely to repeat students with this grade.
According to the researchers, “ChatGPT alone is just an ordinary law student. In the workplace, ChatGPT can be used to produce a first draft, allowing workers to make events more efficient.”
Currently, many schools also prohibit the use of the Internet during classroom exams to eliminate the possibility of cheating using ChatGPT , but future exams may test their ability to effectively use AI programs.
Law professors at the University of Minnesota will take ChatGPT exams in tort, employee benefits, taxation, and constitutional law. The exam consists of a total of 95 multiple-choice questions and 12 short-answer questions. ChatGPT’s test scores range from a high B in constitutional law to a low C- in tort and taxation.
ChatGPT generally does better than multiple-choice questions in short-answer questions, although its essays perform inconsistently. “In writing articles, ChatGPT has demonstrated a strong grasp of the basic rules of law and has a consistently excellent organization and structure,” the researcher said. However, it has difficulty identifying relevant issues and applies rules only superficially to the facts compared to real law students.”
Source:
https://www.newmobilelife.com/2023/01/27/chatgpt-law-exam/