The Hochschule für öffentlichen Dienst (HföD) in Hof offers various AI-supported exams for the degree program in Public Administration (FH) in cooperation with the research project DeepWrite. In the summer semester of 2024, intensive collaboration began with the so-called "Compliant Teamwork Klausur," a practice assignment that students work on collaboratively via the HföD's learning management system, ILIAS. This was expanded in the winter semester to include another digital exam completed individually.
The focus is on AI-generated feedback for legal exams that students write during their first semester. Before submitting their exams, students have the option to have their papers voluntarily reviewed by current GPT models and then revise their solutions accordingly. They receive both formal and content-related feedback from the AI, along with an evaluation depending on the exam.
The pilot project also includes a widespread field–test and an evaluation of the AI-based correction assistance.
In cooperation with the DeepWrite research project, FAU Erlangen-Nürnberg is offering an online course on examination techniques in regard to the "Gutachtenstil" via the Virtuelle Hochschule Bayern (vhb). From the start of lectures in the winter semester 2023/24, we will be testing the use of Artificial Intelligence (AI) to correct short legal cases on the "Gutachtenstil" for first-year students.
In the online course, students can have their texts checked by Chat-GPT-4 and corrected with the support of AI on a voluntary basis before they apply the "Gutachtenstil" in real-life exams. In particular, the AI will point out missing elements and suggest linguistic and stylistic improvements.
The pilot project also includes an evaluation of the AI-proofreading assistant and a comparison of the feedback from human tutors with that of the AI.
In a keynote speech at the AI & Law conference of recode.law, Dr. Martin Zwickel from the FAU Erlangen-Nürnberg spoke about ChatGPT in legal education and about the cooperation project.
