The Death of the Short-Form Physics Essay in the Coming AI Revolution
| Autor: | Will Yeadon, Oto-Obong Inyang, Arin Mizouri, Alex Peach, Craig P Testrow |
|---|---|
| Rok vydání: | 2022 |
| Předmět: | |
| Zdroj: | Physics Education, 2023, Vol.58(3), pp.035027 [Peer Reviewed Journal] |
| DOI: | 10.48550/arxiv.2212.11661 |
| Popis: | The latest AI language modules can produce original, high quality full short-form ($300$-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely available to anyone with an internet connection. In this work, we present evidence of AI generated short-form essays achieving first-class grades on an essay writing assessment from an accredited, current university Physics module. The assessment requires students answer five open-ended questions with a short, $300$-word essay each. Fifty AI answers were generated to create ten submissions that were independently marked by five separate markers. The AI generated submissions achieved an average mark of $71 \pm 2 \%$, in strong agreement with the current module average of $71 \pm 5 %$. A typical AI submission would therefore most-likely be awarded a First Class, the highest classification available at UK universities. Plagiarism detection software returned a plagiarism score between $2 \pm 1$% (Grammarly) and $7 \pm 2$% (TurnitIn). We argue that these results indicate that current AI MLPs represent a significant threat to the fidelity of short-form essays as an assessment method in Physics courses. Comment: 14 pages, 2 figures |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|