Exploring the use of AI in mathematics and statistics assessments
DOI:
https://doi.org/10.21100/msor.v23i2.1560Keywords:
Generative Artificial Intelligence, Mathematics, Statistics, Assessments.Abstract
The mathematical sciences and operational research (MSOR) community in higher education is still largely unprepared to adapt to the rapid rise of generative artificial intelligence (genAI) and its impact on assessment strategies. Whilst in-person exams remain an essential assessment mode for MSOR, take-home assignments are also an integral assessment tool. This work investigates concerns that current assignments are not robust against genAI and the way students use genAI. In this work, we address the following questions: 1) How well can genAI perform in current assignments? 2) To what extent do students currently use AI in take-home assignments? 3) How should assessment strategies evolve given the rapid improvement of genAI? Our research involves an investigation of genAI’s performance in a range of MSOR assignments. We also conducted surveys and discussions with mathematics and statistics students and staff at the University of Warwick. We make recommendation and conclude that genAI represents a catalyst for innovation and assignments, perhaps adapted, should remain a core assessment in MSOR.
References
Attewell, S. Student perceptions of generative Al. Jisc report, 2024. Available at: https://edin.ac/3Y8Y2Cd. [Accessed 10 October 2024].
Chongchitnan, S. Parker, M. Mahal, M. and Petrie, S., 2024. Exploring the use of AI in mathematics and statistics assessments, Warwick International Higher Education Academy. Available at: https://warwick.ac.uk/fac/cross_fac/academy/funding/2023-24-int-projects/ai-in-maths/ [Accessed 10 October 2024].
Das, S.R., J.V. Madhusudan, J.V., Perceptions of higher education students towards ChatGPT usage. Int. J. Technol. Educ. 7(1) (2024) 86-106.
Huang, L., Yu, W., Ma, W., Zhong, W., Feng, Z., Wang, H., Chen, Q., Peng, W., Feng, X., Qin, B., and Liu, T., 2023. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions. ArXiv. Available at https://doi.org/10.48550/arXiv.2311.05232
OpenAI., 2022. Introducing ChatGPT. Available at https://openai.com/index/chatgpt/ [Accessed 25 September 2024]
Iannone, P. and Simpson, A., 2022. How we assess mathematics degrees: the summative assessment diet a decade on, Teaching Mathematics and its Applications: An International Journal of the IMA, Volume 41, Issue 1, March 2022, Pages 22–31, https://doi.org/10.1093/teamat/hrab007
Iannone, P. and Simpson, A. 2011. The summative assessment diet: how we assess in mathematics degrees. Teach. Math. Its Appl., 30, 186–196.
Iannone, P. and Simpson, A. (eds) 2012. Mapping University Mathematics Assessment Practices. Norwich: University of East Anglia.
Meyer, J. et al. 2024. Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback increases secondary students’ text revision, motivation, and positive emotions, Computers and Education: Artificial Intelligence, Volume 6, (2024), 100199.
QAA, 2023. Subject Benchmark Statement: Mathematics, Statistics and Operational Research. Available at https://www.qaa.ac.uk/docs/qaa/sbs/sbs-mathematics-statistics-and-operational-research-23.pdf?sfvrsn=5c71a881_12 [Accessed October 2024]
