Unlocking The Potential of Artificial Intellignce:
A New Paradigm for Assessment in 21st Century Education
DOI:
https://doi.org/10.33830/ijrse.v6i2.1698Keywords:
Artificial Intelligence, Educational Assessment, Systematic Review, Ethical Considerations, Adaptive Learning SystemsAbstract
This systematic review explores the transformative role of artificial intelligence (AI) in shaping assessment practices within 21st-century education. It critically examines the integration of AI technologies such as Automated Essay Scoring (AES), adaptive learning systems, and learning analytics, emphasizing their contributions to personalized learning experiences and real-time feedback mechanisms. The review identifies key opportunities for AI to enhance educational assessment, including the automation of scoring and the provision of adaptive feedback. However, it also addresses significant ethical challenges such as algorithmic bias, data privacy, and the need for transparency. We urge policymakers and educators to establish robust ethical guidelines and invest in comprehensive educator training to ensure the responsible use of AI in educational settings. The future directions suggest an increase in the integration of AI technologies, emphasizing the need for ongoing research to enhance validity, reliability, and address ethical considerations in AI-driven assessment practices.
References
Almond, R. G., Steinberg, L. S., & Mislevy, R. J. (2002). Enhancing the design and delivery of assessment systems: A four-process architecture. Journal of Technology, Learning, and Assessment, 1(1), 3-48. https://ejournals.bc.edu/index.php/jtla/article/view/1671
Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater® v.2. Journal of Technology, Learning, and Assessment, 4(3), 1-30. https://ejournals.bc.edu/index.php/jtla/article/view/1650
Baker, R., & Inventado, P. S. (2014). Educational data mining and learning analytics. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of Research on Educational Communications and Technology (pp. 551-560). Springer. https://doi.org/10.1017/CBO9781139519526.016
Black, P., & Wiliam, D. (1998). Inside the Black Box: Raising Standards Through Classroom Assessment. Phi Delta Kappan, 80(2), 139-148. https://sl.ut.ac.id/Inside-The-Black-Box
Chen, B., et al. (2019). AI-supported formative assessment: A review. Frontiers in Psychology, 10, 2812. https://ijcrt.org/papers/IJCRT2508377.pdf
Churi, B., et al. (2022). Intelligent Tutoring Systems: State-of-the-Art Research and Future Directions. IEEE Transactions on Learning Technologies, 15(1), 1-13. https://doi.org/10.1007/s12564-021-09697-7
Dikli, S. (2006). An overview of automated scoring of essays. The Journal of Technology, Learning and Assessment, 5(1), 1-36. https://ejournals.bc.edu/index.php/jtla/article/view/1640
Jones, E. F., et al. (2021). Artificial intelligence in educational assessment: Opportunities and challenges for equitable assessment. Educational Measurement: Issues and Practice, 40(4), 47-55. https://doi.org/10.1111/jcal.12577
Kaipa, S. C. (2021). Traditional assessment practices in education. Journal of Educational Assessment, 2(1), 45-58. https://www.sciencedirect.com/topics/social-sciences/traditional-assessment
Koretz, D. (2008). Measuring Up: What Educational Testing Really Tells Us. Harvard University Press. https://doi.org/10.2307/j.ctv1503gxj
Li, L., & Garcia, J. F. (2023). Ethical considerations in the use of artificial intelligence for educational assessment. Ethics and Information Technology, 25(1), 23-42. https://doi.org/10.7759/cureus.62443
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research & Perspectives, 1(1), 3-62. https://psycnet.apa.org/doi/10.1207/S15366359MEA0101_02
Park, S. W., & Lee, J. H. (2022). The effects of adaptive feedback on students' performance and motivation in online learning environments: A meta-analysis. Computers & Education, 176, 104385. https://doi.org/10.1007/s10639-024-12510-8
Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing What Students Know: The Science and Design of Educational Assessment. National Academies Press. https://doi.org/10.17226/10019
Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119-144. https://doi.org/10.1007/BF00117714
Shermis, M. D., & Hamner, B. (2012). Contrasting state-of-the-art automated scoring of essays: Analysis. In G. Attali & D. Powers (Eds.), Automated Scoring of Writing Quality (pp. 21-44). Routledge. https://sl.ut.ac.id/Contrasting-state-of-the-art-automated-scoring-of-essays
Shute, V. J. (2017). Evolution of assessment in education. In J. M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy (pp. 1-23). Springer. https://doi.org/10.1007/978-1-4614-3185-5_25
Shute, V. J., & Kim, Y. J. (2014). Formative and stealth assessment. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of Research on Educational Communications and Technology (pp. 311-321). Springer. https://link.springer.com/chapter/10.1007/978-1-4614-3185-5_25#citeas
Siemens, G., & Baker, R. S. J. d. (2012). Learning analytics and educational data mining: Towards communication. https://learninganalytics.upenn.edu/ryanbaker/LAKs%20reformatting%20v2.pdf
Smith, A. B., & Johnson, C. D. (2020). The role of artificial intelligence in educational assessment: Current perspectives and future potential. Educational Psychology Review, 32(4), 875-892. https://doi.org/10.1109/ICISCT52966.2021.9670009
van der Kleij, F. M., Feskens, R. C. W., & Eggen, T. J. H. M. (2015). Effects of feedback in a computer-based learning environment on students' learning outcomes: A meta-analysis. Review of Educational Research, 85(4), 475-511. https://psycnet.apa.org/doi/10.3102/0034654314564881
vanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197-221. https://doi.org/10.1080/00461520.2011.611369
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Isaac Ogunsakin

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Content Licensing, Copyright, and Permissions
1. License
International Journal of Research in STEM Education (IJRSE) adopts the Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0) as the optimal license for the publication, distribution, use, and reuse of scholarly works for non-commercial purposes.
The non-commercial use of the article will be governed by this license, which allows others to share and adapt the work provided proper attribution is given to the author(s) and the journal.
Creative Commons Attribution-NonCommercial 4.0 International License.
Creative Commons License: CC BY-NC 4.0
2. Author's Warranties
The author warrants that the article is original, written by the stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright vested exclusively in the author, is free of any third-party rights, and that all necessary written permissions to quote from other sources have been obtained by the author(s).
3. User Rights
The International Journal of Research in STEM Education aims to disseminate published articles as freely as possible. Under the Creative Commons license, users are permitted to copy, distribute, display, and perform the work for non-commercial purposes only, provided that proper attribution is given to the author(s) and this journal.
4. Rights of Authors
Authors retain the following rights:
- Copyright and proprietary rights related to the article, such as patent rights.
- The right to use the substance of the article in future works (e.g., lectures, books).
- The right to reproduce the article for personal purposes.
- The right to self-archive the article.
- The right to enter into separate, additional non-exclusive contractual arrangements for the distribution of the article’s published version (e.g., posting to an institutional repository or publishing it in a book), with acknowledgment of its initial publication in IJRSE.
If the author has a non-exclusive publishing contract with another publisher under a more restrictive license, the author still retains all rights to republish or distribute the work elsewhere, including commercially, as the author is not bound by the license conditions imposed on the journal.
5. Co-Authorship
If the article has multiple authors, the signatory of this agreement warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf and agrees to inform all co-authors of the terms of this agreement.
6. Termination
This agreement may be terminated by either the author or IJRSE with two months’ notice if the other party has materially breached this agreement and failed to remedy such breach within one month after receiving written notice.
No breach or violation of this agreement will cause automatic termination or affect the license granted to IJRSE.
7. Royalties
This agreement entitles the author to no royalties or other fees. To the extent legally permissible, the author waives the right to collect royalties in respect of any use of the article by IJRSE or its sublicensees.
8. Miscellaneous
IJRSE will publish the article (or have it published) once the editorial process has been successfully completed.
The journal reserves the right to edit the article for style, punctuation, spelling, capitalization, referencing, and consistency as deemed appropriate.
The author acknowledges that the article will be made publicly accessible, and such access will be free of charge for readers.






