HUMAN-IN-THE-LOOP AI COACHING IN ONLINE EDUCATION: COMBINING AUTOMATED FEEDBACK WITH HUMAN MENTORSHIP

Timofei Rogov

Abstract


This article examines the organization of feedback in online education under conditions of increasing enrollment and limited opportunities for individualized instructional support. The study focuses on the distinction between automated error detection and the pedagogical interpretation of learning outcomes. Automated feedback provides rapid and consistent analysis; however, its application is associated with the risks of standardized responses, interpretive inaccuracies, and a disconnect between error identification and meaningful revision. The analysis identifies a consistent pattern: the greatest improvements in learning occur not at the moment feedback is received but during its incorporation into an iterative cycle of revision and refinement. Based on these findings, the article proposes a Human-in-the-Loop model in which automated feedback and instructor mentoring are treated as interdependent components of a unified educational process. The model describes the transition from initial diagnosis to pedagogical interpretation, revision, and continuous adjustment of the learner’s educational trajectory. The practical significance of the study lies in clarifying the role of instructors within scalable online learning environments. The findings may be applied to the design of educational programs, the organization of mentoring practices, the development of feedback systems, and the preparation of instructors to work effectively with automated educational technologies.

Keywords


online education, automated feedback, mentoring, personalized learning, pedagogical interpretation, text revision

Full Text:

PDF

References


Alghamdi, L. H., & Alghizzi, T. M. (2025). Educators’ reflections on AI-automated feedback in higher education: A structured integrative review of potentials, pitfalls, and ethical dimensions. Frontiers in Education, 10, 1704820. https://doi.org/10.3389/feduc.2025.1704820

Alnemrat, A., Aldamen, H., Almashour, M., Al-Deaibes, M., & AlSharefeen, R. (2025). AI vs. teacher feedback on EFL argumentative writing: A quantitative study. Frontiers in Education, 10, 1614673. https://doi.org/10.3389/feduc.2025.1614673

Banihashem, S. K., Kerman, N. T., Noroozi, O., et al. (2024). Feedback sources in essay writing: Peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education, 21, 23. https://doi.org/10.1186/s41239-024-00455-4

Demszky, D., Hill, H. C., Taylor, E., Kupor, A., Varuvel Dennison, D., & Piech, C. (2025). Does increased choice over learning topics improve the effectiveness of automated feedback for educators? Education Sciences, 15(9), 1162. https://doi.org/10.3390/educsci15091162

Doyle, L., Nash, R. A., Jakcsiova, V., et al. (2025). ‘They want you to read their work’: Teachers’ and students’ perspectives on the use of AI for school feedback. Technology, Knowledge and Learning, 30, 1917–1941. https://doi.org/10.1007/s10758-025-09903-0

Fajardo-Ramos, D. C., Chiappe, A., & Mella-Norambuena, J. (2025). Human-in-the-loop assessment with AI: Implications for teacher education in Ibero-American universities. Frontiers in Education, 10, 1710992. https://doi.org/10.3389/feduc.2025.1710992

Farhood, H., Nyden, M., Beheshti, A., et al. (2025). Artificial intelligence-based personalised learning in education: A systematic literature review. Discover Artificial Intelligence, 5, 331. https://doi.org/10.1007/s44163-025-00598-x

Kestin, G., Miller, K., Klales, A., et al. (2025). AI tutoring outperforms in-class active learning: An RCT introducing a novel research-based design in an authentic educational setting. Scientific Reports, 15, 17458. https://doi.org/10.1038/s41598-025-97652-6

Kong, X., Fang, H., Chen, W., et al. (2025). Examining human–AI collaboration in hybrid intelligence learning environments: Insight from the Synergy Degree Model. Humanities and Social Sciences Communications, 12, 821. https://doi.org/10.1057/s41599-025-05097-z

Lan, M., & Zhou, X. (2025). A qualitative systematic review on AI empowered self-regulated learning in higher education. npj Science of Learning, 10, 21. https://doi.org/10.1038/s41539-025-00319-0

Navío-Inglés, M., Guzmán Mora, J., O’Connor-Jiménez, P., & García González, A. (2025). What’s next for feedback in writing instruction? Pre-service teachers’ perceptions of assessment practices and the role of generative AI. Education Sciences, 15(11), 1534. https://doi.org/10.3390/educsci15111534

Tran, T. T. T. (2025). Enhancing EFL writing revision practices: The impact of AI- and teacher-generated feedback and their sequences. Education Sciences, 15(2), 232. https://doi.org/10.3390/educsci15020232

Walter, Y. (2024). Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21, 15. https://doi.org/10.1186/s41239-024-00448-3

Wang, D. (2024). Teacher-versus AI-generated (Poe application) corrective feedback and language learners’ writing anxiety, complexity, fluency, and accuracy. The International Review of Research in Open and Distributed Learning, 25(3), 37–56. https://doi.org/10.19173/irrodl.v25i3.7646

Yusuf, H., Money, A., & Daylamani-Zad, D. (2025). Pedagogical AI conversational agents in higher education: A conceptual framework and survey of the state of the art. Educational Technology Research and Development, 73, 815–874. https://doi.org/10.1007/s11423-025-10447-4




DOI: http://dx.doi.org/10.46827/ejoe.v11i2.7079

Refbacks

  • There are currently no refbacks.


Copyright © 2016-2026. European Journal of Open Education and E-learning Studies (ISSN 2501-9120) is a registered trademark of Open Access Publishing Group. All rights reserved.

This journal is a serial publication uniquely identified by an International Standard Serial Number (ISSN) serial number certificate issued by Romanian National Library (Biblioteca Nationala a Romaniei). All the research works are uniquely identified by a CrossRef DOI digital object identifier supplied by indexing and repository platforms.

All the research works published on this journal are meeting the Open Access Publishing requirements and can be freely accessed, shared, modified, distributed and used in educational, commercial and non-commercial purposes under a Creative Commons Attribution 4.0 International License (CC BY 4.0).