Olaf Zawacki-Richter, Victoria I. Marín, Melissa Bond, Franziska Gouverneur
6 min
Artificial Intelligence in Education (AIEd) is an rapidly growing field, yet its integration into higher education remains poorly understood by educators. This systematic review analyzed 146 peer-reviewed articles published between 2007 and 2018 to map the current state of AI research, its disciplinary origins, and the nature of its applications.
The review reveals a significant imbalance in the field: 62% of the research originates from Computer Science and STEM departments, while only a small fraction comes from Education departments. This technical focus is reflected in the methodology, where 73% of empirical studies rely on quantitative methods, such as quasi-experimental designs, to evaluate AI tools. There is a notable absence of qualitative research and a striking lack of explicit pedagogical or psychological theory underpinning these technological interventions.
The authors synthesized the research into four primary categories of AI application within the student lifecycle:
A critical finding is the "stunningly low" level of critical reflection regarding the risks and ethical implications of AI. Issues such as data privacy, algorithmic bias, and the potential for educational surveillance are rarely addressed. The authors argue that the field is currently driven by what is technically possible rather than what is pedagogically sound. They call for a shift toward "ethics of care" and emphasize that AI should be used to augment, not replace, the essential human elements of teaching.
According to various international reports, Artificial Intelligence in Education (AIEd) is one of the currently emerging fields in educational technology. Whilst it has been around for about 30 years, it is still unclear for educators how to make pedagogical advantage of it on a broader scale, and how it can actually impact meaningfully on teaching and learning in higher education. This paper seeks to provide an overview of research on AI applications in higher education through a systematic review. Out of 2656 initially identified publications for the period between 2007 and 2018, 146 articles were included for final synthesis, according to explicit inclusion and exclusion criteria. The descriptive results show that most of the disciplines involved in AIEd papers come from Computer Science and STEM, and that quantitative methods were the most frequently used in empirical studies. The synthesis of results presents four areas of AIEd applications in academic support services, and institutional and administrative services: 1. profiling and prediction, 2. assessment and evaluation, 3. adaptive systems and personalisation, and 4. intelligent tutoring systems. The conclusions reflect on the almost lack of critical reflection of challenges and risks of AIEd, the weak connection to theoretical pedagogical perspectives, and the need for further exploration of ethical and educational approaches in the application of AIEd in higher education.
Alex: [measured, honest] The study concludes that the field is still in its infancy regarding critical reflection. If you want to see the full breakdown of their methodology, check out the link to the paper in our show notes.
Sam: [quick] We’ll be right back.
Alex: [measured, professional, clear] Despite thirty years of research, only 1.4 percent of academic studies on AI in higher education critically reflect on ethical risks. This comes from a systematic review by Olaf Zawacki-Richter and his colleagues.
Sam: [curious, analytical] That is a striking gap. If the literature ignores the ethical dimension, what are they focusing on instead?
Alex: [slower, deliberate] They prioritize technical optimization. The review shows that 73 percent of these studies rely on quantitative methods led by STEM researchers, focusing on predictive accuracy rather than pedagogical outcomes.
Sam: [leaning in, probing] So it is a technological supply-push. If an administrator deploys an early warning system to predict dropout, the model might flag someone based on an F1-score, but it lacks the pedagogical grounding to explain why that student is struggling.
Alex: [nodding, analytical] Exactly. It is a black-box optimization problem. Researchers are tuning the engine without asking if the car is heading toward a meaningful educational destination.
Sam: [thoughtful, connecting the dots] This creates a massive disconnect. If educators are absent from the research, the tools are likely to be ineffective or even stigmatizing.
Alex: [measured, confirming] That is the central tension. Only 9 percent of first authors had an education background. The field is dominated by disciplines that treat learning as a data-processing task rather than a social, human process.
Sam: [skeptical, pushing back] But how do they measure success if they aren't looking at pedagogy?
Alex: [precise, analytical] They measure success through classification rates and predictive performance. The primary metric is whether the system can correctly identify a student's status, not whether the intervention actually improves their learning.
Sam: [beat, then] So, the methodology is optimized for the algorithm, not the student. <break time="0.6s" /> If the system flags a student, the outreach is often automated and disconnected from the student's actual context.
Alex: [slower, for clarity] Precisely. Without integrating pedagogical theory, we risk deploying systems that act as if they are intelligent while failing to support actual learning.
Sam: [reflective] It sounds like we have sophisticated infrastructure, but very little understanding of how it fits into the classroom. Is there any sign that this is changing?
Alex: [measured, honest] The study concludes that the field is still in its infancy regarding critical reflection. If you want to see the full breakdown of their methodology, check out the link to the paper in our show notes.
Alex: [measured, professional, clear] Despite thirty years of research, only 1.4 percent of academic studies on AI in higher education critically reflect on ethical risks. This comes from a systematic review by Olaf Zawacki-Richter and his colleagues.
Sam: [curious, analytical] That is a striking gap. If the literature ignores the ethical dimension, what are they focusing on instead?
Alex: [slower, deliberate] They prioritize technical optimization. The review shows that 73 percent of these studies rely on quantitative methods led by STEM researchers, focusing on predictive accuracy rather than pedagogical outcomes.
Sam: [leaning in, probing] So it is a technological supply-push. If an administrator deploys an early warning system, it might flag someone based on an F1-score, but it lacks the pedagogical grounding to explain why that student is struggling.
Alex: [nodding, analytical] Exactly. It is a black-box optimization problem. Researchers are tuning the engine without asking if the car is heading toward a meaningful educational destination.
Sam: [thoughtful, connecting the dots] This creates a massive disconnect. If educators are absent from the research, the tools are likely to be ineffective or even stigmatizing.
Alex: [measured, confirming] That is the central tension. Only 9 percent of first authors had an education background. The field is dominated by disciplines that treat learning as a data-processing task rather than a social, human process.
Sam: [skeptical, pushing back] But how do they measure success?
Alex: [precise, analytical] They measure success through classification rates and predictive performance. The primary metric is whether the system can identify a student's status, not whether the intervention actually improves their learning.
Sam: [beat, then] So, the methodology is optimized for the algorithm, not the student. <break time="0.