Metacognitive Monitoring in AI Contexts

What This Skill Does

Analyses how AI tool use in a specific learning context might distort students' metacognitive monitoring — their ability to accurately assess what they know and don't know — and designs interventions to maintain metacognitive accuracy. This is one of the most urgent challenges in AI-enabled education. When a student uses an AI tool to complete work, they may experience a fluency illusion: the work looks good, the answers are correct, the text is fluent — and the student concludes "I understand this." But the STUDENT didn't do the cognitive work; the AI did. The student's sense of understanding is calibrated to the PRODUCT (which is good) rather than to their OWN knowledge (which may be unchanged). Bjork et al. (2013) showed that learners are systematically poor at judging their own learning — they confuse familiarity with understanding, and fluent performance with durable knowledge. AI tools dramatically amplify this miscalibration because they produce fluent, correct output that the student may mistake for evidence of their own competence. The output includes a metacognitive diagnosis (how AI use distorts self-assessment in this specific context), monitoring interventions (strategies to improve metacognitive accuracy), AI usage guidelines (when to use and when to restrict AI), and assessment alignment (ensuring tests measure student knowledge, not AI-assisted performance).

Evidence Foundation

Winne & Hadwin (1998) developed the most comprehensive model of self-regulated learning (SRL), which places metacognitive monitoring at its centre. Their model describes a cycle: the learner sets goals, applies strategies, monitors whether the strategies are working, and adjusts. Effective learning depends critically on the MONITORING stage — the learner's ability to accurately judge whether they are understanding the material. When monitoring is inaccurate (the learner thinks they understand when they don't), the entire self-regulation cycle breaks down: they stop studying too early, choose inappropriate strategies, and are surprised by poor assessment results. Thiede et al. (2003) showed that metacomprehension accuracy (the correlation between judged and actual understanding) is typically very low — around r = 0.27. However, they found that certain activities dramatically improve accuracy: delayed summary writing, keyword generation, and any task that forces the learner to generate from memory rather than recognise from the text. The key principle: metacognitive accuracy improves when the monitoring task requires RETRIEVAL, not just recognition. Dunning et al. (2003) documented the Dunning-Kruger effect: the least competent individuals are the MOST overconfident in their abilities, because they lack the knowledge needed to recognise their own incompetence. In AI contexts, this effect may be amplified: a student who doesn't understand a concept cannot distinguish their own (poor) understanding from the AI's (excellent) output. Bjork et al. (2013) reviewed the psychology of self-regulated learning and identified several "illusions of competence" — conditions where learners feel they've learned more than they actually have. These include: familiarity (having seen something before feels like understanding it), fluency (material that's easy to process feels like it's well-learned), and performance (doing well now feels like permanent learning). AI tools can trigger all three illusions simultaneously: the AI-produced output is familiar (the student saw it being generated), fluent (LLMs produce polished text), and high-performing (the answers are correct). Kazemitabaar et al. (2023) studied how AI code generators (like Copilot) affect novice programming learners and found that while AI-assisted students completed tasks faster and with fewer errors, they showed weaker understanding on subsequent tasks without AI support. The students had learned to use the AI, not to program. This is a direct empirical demonstration of the metacognitive risk: AI assistance produced the ILLUSION of learning without the REALITY of learning.

Input Schema

The teacher must provide:

• AI learning context: How students are using AI. e.g. "Year 12 students use ChatGPT to help write A-level English Literature essays. They paste in essay questions and use the AI output as a starting point, then edit and refine" / "Year 9 students use an AI maths tutor that solves equations step-by-step when they get stuck. They can ask for help at any point" / "Year 10 students use AI to generate revision notes from their textbook, then study from the AI-generated notes"
• Metacognitive risk: The specific concern. e.g. "Students believe they 'understand' the literary analysis because the essay looks good, but when asked to discuss the text in class without AI, they can't articulate the argument" / "Students believe they 'can solve equations' because they get correct answers with AI help, but fail when the AI isn't available" / "Students believe they 'know' the content because they read well-organised AI revision notes, but the reading produced familiarity, not understanding"

Optional (injected by context engine if available):

• Student level: Year group and proficiency
• Subject area: The curriculum subject