JOURNAL / LEARNING & AI

Does AI help
you learn?

It can make the exercise easier while you use it. The harder test is what you can still explain, remember, and do after the assistant is gone.

A student studies at a library table with a laptop, open book, and notes.LEARNING / PRACTICE & RETENTION / SYMPLOKA
THE ANSWER IS NOT THE OUTCOME

Measure what stays with the learner.

A useful tutor does more than produce a clear explanation. It helps a person build understanding they can use on their own.

01 / TWO DIFFERENT RESULTS

Finishing with help is not the same as learning.

An AI assistant can help someone complete a problem, draft an explanation, or find a fact. That is performance with support. Learning is a change that remains when the support is removed: the learner can recall an idea, explain why it works, and apply it to a new problem.

Both outcomes can matter. A professional looking up a procedure may value immediate support; a student learning algebra needs to solve the next problem independently. The same assistant can be useful for one goal and counterproductive for another. Start by naming the goal, then choose how the system should help.

Help me finishGive me an answer, summary, or worked example. Useful for access and speed when independent mastery is not the goal.
Help me learnAsk what I tried, find the gap, give a hint, and let me do the reasoning. Check later whether I can do it without assistance.

A quick quiz after closing the chat is more informative than how confident or productive the conversation felt.

02 / WHAT THE EXPERIMENTS FOUND

The results change when the tutor changes.

There is no single “AI tutor” intervention. Studies test different ages, subjects, tools, lesson designs, and outcomes. Several recent controlled studies make that variation visible.

High-school mathematics / direct answers vs. hintsA 2025 field experiment with nearly 1,000 students at a Turkish high school compared unrestricted GPT-4 access, a version prompted to provide hints using teacher-prepared solutions, and a no-AI group. Both AI groups performed better during supported practice. On a later exam without AI, the unrestricted group scored 17% lower than the control group; the safeguarded tutor group was statistically indistinguishable from control. Students’ own impressions did not reveal the drop. This is evidence about a specific math setting and short intervention, not every age or subject.Read the PNAS field experiment ↗
Middle-school mathematics / access and engagementA two-year cluster-randomized study in 18 Tennessee schools tested Khanmigo configured to coach rather than give answers during existing remedial math sessions. Assignment raised achievement by about 0.06–0.08 standard deviations over a school year, similar to Khan Academy practice without AI. Students often used the tutor briefly: the median student messaged it on only a third of practice days, and seldom when stuck. Access alone did not create sustained tutoring.Read the NBER study summary ↗
University courses / an assistant added to the LMSA 2026 working paper followed 2,379 undergraduates across 30 instructors. In its same-course comparison (1,353 students), assignment to a course-integrated AI assistant was associated with final grades 4.12 points lower (0.37 standard deviations) and learning-platform participation 0.90 standard deviations lower. The full-sample academic result was not statistically significant. Only about 15% of students offered the tool used it at least once. The randomized estimate is about offering the assistant as deployed in those courses; it does not isolate the effect of sustained, well-designed tutoring.Read the University of Maryland working paper ↗
Secondary-school science / curriculum-aligned practiceA four-week randomized evaluation of the Medly platform compared guided revision with usual self-study across Biology, Chemistry, and Physics in England. The authors report higher post-test scores for students assigned to Medly (Hedges’ g = 0.33). It is a promising early result, but 30.7% of baseline participants did not complete the post-test, the assessments were aligned to the taught curriculum rather than standardized, and the authors describe the findings as preliminary.Read the 2026 preprint ↗

These findings are not votes on whether AI is good or bad for education. They show why the intervention, level of guidance, existing course, participation, and test design belong in the headline alongside the result.

03 / WHAT THE DESIGN CHANGES

Structure matters more than a humanlike interface.

In a small preregistered 2026 experiment in one online MBA finance course, researchers compared a tutor grounded in course materials with a holdout where students could use consumer AI. They report 6.63 points more learning in the structured-tutor group, with the gain concentrated in written reasoning. Within that group, voice nearly doubled conversation and cost 2.8 times as much to deliver, but the study found no learning advantage over text. The sample was small—86 students entered the study and 51 completed both assessment waves—and the paper is a working preprint. It is a useful signal about design, not a settled comparison of voice and text for every learner.

The practical lesson is not to add more conversational polish. It is to make the learning move explicit: diagnose the misconception, ask the learner to retrieve or apply an idea, give feedback on their attempt, and leave room for independent work. A simple interface can support that well; a friendly voice can still give away the answer.

Read When AI Tutors Speak ↗, a preregistered field experiment, and compare it with the open data and code for the PNAS mathematics study ↗.

04 / A LEARNING-FIRST STUDY LOOP

Use the assistant to keep your thinking in motion.

  1. Try first. Write down what you understand and where you are stuck before opening the chat. This gives the tutor something real to respond to.
  2. Ask for one hint. Try: “I’m learning this, so don’t give me the answer. Ask what I’ve tried, then give one small hint at a time and wait for my next step.”
  3. Do the work yourself. Solve the next step, explain your reasoning, or recall the idea from memory before asking for more help.
  4. Request feedback on your attempt. Ask the system to point out the first questionable step, explain why it might fail, and suggest a way to check it. Verify factual claims against course materials or another reliable source.
  5. Test without the assistant. Close the conversation. Explain the concept in your own words, then try a new example without hints. A changed number or setting can reveal whether you learned a method or memorized an answer.
  6. Return later. Retry the idea after a delay. If it only makes sense while the chat is open, treat that as a signal to practice again.

For brainstorming, translation, or a quick overview, a direct answer may be exactly what you need. For learning a skill, use the system in a way that asks you to produce and check the reasoning yourself.

05 / FOR TEACHERS AND COURSE DESIGNERS

Integrate the tool into the lesson, not just the login page.

An assistant can displace the practice, help-seeking, or teacher feedback that a course already relies on. Before adding one, decide what learners should be able to do without it. Then give the tool a bounded role: for example, offer a hint after a student submits an attempt, ask a diagnostic question before explaining, or generate new practice questions from teacher-approved material.

Measure independent learningUse an assessment without the assistant and include a new problem, not only completion or satisfaction during use.
Watch what the tool replacesTrack whether learners still read, attempt problems, ask a teacher, and participate in the course.
Make its teaching role explicitSet whether it may answer directly, when it should ask for an attempt, and what source material it may use.
Check who benefitsReview uptake, access, privacy, error patterns, and outcomes across learner groups. Do not assume an optional tool reaches everyone equally.

OECD’s PISA 2025 analysis found that the relationship between student AI use and science performance varies by purpose and frequency. Because this part of PISA relies on reported behavior rather than random assignment, those patterns describe associations; they do not establish that AI use caused a score change.

Read the OECD PISA 2025 analysis ↗
06 / QUICK ANSWERS

Ask what the learner can do next.

Does AI help with homework?It can explain, suggest, or check work. Whether that supports learning depends on the goal and whether the learner still practices the underlying skill.
Are AI tutors better than teachers?Current studies do not support one universal ranking. Some test AI as a standalone tutor; others test it inside teacher-led lessons. Those are different tools and different questions.
Is voice mode better for learning?One small 2026 finance-course preprint found more interaction with voice but no measured learning advantage over text. More conversation does not automatically mean more understanding.
How can I use AI without copying?Attempt the task first, ask for a hint or critique, produce the answer yourself, check the explanation, and disclose assistance when your class or workplace requires it.
RESEARCH & PRIMARY SOURCESBastani et al., Generative AI without guardrails can harm learning, PNAS (2025) ↗Open data and code for the PNAS study ↗Oreopoulos & Low, One Click Away: AI Tutoring with Khanmigo, NBER Working Paper 35620 (2026) ↗Liu et al., Course-integrated AI tutoring, EdWorkingPaper (2026) ↗Harrison et al., Evaluating AI tutoring in GCSE science, arXiv:2609.14789 (2026) ↗Yang et al., When AI Tutors Speak, arXiv:2609.23958 (2026) ↗OECD, PISA 2025 Results, student school life and AI use ↗