{"id":666,"date":"2026-10-21T16:20:13","date_gmt":"2026-10-21T20:20:13","guid":{"rendered":"https:\/\/solutionsreview.com\/edtech\/?p=666"},"modified":"2026-10-21T16:20:21","modified_gmt":"2026-10-21T20:20:21","slug":"ai-in-education-whats-actually-improving-learning","status":"publish","type":"post","link":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/","title":{"rendered":"AI in Education: What’s Actually Improving Learning?"},"content":{"rendered":"
\n
\n

\"AI<\/p>\n

Michelle Marlowe, the Director of Education at Pocket Prep<\/a>, shares her insights into which aspects of AI in education are actually improving the learning experience for students. <\/strong><\/em>This article originally appeared in Insight Jam<\/a>, an enterprise IT community that enables human conversation on AI.<\/strong><\/em><\/p>\n

\"\"<\/a>As an educator of busy working professionals, I know learners often assume quick answers equate to learning and knowledge retention. AI’s speed in providing information makes it an appealing way to learn; however, it often harms the learning process and knowledge retention.<\/p>\n

At Pocket Prep, we help people prepare for certification exams that determine whether they get licensed, promoted, or hired, and most already use AI in some form. As the person responsible for ensuring our learners pass exams and<\/em> retain the knowledge they need to apply it in the field, I am always researching best practices for implementing AI in education. AI improves learning when it\u2019s designed to make the learner do the thinking, and it gets in the way when it does the thinking for them.<\/p>\n

What\u2019s Working: AI That Makes Learners Think<\/strong><\/h3>\n

Tennessee middle schools<\/u><\/a> followed more than 6,000 middle schoolers through computer-based math practice, and the students with an AI tutor worked more slowly and answered fewer questions than classmates using standard software. Based on output alone, the AI tutor appeared less productive; however, one week later, the AI group scored higher on a follow-up test. The biggest improvements came when the tutor used a mastery rule that required students to correctly answer three questions in a row after any mistake before they could proceed. In these findings, the AI tutor helped because it made students do more of the thinking themselves.<\/p>\n

That finding aligns with what learning science has shown for decades. Retrieval practice, spaced review, and desirable difficulties work because the effort of pulling something from memory makes it stick in a way that rereading or being handed the answer doesn\u2019t. Well-designed Socratic questioning also works by surfacing a learner\u2019s assumptions and asking them to reason forward instead of handing them the conclusion. When an AI tool is built to ask rather than tell, it strengthens the processes we already know produce learning. AI tutors can increase learning gains or lower scores, and it all depends on how educators design the tutor.<\/p>\n

What Isn\u2019t Working: AI That Hands Out Answers<\/strong><\/h3>\n

In a randomized trial at the University of Maryland<\/u><\/a>, nearly 2,400 undergraduate students took courses where some groups had access to a GPT-4o study assistant designed around the instructor\u2019s materials. In those groups, students earned lower final grades than classmates in the same course without the study assistant.<\/p>\n

In reviewing the student interactions with the AI study assistant, researchers found that nearly three out of four student requests asked the assistant for answers, information, or explanations; fewer than one percent asked for feedback on their work; and use of the tool spiked right before exams. The study assistant did have a guided tutoring mode option, but only two instructors turned it on, so nearly everyone used the default setting that gave direct answers, which students mistook as learning.<\/p>\n

RAND\u2019s August 2026 survey<\/u><\/a> found that about two-thirds of young people believe that relying on AI for schoolwork hurts critical thinking. However, knowing a shortcut hurts long-term learning has never been enough to stop someone who\u2019s tired and short on time, which is why the responsibility falls on educators to design effective AI tools.<\/p>\n

What we\u2019ve learned building a Socratic AI tutor<\/strong><\/h3>\n

Our learners are nurses, IT professionals, emergency medical providers, and people in dozens of other fields, and many of them have short windows of time to study. In those moments, an AI tool that simply explains why C is correct feels like learning, even when very little is being retained.<\/p>\n

That\u2019s why we built our AI Tutor around Socratic questioning. When a learner misses a question, the tutor doesn\u2019t lead with the explanation; it asks what led them to their answer, probes the assumption behind it, and nudges them toward the concept they\u2019re missing, so they can put the reasoning into their own words.<\/p>\n

In reviewing our learners\u2019 tutor logs, I found a learner studying for the CompTIA Network+ missed a question about which tool an attacker would most likely use, and after a few exchanges, they typed, \u201cOh, I get it.\u201d Many tools would end the conversation and the learning process there, but our tutor dug deeper and asked them to explain, in their own words, why the tool they\u2019d chosen wouldn\u2019t be an attacker\u2019s first choice. \u201cI get it\u201d tells us how a learner feels, while explaining it shows us what they actually understand. Putting an answer into your own words helps the knowledge stick, and it\u2019s what lets you recognize the same concept when it shows up in a different form on exam day.<\/p>\n

Educators must design AI tools with a limit on productive struggle. Questioning only works until it tips into frustration, and a good tutor has to recognize when a learner needs a stronger hint or simply the missing fact to keep reasoning. AI works best as a layer on top of retrieval practice and spaced review rather than a replacement for them.<\/p>\n

What to Consider Before Adopting or Creating an AI Learning Tool<\/strong><\/h3>\n

These questions will tell you a lot about whether an AI tool is designed to improve learning:<\/p>\n

    \n
  1. Does it ask before it tells?<\/strong> Watch what happens when a learner gets something wrong. If the first thing they see is a full explanation, the thinking has already been done for them.<\/li>\n
  2. Is it aligned to what the learner is actually tested on?<\/strong> A tutor can be accurate and still teach the wrong things, so ask how the content maps to the current exam blueprint or competency framework and how quickly it\u2019s updated when that changes.<\/li>\n
  3. What does it measure?<\/strong> Engagement and completion are easy to inflate, so ask whether the tool can show delayed retention or performance on new problems, not just activity.<\/li>\n
  4. What happens when the AI is wrong?<\/strong> Every generative tool makes mistakes, so ask how errors get caught, who reviews flagged responses, and how quickly fixes reach learners.<\/li>\n<\/ol>\n

    Learning is still the learner\u2019s work<\/strong><\/h3>\n

    So how is AI actually improving learning? When it\u2019s designed well, it does what effective teachers have always done: it asks questions, waits for the learner to answer, and gives just enough support for them to get there on their own. Whether the educator is a person or an AI, the job is the same: keep the learner thinking critically at every stage, from the first time they encounter a concept to the moment they need to recall and apply it. That means building AI tools around how people learn, not around how quickly they can get an answer. For those of us building in this space, the question that matters most isn\u2019t how much AI can do for learners, but how much it can help them do for themselves.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

    Michelle Marlowe, the Director of Education at Pocket Prep, shares her insights into which aspects of AI in education are actually improving the learning experience for students. This article originally appeared in Insight Jam, an enterprise IT community that enables human conversation on AI. As an educator of busy working professionals, I know learners often […]<\/p>\n","protected":false},"author":1517,"featured_media":668,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[14],"tags":[112,48,47],"acf":[],"yoast_head":"\nAI in Education: What's Actually Improving Learning?<\/title>\n<meta name=\"description\" content=\"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI in Education: What's Actually Improving Learning?\" \/>\n<meta property=\"og:description\" content=\"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"EdTech Platforms & Learning Management Systems | Solutions Review\" \/>\n<meta property=\"article:published_time\" content=\"2026-10-21T20:20:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-10-21T20:20:21+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Michelle Marlowe, PMP\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Michelle Marlowe, PMP\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/\",\"url\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/\",\"name\":\"AI in Education: What's Actually Improving Learning?\",\"isPartOf\":{\"@id\":\"https:\/\/solutionsreview.com\/edtech\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg\",\"datePublished\":\"2026-10-21T20:20:13+00:00\",\"dateModified\":\"2026-10-21T20:20:21+00:00\",\"author\":{\"@id\":\"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/9915cbfb1275b682d08adf58c7f5b518\"},\"description\":\"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.\",\"breadcrumb\":{\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage\",\"url\":\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg\",\"width\":800,\"height\":400,\"caption\":\"AI in Education What's Actually Improving Learning\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/solutionsreview.com\/edtech\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI in Education: What’s Actually Improving Learning?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/#website\",\"url\":\"https:\/\/solutionsreview.com\/edtech\/\",\"name\":\"EdTech Platforms & Learning Management Systems | Solutions Review\",\"description\":\"Evaluating Enterprise LMS Software, Virtual Classrooms & Educational Tech Tools.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/solutionsreview.com\/edtech\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/9915cbfb1275b682d08adf58c7f5b518\",\"name\":\"Michelle Marlowe, PMP\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/Michelle-Marlowe.jpg\",\"contentUrl\":\"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/Michelle-Marlowe.jpg\",\"caption\":\"Michelle Marlowe, PMP\"},\"description\":\"Michelle Marlowe is Director of Education at Pocket Prep, where she leads content strategy, governance, and learning-science-driven design for certification preparation across more than 155 certification exams. With over a decade in education and assessment, Marlowe writes on AI literacy, assessment validity, and how learning systems can protect critical thinking as generative AI reshapes the way knowledge is produced and accessed.\",\"sameAs\":[\"https:\/\/www.pocketprep.com\/\",\"https:\/\/www.linkedin.com\/in\/michellecmarlowe\"],\"url\":\"https:\/\/solutionsreview.com\/edtech\/author\/michellemarlowe\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI in Education: What's Actually Improving Learning?","description":"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/","og_locale":"en_US","og_type":"article","og_title":"AI in Education: What's Actually Improving Learning?","og_description":"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.","og_url":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/","og_site_name":"EdTech Platforms & Learning Management Systems | Solutions Review","article_published_time":"2026-10-21T20:20:13+00:00","article_modified_time":"2026-10-21T20:20:21+00:00","og_image":[{"width":800,"height":400,"url":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg","type":"image\/jpeg"}],"author":"Michelle Marlowe, PMP","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Michelle Marlowe, PMP","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/","url":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/","name":"AI in Education: What's Actually Improving Learning?","isPartOf":{"@id":"https:\/\/solutionsreview.com\/edtech\/#website"},"primaryImageOfPage":{"@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage"},"image":{"@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage"},"thumbnailUrl":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg","datePublished":"2026-10-21T20:20:13+00:00","dateModified":"2026-10-21T20:20:21+00:00","author":{"@id":"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/9915cbfb1275b682d08adf58c7f5b518"},"description":"Michelle Marlowe at Pocket Prep shares insights into which aspects of AI in education are improving the learning experience for students.","breadcrumb":{"@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#primaryimage","url":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg","contentUrl":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/AI-in-Education-Whats-Actually-Improving-Learning.jpeg","width":800,"height":400,"caption":"AI in Education What's Actually Improving Learning"},{"@type":"BreadcrumbList","@id":"https:\/\/solutionsreview.com\/edtech\/2026\/10\/21\/ai-in-education-whats-actually-improving-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/solutionsreview.com\/edtech\/"},{"@type":"ListItem","position":2,"name":"AI in Education: What’s Actually Improving Learning?"}]},{"@type":"WebSite","@id":"https:\/\/solutionsreview.com\/edtech\/#website","url":"https:\/\/solutionsreview.com\/edtech\/","name":"EdTech Platforms & Learning Management Systems | Solutions Review","description":"Evaluating Enterprise LMS Software, Virtual Classrooms & Educational Tech Tools.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/solutionsreview.com\/edtech\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/9915cbfb1275b682d08adf58c7f5b518","name":"Michelle Marlowe, PMP","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/solutionsreview.com\/edtech\/#\/schema\/person\/image\/","url":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/Michelle-Marlowe.jpg","contentUrl":"https:\/\/solutionsreview.com\/edtech\/files\/2026\/10\/Michelle-Marlowe.jpg","caption":"Michelle Marlowe, PMP"},"description":"Michelle Marlowe is Director of Education at Pocket Prep, where she leads content strategy, governance, and learning-science-driven design for certification preparation across more than 155 certification exams. With over a decade in education and assessment, Marlowe writes on AI literacy, assessment validity, and how learning systems can protect critical thinking as generative AI reshapes the way knowledge is produced and accessed.","sameAs":["https:\/\/www.pocketprep.com\/","https:\/\/www.linkedin.com\/in\/michellecmarlowe"],"url":"https:\/\/solutionsreview.com\/edtech\/author\/michellemarlowe\/"}]}},"_links":{"self":[{"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/posts\/666"}],"collection":[{"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/users\/1517"}],"replies":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/comments?post=666"}],"version-history":[{"count":0,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/posts\/666\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/media\/668"}],"wp:attachment":[{"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/media?parent=666"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/categories?post=666"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/solutionsreview.com\/edtech\/wp-json\/wp\/v2\/tags?post=666"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}