Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Some experiments suggest that a carefully tailored AI conversation can reduce a person’s stated belief in a conspiracy theory. But the best-known result—an approximately 20% average reduction reported in a 2024 Science study—is now under formal journal evaluation after problems were found in its analysis pipeline and public dataset. It is an intriguing finding, not proof that chatbots reliably talk people out of conspiracy beliefs.

What did the 2024 AI chatbot study find?

In a 2024 Science study, Thomas H. Costello, Gordon Pennycook, and David G. Rand had 2,190 people who believed in a conspiracy theory discuss their own belief with GPT-4 Turbo. Rather than showing everyone the same fact sheet, the system used each participant’s stated theory and supporting rationale to conduct a personalized, evidence-based exchange. The paper’s abstract reports an average belief reduction of about 20%, effects still present at a two-month follow-up, and spillover to unrelated conspiracy beliefs and conspiracy-related behavioral intentions.

That 20% figure describes the study’s reported average reduction in belief strength; it does not mean 20% of participants changed their minds or stopped believing. MIT Sloan’s summary of the original study says the written exchange involved three rounds and took about eight minutes on average. It also reports that one quarter of participants moved below the study’s belief midpoint. These are figures from the original analysis, which is now under evaluation. MIT Sloan’s account

Why is the headline result now qualified?

On 11 June 2026, Science issued an Editorial Expression of Concern about the 2024 paper. The notice says the authors identified inconsistencies between the screening criteria described in the manuscript and those applied in the analysis pipeline. It also reports that a code-merging error introduced extraneous spliced rows into the public dataset, making some published values difficult to reproduce. The authors submitted a corrected analysis pipeline and updated results, which the journal says it is evaluating. Read the Science notice via AAAS

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The authors report that the corrected results preserve the original finding’s direction, statistical significance, and substantive size. That is the authors’ report, not a final confirmation by the journal. The notice is a formal caution during evaluation; it is not a retraction or a settled corrected result. Until the evaluation is resolved, describe the 2024 figures as reported findings rather than definitive estimates.

Do later studies also find that chatbots reduce conspiracy beliefs?

Later work offers additional evidence, but the studies differ in subject matter, chatbot approach, and how participants understood the conversation. Their results should not be collapsed into a single claim that “chatbots work.”

A health-related conspiracy experiment found an effect—and a framing difference

A 2026 Scientific Reports online experiment involved 554 U.S. and U.K. adults screened for negative COVID-19 vaccine attitudes. Participants discussed an individual COVID-19 conspiracy theory with an LLM. Compared with a control group, those told they were speaking with AI reported 7.88 percentage points less confidence after the intervention. The reduction was larger—13.76 percentage points compared with control—when participants were led to believe the same LLM was human. The authors associate this difference with perceived neutrality. Read the Scientific Reports study

This result complicates the idea that an AI label itself makes a conversation more persuasive. The experiment focused on a particular health topic and a screened sample, not all conspiracy theories or all users. Its human-label condition used deception, so the findings do not establish that people generally respond better to human interlocutors.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A reflective approach asks questions instead of leading with rebuttals

A Harvard Kennedy School Misinformation Review study tested reflection tasks and a chatbot instructed to act as a “street epistemologist.” Instead of simply presenting counterevidence, this approach asks people to examine the reasons and reservations behind a belief. The authors report average reductions in stated belief strength, but also differences in responsiveness: people with stronger general conspiratorial tendencies, and people who rated the accuracy of a particular belief as especially important, were less responsive. Read the Harvard Kennedy School Misinformation Review study

The authors flag an important risk: reflection may initially weaken true or well-supported beliefs, too. A persuasive technique is not automatically a reliable truth-finding technique; it can also be misused by someone who is mistaken or acting with harmful intent.

A 2026 political-violence study is preliminary

A 2026 arXiv preprint describes two U.S. experiments on conspiratorial views emerging around recent political violence. It reports lower conspiracy belief after multi-turn LLM conversations than after unrelated-chat or static-fact-sheet controls, along with later effects on other conspiracy beliefs. Because this is a preprint, it is preliminary research, not a peer-reviewed replication. Read the preprint

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What can—and can’t—these findings tell us?

Across the studies, the outcome is principally a change in participants’ self-reported belief or confidence under experimental conditions. Some work also measured follow-up belief or behavioral intentions. Those outcomes matter, but they are not the same as proving that a person abandoned a belief, changed real-world behavior, or will stay changed indefinitely.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • Personalization matters to the claim: the 2024 study tested dialogue tailored to participants’ own stated beliefs, not a generic chatbot answer.
  • Method and context differ: evidence-based rebuttal, reflective questioning, health beliefs, and political-event beliefs are distinct interventions and topics.
  • People respond differently: average shifts do not establish an effect for every participant, especially given the weaker responsiveness reported for some highly conspiratorial participants in the reflection study.
  • Accuracy is not guaranteed: these experiments do not show that general-purpose chatbots are consistently accurate, neutral, or safe when discussing conspiracy claims.

Should someone use a chatbot to evaluate a conspiracy claim?

A chatbot can be a starting point for examining a claim, but its fluency is not evidence that its answer is correct. Ask it to identify the claim’s specific, checkable parts and point to reliable sources; then verify those sources independently. Consider whether the same evidence supports the claim, whether important counterevidence is being omitted, and whether the system is distinguishing documented facts from speculation. These studies provide no guarantee that a consumer chatbot will do that reliably.

For researchers, the practical lesson is narrower: personalized or reflective dialogue may shift stated beliefs in some experimental settings, and the source’s framing can matter. For anyone trying to persuade another person, the findings do not justify treating a chatbot as a cure for conspiracy thinking or as a substitute for careful evidence and judgment.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.