If you’ve been relying on ChatGPT or Claude to help you with your writing, a new study suggests the polished output you’re getting may be giving you false confidence. Research published in the Computers and Composition journal found that AI writing tools create a “fluency trap,” where refined, confident-sounding output masks shallow thinking and gives writers a false sense that the work is done.
Fluent doesn’t mean finished
Abram Anders, associate professor of English at Iowa State University, and co-author Emily Dux Speltz, assistant professor at the Department of Humanities and Communication at the Embry-Riddle Aeronautical University, followed 38 undergraduate students across two semesters in an experimental “AI and Writing” course. Students came in expecting AI to cut their workload, but it didn’t.
The research explains that the fluency trap sets in because AI produces text that reads as confident and clean, leading writers to trust it even when the content is wrong, shallow, or off-point. Many students initially treated AI like a search engine, entering a vague prompt and accepting whatever came back. Over time, they learned that effective prompting required planning, clarity, and rhetorical awareness, the same skills strong writers already use without AI.
“AI writes in confident sentences, uses the right tone and sounds smart,” Anders said. “But that polish can trick students into trusting it, even when it’s wrong, shallow, or missing the point entirely.”
What good AI-assisted writing actually looks like
The researchers identified three things writers need to understand before they can use AI effectively. First, working with AI requires genuine trial and error, not a single prompt and accept. Second, AI output still needs human judgment to check claims, refine logic, and match the expectations of a given context. Third, AI can generate text, but it cannot generate purpose. Only the writer can decide what the writing is arguing and why it exists.
Students who worked through those three thresholds stopped treating AI as a shortcut and started using it to test ideas, evaluate options, and sharpen their arguments. Anders and Dux Speltz describe this shift as moving from outsourcing your writing to orchestrating it.
“AI changes the workflow, but it doesn’t change the fact that writing is thinking,” Anders said. That distinction matters more as AI-generated text becomes harder to tell apart from the real thing.