What Happens Next

What Happens Next
Photo by Jukan Tateisi / Unsplash

There is a question no one in the AI-in-education debate is asking clearly: what happens to the brain that doesn't do the work?

Not the brain that uses AI badly, or irresponsibly, or without supervision. The brain that uses it exactly as intended. The student who gets the hint before the struggle, the summary before the reading, the answer before the reasoning has had a chance to form. What is being built in that brain, and what is not being built, and does it matter?

So far, the evidence shows it matters enormously. And the reason it matters has nothing to do with whether the outputs are accurate, or whether the child seems to be learning, or whether test scores hold. It has to do with what the brain is made of and how it is made.


What the Brain Requires

The brain is not a storage system. It is a construction project, and it builds itself from the inside out, across windows of time that close.

Myelination — the process by which neural pathways are insulated and stabilized — proceeds in sequence from birth through early adulthood. The pathways that get used during these windows are the ones that myelinate efficiently. The pathways that don't get used are pruned. This is not a deficiency in the architecture; it is the architecture. The brain constructs itself from the conditions it is placed in, and it produces an organism that is specifically adapted to those conditions.

This is what "adaptable" actually means. The brain adapts. It wires itself to the environment it repeatedly encounters. That capacity is remarkable and it is also not a safety net. Adapting to an environment where attention is constantly redirected before it can consolidate, where inference is provided before it can be attempted, where difficulty is smoothed away before it can do its work, well, that is not neutral adaptation. It is the construction of a specific kind of mind.

The developmental work that matters most is effortful. Reading builds reading circuitry not because text is inherently special but because decoding under effort, over time, produces the neural infrastructure that supports comprehension. Sustained attention develops through practice with things that resist easy resolution. Executive function – the capacity to plan, inhibit impulse, hold information in mind while acting on it – develops through experiences that require exactly that. None of this is automatic. All of it is built, during specific windows, under specific conditions, or it isn't built to the same degree.

The reassurance that AI will free children for "higher-order thinking" assumes that higher-order thinking is waiting somewhere, ready to emerge once the low-level work is handed off. It isn't. Higher-order thinking is downstream of the architecture that effortful low-level work builds. You cannot skip the construction and occupy the building.

"Adaptability" is the other common reassurance, and it is the more insidious one, because it sounds like neuroscience without being neuroscience. Children are adaptable: this is true. Adults are adaptable, too. It means the brain will wire itself to whatever it is repeatedly placed in. That is exactly what should concern us.


Who This Is For

The people building AI tutoring systems at scale are not, by and large, sending their children to schools that use them. This is not an accusation. It is a data point, and it is more informative than anything the vendors say in their procurement materials.

Waldorf and Montessori enrollment among families in the technology industry is well-documented and has been noted with some irony for over a decade. A 2011 New York Times investigation found that 75% of students at the Waldorf School of the Peninsula (a screen-free school in the heart of Silicon Valley) had parents employed in the technology industry, including the CTO of eBay and employees of Google, Apple, Yahoo, and Hewlett-Packard. The school's chief teaching tools were pens, paper, knitting needles, and occasionally mud. The pattern predates AI in classrooms; it was visible during the first wave of EdTech, and it has not meaningfully changed. The product is for other people's children. The decision-makers have, quietly and without announcement, revealed what they actually believe about the developmental environment they are selling.

This matters because the reassurances travel in one direction only. "Children are adaptable." "Technology will free them for higher-order thinking." These are offered to parents in school districts with procurement budgets and administrative pressure to modernize. They are not the reasoning used by the people making the product.

The equity argument compounds this. AI tutoring is frequently justified as a gap-closing intervention: personalized learning at scale for students who lack access to individualized attention. The evidence for this framing has not held up consistently. The Education Endowment Foundation's review found that EdTech can be a gap-widener, with average effects for disadvantaged pupils falling below the overall average. The children for whom the technology is most enthusiastically prescribed are the children with the least institutional protection from its risks.


What Is Not Being Built

The population-level consequences of this are not hypothetical. They are slow, which is why they are easy to ignore.

Attention is not a fixed trait. It is a capacity that develops, or doesn't, depending on whether the conditions for its development are met. The research on sustained attention in children is consistent: it improves through practice with tasks that demand it, and it is undermined by environments that reward rapid switching and provide external resolution before internal consolidation can occur. The attentional profiles now appearing in children at increasing rates — difficulty sustaining focus, low tolerance for effortful tasks, dependence on novelty — are consistent with what the developmental neuroscience literature would predict from the environments many children are spending most of their time in. This was true before AI entered classrooms. AI in classrooms is not a new problem; it is an intensification of an existing one, with a better marketing budget.

Executive function follows a similar arc. The prefrontal circuitry that supports planning, inhibition, and working memory is among the latest to mature (developing well into the mid-twenties) and it matures through exercise. Not through instruction about planning, but through actually having to plan. Through holding complexity in mind while acting on it. Through the experience of difficulty that doesn't resolve itself.

What we are building, at scale, is a generation with degraded capacity for exactly the cognitive work that is hardest to automate: reasoning under uncertainty, synthesis across domains, detection of error in confident-sounding outputs. The irony is precise. The students being trained to rely on AI for the work that builds reasoning capacity will be the adults responsible for overseeing AI systems — systems that require, above all else, the ability to follow an argument to its conclusion and notice when something is wrong.


What This Is Actually About

Causal reasoning is not incidental to human survival. It is the mechanism of it.

Tooby, DeVore, and Pinker describe humans as having evolved to fill what they call the cognitive niche: a mode of survival defined by manipulating the environment through cause-and-effect reasoning and social cooperation. Not physical specialization, speed or strength, but the capacity to model how things work, infer consequences, and improvise solutions to novel problems applied to local conditions, transmitted and built upon across generations. That is what accounts for the range and persistence of human adaptation.

The defensible version of this claim is not that evolution selected for reasoning in the abstract. It is that reasoning is what has accounted for human survival advantage — and that this architecture is expensive, slow to mature, and dependent on specific developmental conditions to form. It does not maintain itself across generations through inheritance alone. It is grown, one developing brain at a time, through the effortful engagement that produces it.

A person with that architecture uses AI better. They read outputs critically rather than accepting them. They catch errors because they have internalized what correct reasoning looks like. They know when a confident-sounding answer is wrong because they can follow the logic independently. The value of AI as a tool scales with the cognitive capacity of the person using it. Deploying AI as a replacement for the conditions that build that capacity is not acceleration. It is subtraction masquerading as addition.

The cognitive niche does not maintain itself. It is grown, one developing brain at a time, or it isn't.


This piece is a companion to Deployed Before Proven.


References

Tooby, J., DeVore, I., & Pinker, S. (2010). The cognitive niche. Proceedings of the National Academy of Sciences.

Suddendorf, T., & Corballis, M. C. (2007). The evolution of foresight: What is mental time travel, and is it unique to humans? Behavioral and Brain Sciences.

Richtel, M. (2011, October 22). A Silicon Valley school that doesn't compute. The New York Times.

Education Endowment Foundation. EdTech evidence review. https://educationendowmentfoundation.org.uk

Jen

Jen