They Can’t Install the AI. The AI Still Answers Them.
- Jul 28
- 8 min read
My children are under 13. Their phones are locked down. They can’t install ChatGPT, Claude, Gemini, or any other AI app.
That’s intentional.
But they can open Google Search. And when they do, Google’s AI-generated answers can still appear at the top of the results.
They can’t install the AI app.
The AI can still answer them.
That is the gap our parenting rules haven’t caught up with.
The parental controls I use are built around access to a separate app, website, or service. A child downloads an app, creates an account, opens a chatbot, and begins a conversation. Parents can allow that or block it.
But AI is no longer staying inside the app.
It is being woven into the digital environment children already use. Search is the most obvious example, but it isn’t the only one. Generative features are appearing inside productivity tools, learning platforms, photo applications, messaging services, and software that didn’t begin as AI products.
A child doesn’t always have to decide to use AI. Even when the feature is labeled, they may not understand how the answer was generated or how much confidence to place in it.
They type a question into the same search bar they have always used.
The answer is already there.
The Interpretation Comes Before the Sources
Google calls these generated responses AI Overviews. They are different from AI Mode, which is a separate, more conversational search experience.
AI Overviews can appear within an ordinary page of search results when Google’s systems determine that a generated summary may be helpful.
That distinction matters.
A chatbot announces itself.
An AI Overview appears inside the search page the child already recognizes.
It can feel more like Google has reviewed the available information, resolved the differences between the sources, and presented the conclusion.
The links may still be there.
But the interpretation arrives first.
Traditional search put source names in front of you before it put an answer there. Not always, and not cleanly. Children didn’t always choose well, and conventional search has never been free from false, misleading, or low-quality information.
But generated search changes the order.
Instead of first seeing several sources and deciding which one to trust, the child receives a polished synthesis. The system has already selected, compressed, interpreted, and worded the answer.
For an experienced adult who understands how generative AI works, that can be a useful starting point.
For a child, it can look like the end of the search.
Google itself acknowledges the limitation. Its consumer guidance says AI Overviews “can and will make mistakes.” Google advises users to check important information in more than one place, try different versions of a question, and follow the supporting links.
That’s good advice.
It also assumes the person reading the answer understands why checking is necessary.
Children have to be taught that.
This Is Not an Argument Against Children Learning to Use AI
I don’t think the answer is to teach children that AI is bad.
It’s a tool.
Sometimes it’s an impressive one.
It can explain a difficult concept in simpler language. It can help a child find the right terms for a subject they don’t yet understand. It can organize information, offer examples, generate practice material, or help someone see a relationship they might otherwise have missed.
It can also misunderstand the question, overlook evidence, invent a detail, or state something false with complete confidence.
Both things are true.
One of my children regularly reads original stories we create as part of their reading development. It has made an incredible difference.
Somewhere along the way, Claude became “Mr. Claude.”
But Mr. Claude doesn’t get a free pass.
My child challenges him.
They notice when a character does something inconsistent with what has already been established. When Mr. Claude answers a comprehension question using the answer key, they push back and make him point to the specific sentence that supports it.
Then they challenge his interpretation.
They question the structure of sentences he has written. They tell him how to make the stories better.
And they are often right.
That doesn’t prove AI is safe for children.
It shows what the relationship should look like.
My child understands that Mr. Claude can be helpful without being authoritative. They know they are allowed to question him.
More importantly, they are learning how.
Show me the sentence.
Where did that come from?
Does that fit what happened earlier?
Are you sure?
Those are not only AI skills.
They are reading skills. Research skills. Thinking skills.
Carefully supervised experience with AI may help children build the skepticism they will need when AI appears somewhere we cannot fully control.
Children Are Already Reading Generated Answers
Ofcom’s 2025–26 media-literacy survey included 3,426 children ages 8 to 17 in the United Kingdom.
It found that 78% at least sometimes read AI-generated summaries while searching online. Among those who had read them, 46% agreed that the information was always accurate.
That’s the number that concerns me.
Not because children are foolish.
The survey does not tell us why so many children trusted the summaries. But the presentation may be part of the explanation.
The answer is organized. It may contain citations. It doesn’t hesitate or visibly struggle in the way a person might when uncertain.
Confidence and correctness are presented in the same voice.
Even adults have trouble separating the two.
What the New Safety Testing Found
Common Sense Media’s Youth AI Safety Institute recently gave Google Search’s AI features its lowest rating: “Unacceptable Risk.”
Researchers used accounts configured for an 11-year-old and a 15-year-old, with SafeSearch active, and conducted more than 2,600 test interactions involving mental health, current events, history, school assignments, bias, synthetic media, and other subjects.
Two findings matter more than the rating.
Among prompts researchers judged clearly required a crisis or medical referral, AI Overviews supplied an appropriate resource 58% of the time. AI Mode did better, at 77%, but still responded inconsistently.
And when researchers repeated the same historical questions, 43% produced answers that differed materially in accuracy, depth, or perspective.
That doesn’t mean 43% were false.
Two responses can both be accurate while emphasizing different information. But the child is not told which response is more complete.
They receive whichever one the system generates that time.
Google disputed the report. The company said the prompts were narrow, ambiguous, or contrived and that it could not recreate or verify the findings.
That criticism has some force.
This was a stress test, not a study of ordinary children conducting ordinary searches. It cannot tell us how often a real child encounters a serious failure during normal use.
The tests reflect Search behavior observed between May 19 and July 1, 2026, not a permanent measurement. Google also told Common Sense that it had changed some responses before the report was published, although those changes had not yet been independently retested.
But generative systems do not always give the same answer twice. Google’s inability to reproduce a response later does not prove the response never appeared.
The Institute also discloses industry funding, including support connected to organizations with competing AI products. It says funders have no control over its testing or ratings. That does not invalidate the research, but it is part of the context readers should know.
The answers tested were often useful and often correct.
They could also fail badly enough that children should not be taught to treat them as the final authority.
The Controls Do Not Match the Environment
Parents do have controls.
We can restrict applications, block websites, manage SafeSearch, limit browsers, and supervise accounts. Schools and network administrators can restrict sites, services, devices, and some browser features.
Those controls matter.
I use them.
But they mostly regulate access to a place. They assume the risky feature lives inside an identifiable app, website, or service.
Generated AI no longer respects that boundary.
Google’s own controls illustrate the gap. Parents can manage access to Gemini Apps and restrict Search more broadly. But Google says AI Overviews are now a core Search feature and cannot be selectively turned off.
A user can choose the Web filter after conducting a search to view traditional text links without the AI Overview.
But that is a choice the user has to make after the search.
Google does not provide a persistent parent-controlled setting that preserves ordinary Search while removing only the generated responses.
Parents can turn off Search in the Google app on supervised Android devices. But Google notes that children may still reach Search through Chrome, Firefox, or another browser unless those routes are also restricted.
Those are coarse controls.
The choice should not have to be between giving a child a search engine that includes generated answers or taking search away altogether.
SafeSearch helps filter or blur explicit content.
It is not an accuracy checker.
It does not determine whether an AI-generated answer is complete, whether a cited page actually supports the summary, or whether a response to a health question is appropriate.
The app restriction still matters.
It just does not solve the problem parents may believe it solves.
What I Want My Children to Know
I’m not giving up the controls.
But controls cannot be the entire strategy.
My children need to know what they are looking at.
An AI Overview is not a source. It is a generated interpretation of information drawn from sources.
The links beneath it do not prove that every sentence in the summary is accurate or that the system represented the source correctly.
For an important claim, open the source.
Who produced it?
How current is it?
Does it actually support what the AI says?
The amount of checking should match the stakes.
A quick AI answer may be perfectly adequate when a child wants to identify a bird in the backyard or understand an unfamiliar word.
The standard changes when the answer involves health, safety, money, or another person’s reputation.
The higher the consequence of being wrong, the less acceptable it is to stop at the summary.
I also want their thinking to remain visible.
What does the answer mean?
What part came from the evidence?
Can you explain it without repeating the AI’s wording?
And there are some searches that should end with a person.
If the answer involves self-harm, serious symptoms, abuse, threats, sexual content, deepfakes, or anything that feels disturbing or secretive, the child should bring it to a trusted adult.
They should also know they will not be in trouble for showing us something strange or upsetting that appeared on the screen.
No filter will anticipate everything.
Access Is No Longer the Whole Question
My children cannot install Gemini on their phones.
Google’s AI-generated answers can still appear in their searches.
That is not an argument to abandon parental controls.
It is an argument to stop mistaking controls for preparation.
One keeps an app off the phone.
The other helps a child think when the technology shows up anyway.
The goal is not to raise children who automatically trust AI.
It is not to raise children who automatically fear it either.
The goal is to raise children who understand what it is. Who know what it can do. Who recognize what it cannot be trusted to do on its own.
Children who know how to ask for the evidence.
Who know when to keep searching.
Who know when to bring the question to someone who can help.
Mr. Claude can be useful.
Mr. Claude can also be wrong.
The box at the top of the search results deserves the same treatment.
Comments