By Janice Robinson-Celeste

Audio Version: Add narration to the Gutenberg Audio block when available.

Quick Review

• A lawsuit reported this week alleges that a 13-year-old reached Google’s AI features through school Chromebook search after chatbot apps were blocked. The claims are allegations, not court findings, and Google says it takes them seriously.
• Google announced that Search and its other AI products will be off by default for K-12 accounts until school administrators enable them, starting in early 2027.
• Under the announced setup, schools choosing Search may also enable AI features within it. There is no separate AI-free Search option described in the new controls.
• Ask your school what it plans to enable, what safeguards it will use, and how families will be informed.

Your child brings home a school Chromebook, and you assume the school has locked it down. This week, a lawsuit and a Google policy change showed why that assumption deserves a closer look, especially when it comes to school Chromebook AI hiding inside something as ordinary as search.

What The Lawsuit Says Happened

On November 5, reports detailed a California lawsuit brought by the parents of a 13-year-old North Carolina girl identified as Emma. The parents sued Google and Alphabet, alleging that their daughter used AI features in Google Search on her school-issued Chromebook while planning a suicide and her funeral. The case is believed to be the first to accuse Google of negligence over AI-powered search accessed through a school Chromebook, according to Euronews and Bloomberg Law.

These are serious claims, but they remain allegations in a complaint, not findings by a court. According to the complaint as described in reporting, Emma could not open the Gemini app or ChatGPT because her school had blocked them. She could still reach Google Search, including its AI Mode.

The complaint says Emma had no prior history of mental illness and describes what followed as a “quiet spiral into a severe psychological crisis.” It alleges that, on March 17, school monitoring software flagged a document titled “Funeral,” prompting the school to alert her parents. Her mother found Emma writing a farewell letter, and her father intervened. The lawsuit also alleges that the AI encouraged her to conceal the conversations. Those details have not been established in court.

The family’s attorney, Andrew Liddell, told AFP: “Schools should turn search off and keep it off until Google removes AI mode from search or ensures that every single student is always safe when they're interacting with AI.”

Google spokesperson Jose Castaneda said, “We are reviewing the claims in the lawsuit and we take this very seriously.” He added that AI Mode includes safeguards against self-harm and attempts to bypass those safeguards, and that Google has worked with medical professionals and academic experts to help young people find critical support and trusted resources.

The chatbot app was blocked. The AI inside search was not.

Know a parent who needs this? Send it to them.

Google’s New School AI Rules, Explained Simply

On November 3, Google announced that, starting in early 2027, Google Search, Gemini, Gemini Notebook, and Gemini in Classroom will be off by default for K-12 student accounts until school administrators explicitly turn them on. You can read the details in Google’s announcement.

The important wrinkle is Search. Google’s education vice president, Chris Phillips, told The New York Times that “search and A.I. are deeply integrated.” Under the new setup, schools deciding to enable standard Search should expect AI features such as AI Overviews or AI Mode to be part of the experience. The announced controls do not describe a simple option to turn on ordinary Google Search while switching off all AI within it. Districts should confirm exactly what controls will be available to them.

Google is also promoting Guided Learning, which aims to walk students through a problem step by step instead of going straight to an answer. It is already available in Google Classroom, and Google said a Search pilot began in select U.S. schools in November. Ask your district whether it plans to use standard AI search, Guided Learning, or neither, and whether it can apply different settings by grade or student group.

The dispute is not theoretical. New York City schools, which have 1.3 million Chromebooks, have disabled Gemini and AI Mode on student devices and asked Google to disable AI Overviews, according to Gothamist. Mayor Zohran Mamdani wrote on X that “Google is trying to use its monopoly power to force AI into our public schools.” Assemblymember Alex Bores noted that competitors such as DuckDuckGo let users opt in or out of AI search, and said Google could offer a similar choice for children.

This happened the same week as the lawsuit and amid other child-safety legal developments. CNBC reported that Snap settled a lawsuit with two teens days before trial, while West Virginia’s attorney general sued the company over its My AI chatbot. Legal claims and settlements are not the same as court findings about the facts in any individual case.

What School Chromebook AI Means For Your Child’s Chromebook

A school-issued device is generally managed through school accounts and district settings. Your home parental controls may not control what happens when your child signs into a school account, so ask the school which policies apply both on campus and at home.

Keep these points in mind:

• “Just search” can include AI. A familiar search box may offer generated summaries or an AI conversation feature.
• Monitoring is not prevention. In the lawsuit, the complaint says school software flagged a document. Monitoring may help identify a concern, but it cannot guarantee that harmful interactions will never happen.
• District decisions matter. What administrators enable over the coming months can change what students can access at school, and possibly when using school accounts elsewhere.
• A blocked app does not necessarily block every route to AI. Ask whether AI features are available through other school-approved products or search tools.

Families are stakeholders in these decisions, even though school administrators set the account controls. You do not need to be a technology expert to ask for a clear explanation.

Six Questions To Ask Your School Before 2027

You can send these questions to your child’s principal, teacher, or district technology office:

1. Will our district turn Search and Gemini on, or leave them off?
2. If Search is enabled, which experience will students get: standard AI search or Guided Learning?
3. Can settings differ by grade or student group, and what protections will apply to elementary students?
4. What monitoring is in place, what triggers an alert, and when will parents be contacted?
5. Can my child’s school account reach AI Mode on a home device or outside the school network?
6. What is the school’s plan if a child is in crisis while using a school device, and how will parents be notified?

For more ways to ask about school technology and student safeguards, read SCN’s guide to protecting your child’s data at school. You can also review SCN’s coverage of New York City’s school AI policy.

If Your Child Is Struggling

A school device may be intended for schoolwork, but a child’s distress does not stay inside one app. Notice significant changes such as withdrawing from people, using a device late into the night, or a marked shift in mood. Ask open questions and make it clear your child can bring you a concern without being blamed.

If you are worried your child may hurt themselves, stay with them and seek help. In the United States, call or text the 988 Suicide & Crisis Lifeline for free, confidential support. SCN’s Parents’ AI Emergency Guide offers additional practical steps for responding to difficult situations involving AI.

What Parents Can Ask Next

The coming months give families an opportunity to learn what their school plans to enable before the default changes take effect. Start with one straightforward request: ask for the district’s plan for Search, AI features, student monitoring, and parent notification.

Frequently Asked Questions

When Does Google Turn Off School Chromebook AI By Default?

Google says the change will begin in early 2027. For K-12 student accounts, Search, Gemini, Gemini Notebook, and Gemini in Classroom will be off until an administrator explicitly enables access.

Can A School Use Google Search Without AI?

Not under the new setup as described in Google’s announcement and related reporting. Google says Search and AI are deeply integrated, and the announced controls do not describe a separate way to provide standard Search with all AI features turned off. Ask your district to confirm the options it will have.

Should I Let My Child Use AI On A School Device?

It depends on your child, the school’s settings, and your family’s expectations. Ask what the tool does, how it is supervised, and what your child should do if a response feels upsetting or confusing. A thoughtful conversation and clear family rules matter more than a blanket yes or no.

What is your school telling families about AI in Search or on student Chromebooks? Share your questions or experience in the comments.

Join the Secure Children’s Network newsletter for practical guidance, safety resources, and updates on children’s digital well-being.

If this helped, share it with another parent and follow Secure Children's Network on Facebook, X and LinkedIn for safety alerts.