California schools are increasingly turning to artificial intelligence to enhance learning, but a recent incident raises questions about this new approach. In December 2025, a student in a Los Angeles elementary school was assigned a project to create a book cover for “Pippi Longstocking.” The student requested an image of “long stockings, red-haired girl with braids sticking out.” Instead of receiving a suitable illustration, the program produced explicit sexual images.
The software in question was Adobe Express for Education, accessed via the district’s learning management system, Schoology. A parent, Julie, expressed concern about how the AI tool was made available. “Other parents were able to replicate that on their kids’ Chromebooks. It’s not a one-off,” she noted, indicating that several students received similar inappropriate results.
California began discussing the integration of AI in classrooms in 2023, influenced by the rising popularity of tools like ChatGPT. The California Department of Education issued guidelines meant to promote the ethical use of AI in education. However, the rollout of these tools has not been without complications. LAUSD did not comment on the incident, and the lack of clarity raises concerns about accountability and transparency in the integration of AI technologies in the classroom.
Christian Pinedo, vice president at The AI Education Project, explained that California’s decentralized control of educational policy makes managing AI implementation challenging. Each school board can create its own rules, which can lead to inconsistencies in how tools are used and regulated.
Julie highlighted a contradiction in LAUSD’s policies, which require students to be at least 13 years old to use generative AI, alongside compulsory digital citizenship training. Yet, the district promoted an AI event for all students, raising questions about compliance and enforcement of its own policies. “It’s like they want to have their cake and eat it too,” she remarked.
Experts like Amy Eguchi stress caution regarding unsupervised AI use among younger students. “We don’t recommend elementary school teachers to let their students use AI tools without adult supervision,” she said. The unpredictability of AI outputs, especially when prompts are vague, can create problematic situations.
Julie argues that blaming the student for the incorrect prompt overlooks fundamental flaws in AI technology. “So somehow it’s her fault?” she questioned. This sentiment is echoed by others who feel hastily implementing AI in education may not benefit students. Julie stated, “We know so little. So to me, it seems insane, the rush to put this in front of developing learning minds.”
The use of AI in California schools promises innovative approaches to education, but incidents like this demonstrate the urgent need for clear guidelines and accountability measures. Parents and educators alike are calling for a more cautious look at how technology is introduced to children. The incident serves as a reminder that in the pursuit of advancing education, oversight and responsibility should not be sidelined.
"*" indicates required fields
