Baltimore students sue after AI gun detector mislabeled bag of chips as a firearm

Baltimore students sue after AI gun detector mislabeled bag of chips as a firearm

Last October, eight Baltimore County Police Department officers responded to the alert with guns drawn, forced the students to their knees, handcuffed them and searched their pockets over a bag of Doritos.(CN) — Since generative artificial intelligence products like ChatGPT came on the market in 2022, schools across the country have been grappling with the technology’s potential for academic hallucinations. But AI’s widespread adoption has also caused headaches for students before even entering the classroom.In October 2025, a group of four Baltimore County high school students found themselves on the wrong side of an AI surveillance system’s mistake when it pegged one student as a gunman after falsely identifying a bag of chips in his hand as a firearm.The students’ parents filed the lawsuit in the Circuit Court for Baltimore County on Tuesday, claiming the Omnilert Gun Detect system’s report resulted in six Baltimore County Police Department cruisers arriving at Kenwood High School over a bag of Cool Ranch Doritos.“This case is about the people who turned that machine error into a traumatic police takedown of four teenagers at their own school: the police officers who, guns drawn, forced the students to their knees on the concrete, handcuffed them and searched them; the school officials who unleashed this technology on their own students with no standards or protocols to protect against false Alerts; and the company that designed, sold and monitored the faulty technology,” plaintiffs Jerrie Davis and Lamont Davis say in the 31-page complaint.Upon arriving at the school, the officers exited their vehicles with guns drawn at the four students and without any explanation why they were suddenly being detained. Only after the officers’ search of the students revealed no weapons did an officer mention they had been alerted by Omnilert.“The officers on the scene knew [Omnilert Gun Detect] was unreliable,” the parents say in the complaint. “One told the students that ‘AI is not the best.’ Another muttered ‘stupid AI cameras’ and ‘fucking Omnilerts.’ Yet officers relied on the alert to initiate this painful encounter with the students.”The parents say one officer suggested in parting that, had the students not immediately complied and gone to their knees, “that would have been a real problem.”Defendants include Onmilert, Baltimore County, its board of education, the board’s executive director of school safety Eric Knox, Kenwood Principal Catherine Smith and the eight officers.Following the incident, Smith and school resource officer John Douglas appeared to make light of it over text, with Douglas explaining the alert was caused by a “bag of chips not a gun” with a laughing crying emoji, to which Smith replied “Bwahahaha, thanks for checking.”In a message to school staff and administrators, Smith similarly explained the incident with four laughing crying emojis.According to the parents, Smith had not apologized to any of the four students.Omnilert’s detection system intentionally leans toward identifying potential inert objects to avoid missing a real firearm, the parents say, flagging anything that resembles a gun-like device so that a human can review the report and evaluate its accuracy before sending out an alert.An alert includes a text message to school administrators with a photo of the threat and a URL link to view a magnified image, video footage and the status of the alert.The parents challenge the company’s reliability, arguing it has a false positive rate of more than 99% in Baltimore County public schools, with less than 1% of alerts between November 2023 and November 2025 requiring notification of law enforcement.The gun detection system has been implemented throughout several industries across the nation, from schools to banks and casinos. According to the company, Omnilert’s technology has been implemented in over 600 schools across 50 school districts — including the Uvalde Consolidated Independent School District in Texas, where a gunman killed 19 students and two teachers at Robb Elementary School in 2022.Omnilert was also implemented in a Nashville school district in February 2024 at a cost of $1 million. However, the system failed to detect the firearm of 17-year-old Solomon Henderson, who carried out a fatal shooting inside Antioch High School in 2025.The parents seek damages claiming violations the students’ Fourth and 14th Amendment rights. They are represented by Lon Engel of the Engel Law Group in Baltimore.The school board and the AI company did not respond to requests for comment.Subscribe to our free newslettersOur weekly newsletter Closing Arguments offers the latest about ongoing trials, major litigation and rulings in courthouses around the U.S. and the world, while the monthly Under the Lights dishes the legal dirt from Hollywood, sports, Big Tech and the arts.Additional Reads

Original Source

Read the full article at Courthousenews →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.