Four Maryland high school students sue after AI mistakes Doritos bag for gun

Four Maryland high school students sue after AI mistakes Doritos bag for gun

Four current and former students at a Maryland high school have filed a lawsuit a year after armed police detained them, prompted by an AI alert that mistook a bag of Doritos for a gun, in an incident that left them “fearing for their lives”.The plaintiffs sued Omnilert, the company behind the AI gun-detection system, Baltimore county police, the board of education, individual officers and the school principal, alleging unlawful detention and search because of technological and human errors.“These students were failed not only by a technology that is prone to false alerts, but also by the very adults meant to keep them safe when we send them to school,” said Damon Hewitt, the president and executive director of the Lawyers’ Committee for Civil Rights Under Law, which is representing the students. “Instead of this protection, they were met with guns and traumatized. And it could have been even worse.”The incident took place last fall. The students had just wrapped up football practice on the evening of 20 October when their coach passed out bags of Doritos to the team, according to the complaint. Taki Allen, a junior at the time, took several bags and was with his friends near the picnic tables waiting for their ride, when six local police cruisers emerged with lights flashing. Many officers unholstered their weapons and the students put their hands in the air, the complaint said.The legal complaint stated that the plaintiffs “were in shock and feared for their lives after being stopped, ordered to their knees, handcuffed and searched” by armed officers. One officer allegedly told them as he left the scene: “Hey, thanks for not running away, that would have been a real problem.”The complaint described a chaotic series of events in which Omnilert’s AI gun-detection system flagged the chips bag as a firearm with 90% confidence. Omnilert Gun Detect system scans security footage for signs of firearms. “That alert kept going even after school staff and local police reviewed the image and determined it was a mistake,” the lawsuit stated.While Omnilert markets its product as reliable and leading to “fewer false positives”, the lawsuit states that Maryland’s office of the inspector general for education “found that more than 99% of OGD Alerts in Baltimore County Public Schools were false positives that required no police response”.Omnilert, the school principal, Baltimore police and the board of education did not immediately respond to a Guardian request for comment.An Omnilert spokesperson previously told the Baltimore Banner that the company was reviewing the lawsuit and was “truly sorry for the fear they and their families experienced. We understand why they want answers.” A spokesperson for Baltimore county told the New York Times that the district cannot comment on pending litigation.The lawsuit included texts from the school principal making light of the incident in messages to fellow administrators that contained emojis of a smiley face crying with laughter. The complaint said she did not apologize to the students.One officer allegedly said as he began to leave the scene: “Fucking Omnialerts” and: “Stupid AI cameras.” His colleague allegedly joked to the plaintiffs: “Be careful on school property, especially holding stuff like that … be careful with your chips bags.”The students didn’t find that funny, and reported feeling pain from tight handcuffs, as well as lasting emotional distress, according to the complaint.Taki Allen said he no longer feels safe waiting for rides or hanging out at school after hours; he often pays for rides home to avoid waiting for rides from friends or family.Freida Winfield, whose son Keith is part of the lawsuit, was en route to pick up him and his friends when they were detained. “No child in Baltimore county should face this kind of danger while waiting outside his own school for a ride home from his mother,” said Winfield.

Original Source

Read the full article at Theguardian →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.