Concerns over AI surveillance in schools are intensifying after armed officers swarmed a 16-year-old student outside Kenwood High School in Baltimore when an AI gun detection system falsely flagged a Doritos bag as a firearm.
Allen was handcuffed at gunpoint. Police later showed him the AI-captured image that triggered the alert. The crumpled Doritos bag in his pocket had been mistaken for a gun.
The purpose of a system is what it does, indeed.
It successfully got a false positive that resulted in a black kid getting swarmed by police. Job well done, amirite?
“yeah this time it wasn’t a gun, but the kid is black for Christ’s sake, what did you expect us to do? So obviously its functioning as intended.”
This is pretty much my takeaway as well