Detroit police challenged over face recognition flaws, bias
A Black man who was wrongfully arrested when facial recognition technology mistakenly identified him as a suspected shoplifter wants Detroit police to apologize — and to end their use of the controversial technology.
The complaint by Robert Williams is a rare challenge from someone who not only experienced an erroneous face recognition hit, but was able to discover that it was responsible for his subsequent legal troubles.
The Wednesday complaint filed on Williams’ behalf alleges that his Michigan driver license photo — kept in a statewide image repository — was incorrectly flagged as a likely match to a shoplifting suspect. Investigators had scanned grainy surveillance camera footage of an alleged 2018 theft inside a Shinola watch store in midtown Detroit, police records show.
That led to what Williams describes as a humiliating January arrest in front of his wife and young daughters on their front lawn in the Detroit suburb of Farmington Hills.
“I can’t really even put it into words,” Williams said in a video announcement describing the daytime arrest that left his daughters weeping. “It was one of the most shocking things that I ever had happen to me.”
The 42-year-old automotive worker, backed by the American Civil Liberties Union, is demanding a public apology, final dismissal of his case and for Detroit police to scrap its use of facial recognition technology. Several studies have shown current face-recognition systems more likely to err when identifying people with darker skin.
The ACLU complaint said Detroit police “unthinkingly relied on flawed and racist facial recognition technology without taking reasonable measures to verify the information being provided.” It called the resulting investigation “shoddy and incomplete,” the officers involved “rude and threatening,” and said the department has dragged its feet responding to public-information requests for relevant records.
In a written statement Wednesday, Wayne County Prosecutor Kym Worthy apologized for her office taking up the case, while noting she has long expressed reservations to Detroit police about face-recognition technology because of its unreliability, “especially as it relates to people of color.”
“This case should not have been issued based on the DPD investigation, and for that we apologize,” she said. “Thankfully, it was dismissed on our office’s own motion. This does not in any way make up for the hours that Mr. Williams spent in jail.”
Detroit police declined to comment on the complaint Wednesday, citing “pending litigation.” But the department told NPR it has since enacted new rules limiting the use of facial recognition to cases involving violent crimes and only using still photos, not security camera footage.
DataWorks Plus, a South Carolina company that supplies the face-scanning system to Detroit and the Michigan State Police, didn’t return requests for comment. One of its subcontractors, Denver-based Rank One Computing, a provider of facial recognition algorithms, defended its accuracy rate but said the way facial recognition was used in the Williams case “goes against established industry standard best practices.”
Police records show the case began in October 2018 when five expensive watches went missing from the flagship store of Detroit-based luxury watchmaker Shinola. A loss-prevention worker later reviewed the video footage showing the suspect to be a Black man wearing a St. Louis Cardinals baseball cap.
“Video and stills were sent to Crime Intel for facial recognition,” says a brief police report. “Facial Recognition came back with a hit” — for Williams.
At the top of the facial recognition report, produced by Michigan State Police, was a warning in bold, capitalized letters that the computer’s finding should be treated as an investigative lead, not as probable cause for arrest.
But Detroit detectives then showed a 6-photo lineup that included Williams to the loss-prevention worker, who positively identified Williams, according to the report. It took months for police to issue an arrest warrant and several more before they called Williams at work and asked him to come to the police department. It’s not clear why.
Williams said he thought it was a prank call. But they showed up soon after at his house, took him away in handcuffs and detained him overnight. It was during his interrogation the next day that it became clear to him that he was improperly identified by facial recognition software.
“The investigating officer looked confused, told Mr. Williams that the computer said it was him but then acknowledged that ‘the computer must have gotten it wrong,'” the ACLU complaint says.
Prosecutors later dismissed the case, but without prejudice — meaning they could potentially pursue it again. The prosecutor’s office said Wednesday that a final dismissal isn’t legally possible, though Williams could have his case expunged. The ACLU said that puts too much burden on Williams to spend time and money to expunge a criminal record “that he should not have in the first place.”
The case is likely to fuel a movement in Detroit and around the U.S. protesting police brutality, racial injustice and the death of George Floyd at the hands of police in Minneapolis. Detroit activists have presented reforms to the city’s mayor and police chief that include defunding the police department and ending its use of facial recognition.
Providers of police facial recognition systems often point to research showing they can be accurate when used properly under ideal conditions. A review of the industry’s leading facial recognition algorithms by the National Institute of Standards and Technology found they were more than 99% accurate when matching high-quality head shots to a database of other frontal poses.
But trying to identify a face from a video feed — especially using the ceiling-mounted cameras commonly found in stores — can cause accuracy rates to plunge. Studies have also shown that face recognition systems don’t perform equally across race, gender and age — working best on white men and with potentially harmful consequences for others.
“It wasn’t designed to work on the faces of Black people in this very Black city,” said Victoria Burton-Harris, an attorney for Williams who is also running to unseat Worthy as Wayne County’s top prosecutor in a Democratic primary in August.
Burton-Harris said what started out as a technical error could have had dire consequences for Williams had the police encounter happened differently.
“What would have happened if he had not been so calm?” she said. “When police officers encounter Black men, especially large Black men, they get afraid.”
Concerns about bias and growing scrutiny of policing practices following Floyd’s death led tech giants IBM, Amazon and Microsoft to announce earlier this month they would stop selling face recognition software to police, at least until Congress can establish guidelines for its use. Several cities, led by San Francisco last year, have banned use of facial recognition by municipal agencies. On Wednesday, the Boston City Council followed suit by unanimously approving a similar ban.
In Detroit, there is a proposal to extend the software contract, but city council leaders have put the plan on hold and told Detroit police to get more community opinion. Protesters in a car caravan drove past the homes of council members last week.
__
By MATT O’BRIEN AP Technology Writer
AP reporter Ed White in Detroit contributed to this report.
Inside Telecom provides you with an extensive list of content covering all aspects of the Tech industry. Keep an eye on our News section to stay informed and updated with our daily articles.