https://qz.com/1208581/diversity-and-bias-in-ai-has-reached-us-congress/

While studying artificial intelligence during the 1990s for his Ph.D. at MIT, Charles Isbell broke the software some of his friends were working on.

“I was breaking all of their facial recognition software because apparently all the pictures they were taking were of people with significantly less melanin than I have,” Isbell, now executive associate dean at the Georgia Institute of Technology, told a hearing of Congressional Subcommittee of Information Technology today. “And so they had to come up with ways around the problem—of me.” While the facial recognition algorithm worked for his lighter-skinned peers, it couldn’t recognize his darker complexion. It’s not a unique problem; in 2015, a Google algorithm classified faces of black people as gorillas.