Content Moderation Case Studies: Stopping Malware In Search Leads To Unsupported Claims Of Bias (2007)

Content Moderation Case Studies: Stopping Malware In Search Leads To Unsupported Claims Of Bias (2007)

4 years ago
Anonymous $rxtAWepgzY

https://www.techdirt.com/articles/20200904/14550345252/content-moderation-case-studies-stopping-malware-search-leads-to-unsupported-claims-bias-2007.shtml

Summary: As detailed in a thorough oral history in Wired back in 2017, it’s hard to overstate the importance of Google’s Safe Browsing blocklist effort that began as a project in 2005, but really launched in 2007. The effort was in response to a recognition that there were malicious websites out there that were attempting to trick people into visiting in order to install various forms of malware. Google’s Safe Browsing list, and its corresponding API (used by pretty much every other major browser, including Safari, Firefox and more) has become a crucial part of stopping people from being lured to dangerous websites that may damage or compromise their computers.

Of course, as with any set of filters and blocklists, questions are always raised about the error rate, and whether or not you have too many false positives (or false negatives). And, not surprisingly, when sites are added to the blocklist, many website operators become upset. Part of the problem was that, all too often, the websites had become compromised without the operator knowing about it -- leading them to claim they were falsely being blocked. From the oral history: