Content Moderation Case Study: Sensitive Mental Health Information Is Also A Content Moderation Challenge (2020)
https://www.techdirt.com/articles/20201002/15295045436/content-moderation-case-study-sensitive-mental-health-information-is-also-content-moderation-challenge-2020.shtml
Summary: Talkspace is a well known app that connects licensed therapists with clients, usually by text. Like many other services online, it acts as a form of “marketplace” for therapists and those in the market for therapy. While there are ways to connect with those therapists by voice or video, the most common form of interaction is by text messages via the Talkspace app.
A recent NY Times profile detailed many concerns about the platform, including claims that it generated fake reviews, lied about events like the 2016 election leading to an increase in usage, and that there were conflicts between growing usage and providing the best mental health care for customers. It also detailed how Talkspace and similar apps face significant content moderation challenges as well -- some unique to the type of content that the company manages.