Self-Harm Amplification

Self-harm Amplification (SHA) is the phenomenon where platforms inadvertently contribute to the escalation and reinforcement of self-harming behaviors among their users. Self-harm includes eating disorders, self-inflicted wounds, and suicidal ideation, and is most pervasive in adolescents. The amplification of self-harm ideation often occurs when individuals seeking information or support around their self-harming tendencies encounter content or communities that glorify or romanticize the behaviors, with the effect of normalizing and encouraging them. This reduces the user's capacity to cope with and overcome the behaviors.

Though their participation in this pattern is inadvertent, platforms bear some responsibility for their amplification of these tendencies. Firstly, content recommendation algorithms prioritize engagement and user interaction, which has the general effect of amplifying and radicalizing the beliefs and ideas which are already familiar to a user. In the context of self harm, this dynamic can lead to the promotion of content on self-harm subjects that aligns to the (notedly unhealthy) leanings of the viewer. Moreover, the sense of anonymity and the availability of online communities can create an environment where individuals feel comfortable to share and seek validation for their self-harming behaviors, and the anonymity which enables that sense of comfort also enables dangerous ideas around self-harm to circulate. 

While platforms have attempted to address self-harm amplification through traditional approaches, they typically struggle to do so. Content moderation systems that focus on content analysis struggle to differentiate content that offers genuine support or educational resources from content that amplifies harmful practices. Additionally, platforms walk a fine line between addressing harmful content and infringing upon users' sense of safety and comfort to share their challenging personal experiences or seek support.