Instagram is tackling self-harm content with ‘Sensitivity Screens’

By Shira Jeczmien

Updated May 17, 2020 at 08:49 AM

Reading time: 2 minutes

829

Instagram and other social media platforms have long been struggling with the rise of communities encouraging self-harm and suicide on their platforms. Following the death of 14-year-old British Molly Russell in 2017, the social media giant, under its new CEO Adam Mosseri, announced this week that it will hide images of self-harm under its ‘Sensitivity Screens’ feature.

There have been a number of deaths and incidents of self-harm in recent years as a result of the spread of various social media groups influencing teens to perform self-harm practices. Most infamously are groups promoting and encouraging members to sustain harmful and sometimes deadly eating disorders. But after Russell’s parents reported that they believe she took her own life following her exposure to disturbing posts on Instagram and Pinterest, social media platforms were forced to confront the dark and sometimes harmful turn their platforms have taken.

“I have been deeply moved by the tragic stories that have come to light this past month of … families affected by suicide and self-harm,” Mosseri write in an op-ed published by the Telegraph on Monday, February 4. “We are not yet where we need to be on the issues of suicide and self-harm. We need to do everything we can to keep the most vulnerable people who use our platform safe.” He added.

Under the new Sensitivity Screens feature, content that is clearly promoting self-harm, such as images of cuts or other forms of self-abuse will be removed from the platform immediately. This process is currently heavily reliant on community flagging, so the more vigilant and active we become as users, the safer the Instagram terrain will become—in theory. Of course, AI is also used to detect this type of content, however are well aware of the shortcomings of AI image recognition. Recent removals of what AI has detected as ‘pornographic’ images come to mind. Suffice to say, it is not all that accurate or reliable.

Instagram regards itself as a “supportive environment” says Mosseri; a platform for creating awareness among people facing difficult issues, and with that, some aspects of the new move have been criticised by those who see the platform as a place to freely express their struggles and find likeminded comradeship. For that Mosseri reported that Instagram still allows users to “share that they are struggling,” so photos or videos that don’t promote self-harm but talk about it and offer support will remain on the site, but won’t appear in search, hashtags, or the Explore tab.

The company also employs content reviewers trained to make it more difficult to find self-harm images, and is working on new ways to support people in need. “This is a difficult but important balance to get right,” Mossari wrote. “These issues will take time, but it’s critical we take big steps forward now.”

It seems that Mosseri is on the right track when it comes to the difficult task of making the platform safer for users who are vulnerable, yet a side-effect of Sensitive Screens will undoubtedly make this move it more difficult to find accounts that offer positive support to those suffering from mental ill health. With that, it’s crucial that in its chase to make the platform ‘safe’, Instagram (and other social media platforms) tread carefully around the terrain of these accounts and nourish channels, users and communities who do support those looking for a place to share, talk and help one another through virtual aid.

Keep On Reading

By Payton Turkeltaub

Do Gen Z secretly hate their boyfriends? TikTok’s viral #IHateMyBF says yes

By Charlie Sawyer

From breaking up families to spreading rumours about Joe Biden’s death, here’s what QAnons been up to

By Eliza Frost

Couples who meet online are less happy in love, new research finds

By Eliza Frost

We finally know why Conrad and Belly broke up in The Summer I Turned Pretty season 2

By Charlie Sawyer

Pope picking 101: What actually happens during Conclave

By Fatou Ferraro Mboup

Did Chappell Roan push her assistant on the red carpet? We analyse the footage

By Abby Amoakuh

Tiktoker gets slammed by dermatologists for promoting dangerous caveman skincare regime

By Abby Amoakuh

I sat down with two professional matchmakers to solve Gen Z’s dating fatigue

By Charlie Sawyer

Penn Badgley praised for opening up about fatherhood and raising sons on Call Her Daddy

By Charlie Sawyer

Odd Muse founder Aimee Smale fights back against fast fashion controversy on TikTok

By Charlie Sawyer

Father of former Harry Potter star gives serious warning to the new child stars in HBO Max reboot

By Charlie Sawyer

Netflix’s new viral movie, The Life List, is prompting Gen Zers to break up with their boyfriends

By Abby Amoakuh

Right-wing Christian podcaster claims that airport body scanners can turn you gay

By Eliza Frost

People think Donald Trump is dead and they’re using the Pentagon Pizza Index to prove it

By Abby Amoakuh

ICE hit with backlash for lying to elementary school staff in bid to detain young students

By Charlie Sawyer

Harry Potter TV series crew bewildered over production’s strange decision on location to film iconic scene

By Charlie Sawyer

First look at $1 billion UK mini city where controversial HBO Harry Potter series will be filmed

By Charlie Sawyer

Wednesday star Jenna Ortega reveals surprising dream role in recent interview

By Eliza Frost

Is Belly Conklin the problem in The Summer I Turned Pretty?

By Charlie Sawyer

Michael Cera reveals why he turned down a role in the Harry Potter franchise