The use of emojis protects abusive posts from being taken down, new study shows

By Alma Fabiani

Published Aug 16, 2021 at 02:55 PM

Reading time: 2 minutes

Nowadays, you really don’t need to be that tech-savvy to know what emojis are—you know, those ‘yellow little dudes’ you can add to your texts and captions, as my grandma likes to call them. The exact same applies to online trolls—who statistically, and I’ll add the adverb unsurprisingly in there too, tend to be men more often than not. Ironically, we’ve also previously seen that men tend to use fewer emojis than women. And last but not least, we even learned that using emojis can help you get laid more often. Make it make sense, right?

‘Where is she going with this?’ I can already hear you say. Let me enlighten you. Yet another study has revealed something new about the use of emojis, especially on social media platforms. The use of emojis online could help decrease the chances of abusive posts being tracked and taken down.

A new report published by the Oxford Internet Institute discovered that online posts which contain abuse are becoming less likely to be identified by some algorithms because of the emojis added to them. The report revealed that, while most algorithms used to track down hate posts work well with posts that only include text, it becomes largely difficult for them to work with posts that include emojis.

As a result, many posts containing harmful and abusive language, along with a couple of emojis, manage to remain on social media. Reporting on the same study, Digital Information World cites one example of this which took place during the Euro 2020 final, when players from England received racist remarks upon losing. Many of these racist posts were never detected nor deleted by the algorithm “since almost all of them contained a monkey emoji.”

Why can’t algorithms detect emoji-using trolls?

Social media algorithms all go through the same ‘learning process’—even TikTok’s impressively accurate one. Depending on what they’ll soon be asked to do, they are first shown examples of what they need to look out for on the platform. For example, when an algorithm is being ‘trained’ to detect abusive comments, it is trained on databases. The problem is that, until recently, these databases mostly contained text and rarely had emojis in them. Because of this, when a platform’s algorithm comes across abusive posts with emojis, it automatically sorts it as acceptable when it’s obviously not.

“A recent analysis disclosed that Instagram accounts that posted racist content but used emojis within it were three times less likely to be banned than those accounts that posted racist content without using emojis,” Digital Information World added.

That’s where Oxford University came in to hopefully save the day. Researchers put forward a solution for this problem, developing a new database of around 4,000 sentences that contained different emojis. They then used the new database to train an artificial intelligence-based model, which was then tested upon different hate comments such as those on minorities, religions and the LGBTQ+ community.

Google’s model named ‘Perspective API’, when tested with the dataset created by researchers, was only found to be 14 per cent efficient. In comparison, the AI model created by the researchers (called  HatemojiTrain) increased Google’s efficiency by about 30 to 80 per cent.

Shortly after publishing their report, the team of researchers from Oxford University shared its database online for other developers and companies to use as soon as possible. Yet so far, it doesn’t seem to be making much noise online.

Keep On Reading

By Abby Amoakuh

British homes for British workers: Tory party pushes new controversial housing scheme

By Charlie Sawyer

Kylie Minogue’s scent, stereotypes in the media, and fancying F1 drivers: My morning with GK Barry

By Bianca Borissova

Explaining the absurdity of gatekeeping in TikTok’s viral Slavic Girl trend

By Abby Amoakuh

Nicola Peltz Beckham’s movie Lola is labelled as poverty porn from the mind of a billionaire’s daughter

By Fatou Ferraro Mboup

Groom’s crude vows were just the beginning: Dad and ex-girlfriend’s speeches go viral

By Fatou Ferraro Mboup

Spirit Airlines flight breaks into violent brawl as passenger throws punches

By Charlie Sawyer

JoJo Siwa fans shocked to discover performer’s mother started bleaching her hair when she was 2 years old

By Abby Amoakuh

Alabama Barker denies claims she has had a lot of plastic surgery in major clapback

By Alma Fabiani

Travis Scott caught spray painting over John McEnroe’s Hall of Fame plaque

By Abby Amoakuh

UK cracks down on boycott protests with controversial new bill, but is the BDS movement to blame?

By Charlie Sawyer

How to get a refund on your train ticket this Christmas

By Charlie Sawyer

Belle Delphine reveals how much money she makes on OnlyFans in new Louis Theroux podcast

By Bianca Borissova

Bunny, cat, fox, boy, girl: What type of pretty are you? Unpacking TikTok’s latest beauty obsession

By Fatou Ferraro Mboup

From one 90s Black girl to another, how on earth did we survive hair relaxers?

By Fatou Ferraro Mboup

Who is Timhouthi Chalamet? The Yemini mystery man touring captured cargo boats in the Red Sea

By Charlie Sawyer

TikToker Leo Skepi faces backlash for fatphobic comments in now-deleted video

By Fatou Ferraro Mboup

British elite quit exclusive Garrick Club after gentlemen’s club refuses to admit women

By Alma Fabiani

Biden’s impeachment inquiry explained and how abortion will impact the 2024 US elections

By Charlie Sawyer

Jennifer Coolidge thanks evil gays during Emmy Awards 2024 acceptance speech

By Charlie Sawyer

What’s in the 2024 Oscars gift bag that’s worth more than most people’s annual salary?