Bumble makes its nude-detecting AI public to combat cyberflashing on the internet

By Malavika Pradeep

Published Oct 25, 2022 at 01:27 PM

Reading time: 1 minute

37612

Since 2018, women-first dating app Bumble has helped pass legislation in both the US and UK to combat cyberflashing, the act of sending sexually explicit material online without consent. According to a previous research carried out by the app, 48 per cent of women aged 18 to 24—out of the 1,793 respondents based in England or Wales—had received an explicit, non-consensual photo in 2019 alone. 59 per cent of them admitted to losing their trust in other users afterward, while one in four felt violated in the process.

In the same year, Bumble harnessed machine learning to better shield its growing community from unwanted nudes, launching an AI tool dubbed ‘Private Detector’ within the app. The feature essentially screens images sent from matches to determine if they depict lewd content or not.

While it was designed with the intention of catching unsolicited nudes, it also helps flag shirtless selfies and images of firearms—both of which aren’t allowed on the platform. I mean, you really have to reevaluate your presence on dating apps if you think such pictures would pull romantic prospects in the first place.

If the AI detects a positive match, the app blurs the image and you’ll be notified of the same. It’s then up to you to decide whether you want to view, block, or report the individual who sent the picture.

View this post on Instagram

A post shared by Bumble UK and Ireland (@bumble_uki)

Fast forward to October 2022, in a recent press release, the app—which is also reportedly launching a speed dating feature that lets users chat before matching or seeing pictures—announced that it is open-sourcing Private Detector on Github, making the framework publicly available for commercial use, distribution, and modification.

“It’s our hope that the feature will be adopted by the wider tech community as we work in tandem to make the internet a safer place,” the company wrote.

When Bumble first introduced the AI, it claimed that the tool had 98 per cent accuracy. On these terms, it’s worth noting that the technology harbours the potential to help smaller companies—who probably don’t have the time or assets to develop similar tools—integrate the same into their offerings thereby shielding users from cyberflashing.

“There’s a need to address this issue beyond Bumble’s product ecosystem and engage in a larger conversation about how to address the issue of unsolicited lewd photos to make the internet a safer and kinder place for everyone,” Bumble concluded.

Keep On Reading

By Fatou Ferraro Mboup

The White House sparks outrage with ASMR video of shackled immigrants being deported

By Fatou Ferraro Mboup

Celebrities call out Blue Origin for sending Katy Perry and Lauren Sánchez to space

By Charlie Sawyer

Lawmakers pressure Trump to provide evidence that Venezuelan asylum seeker Andry Hernández Romero is still alive

By Alma Fabiani

Amazon Music is giving away 4 months free. Here’s how to claim it

By Fatou Ferraro Mboup

Did Chappell Roan push her assistant on the red carpet? We analyse the footage

By Fatou Ferraro Mboup

Gaza journalist death toll surpasses that of both World Wars, following latest Israeli airstrike that killed reporter

By Charlie Sawyer

TikToker Leo Skepi is known for three things: Loving Versace, black tank tops, and controversy

By Charlie Sawyer

The 3 wildest fan theories about Severance season 2

By Fatou Ferraro Mboup

James Toback hit with landmark $1.68 billion jury award after 40 women accused director of sexual abuse

By Eliza Frost

Jennifer Aniston to star in Apple TV+ adaptation of Jennette McCurdy’s memoir I’m Glad My Mom Died

By Annabel Smith

Is TikTok’s protect your peace trend empowering Gen Z women or causing social isolation?

By Fatou Ferraro Mboup

Here’s how the Trump administration has already worsened the humanitarian crisis in Sudan

By Fatou Ferraro Mboup

How incel TikTok accounts are rebranding to avoid getting banned

By Charlie Sawyer

First look at $1 billion UK mini city where controversial HBO Harry Potter series will be filmed

By Charlie Sawyer

Why has the new sculpture of a Black American woman in Times Square prompted mass outrage?

By Abby Amoakuh

Explaining the viral TikTok trend cute winter boots and its unexpected ties to US censorship

By Charlie Sawyer

Mason Disick starts trending on X after rumours circulate that he has a secret child named Piper

By Abby Amoakuh

First ever porn app launches on iOS devices to coincide with iPhone’s 18th birthday

By Charlie Sawyer

Here’s the real reason Armie Hammer shut down Louis Theroux’s questions about cannibalism

By Abby Amoakuh

Zoë Kravitz is pushing for a revival of women of colour-led TV series High Fidelity, but Hulu isn’t budging