AI art generator DALL·E mini is spewing awfully racist images from text prompts

By Malavika Pradeep

Published Jun 16, 2022 at 11:16 AM

Reading time: 3 minutes

32541

In 2021, AI research laboratory OpenAI invented DALL·E, a neural network trained to generate images from text prompts. With just a few descriptive words, the system (named after both surrealist painter Salvador Dalí and the adorable Pixar robot WALL-E) can conjure up absolutely anything from an armchair shaped like an avocado to an illustration of a baby radish walking a dog in a tutu. At the time, however, the images were often grainy, inaccurate and time-consuming to generate—leading the laboratory to upgrade the software and design DALL·E 2. The new and improved model, supposedly.

While DALL·E 2 is slowly being rolled out to the public via a waitlist, AI artist and programmer Boris Dayma has launched a stripped-down version of the neural network which can be used by absolutely anyone with an internet connection. Dubbed DALL·E mini, the AI model is now all the rage on Twitter as users are scrambling to generate nightmarish creations including MRI images of Darth Vader, Pikachu that looks like a pug and even the Demogorgon from Stranger Things as a cast member on the hit TV show Friends.

While the viral tool has even spearheaded a meme format of its own, concerns arise when text prompts descend beyond innocent Pikachus and Fisher Price crack pipes onto actual human faces. Now, there are some insidiously dangerous risks in this case. As pointed out by Vox, people could leverage this type of AI to make everything from deepnudes to political deepfakes—although the results would be horrific, to say the least. Given how the technology is free to use on the internet, it also harbours the potential to put human illustrators out of work in the long run.

But another pressing issue at hand is that it can also reinforce harmful stereotypes and ultimately accentuate some of our current societal problems. To date, almost all machine learning systems, including DALL·E mini’s distant ancestors, have exhibited bias against women and people of colour. So, does the AI-powered text-to-image generator in question suffer the same ethical gamble that experts have been warning about for years now?

Using a series of general prompts, SCREENSHOT tested the viral AI generator for its stance on the much-debated racism and sexism that the technology has been linked to. The results were both strange and disappointing, yet unsurprising.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

When DALL·E mini was fed with the text prompts ‘CEO’ and ‘lawyers’, the results were prominently white men. A query for ‘doctor’ reverted back with similar results while the term ‘nurse’ featured mostly white women. The same was the case with ‘flight attendant’ and ‘personal assistant’—both made assumptions about what the perfect candidate for the respective job titles would look like.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

Now comes the even more concerning part, when the AI model was prompted with phrases like ‘smart girl’, ‘kind boy’ and ‘good person’, it spun up a grid of nine images all prominently featuring white people. To reiterate: Are we shocked? Not in the least. Disappointed? More than my Asian parents after an entrance exam.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

In the case of DALL·E 2, AI researchers have found that the neural network’s depictions of people can be too biassed for public consumption. “Early tests by red team members and OpenAI have shown that DALL·E 2 leans toward generating images of white men by default, overly sexualizes images of women, and reinforces racial stereotypes,” WIRED noted. After conversations with roughly half of the red team—a group of external experts who look for ways things can go wrong before the product’s broader distribution—the publication found that a number of them recommended OpenAI to release DALL·E 2 without the ability to generate faces.

“One red team member told WIRED that eight out of eight attempts to generate images with words like ‘a man sitting in a prison cell’ or ‘a photo of an angry man’ returned images of men of colour,” the publication went on to note.

When it comes to DALL·E mini, however, Dayma has already confronted the AI’s relationship with the darkest prejudices of humanity. “While the capabilities of image generation models are impressive, they may also reinforce or exacerbate societal biases,” the website reads. “While the extent and nature of the biases of the DALL·E mini model have yet to be fully documented, given the fact that the model was trained on unfiltered data from the Internet, it may generate images that contain stereotypes against minority groups. Work to analyze the nature and extent of these limitations is ongoing, and will be documented in more detail in the DALL·E mini model card.”

Although the creator seems to have somewhat addressed the bias, the possibility of options for either controlling harmful prompts or reporting certain results cannot be ruled out. And even if they’re all figured out for DALL·E mini, it’ll only be a matter of time before the neural system is replaced by another with impressive capabilities where such an epidemic of bias could resurface.

Keep On Reading

By Fatou Ferraro Mboup

Lily Phillips announces pregnancy hours after Bonnie Blue teases having cravings

By Fatou Ferraro Mboup

Americans are learning mandarin and fleeing to RedNote and Lemon8 ahead of controversial TikTok ban

By Abby Amoakuh

Who would you call in case of an emergency? TikTokers contemplate their choice in new viral trend

By Abby Amoakuh

Young girls are being lured into drug trade with promises of botox, lip fillers, and makeup products

By Abby Amoakuh

Why is Heidi Montag’s song I’ll Do It trending on TikTok? Inside the plot to get The Hills star back to the top

By Abby Amoakuh

Unpacking the many controversies of Disney’s live action Snow White and its lead Rachel Zegler

By Fatou Ferraro Mboup

Brooklyn Beckham sparks internet frenzy as he teases new career move

By Charlie Sawyer

Impractical Jokers star Joe Gatto accused of sexual assault in viral TikTok

By Charlie Sawyer

Aldi just became the first UK supermarket to provide free in-store period products and transphobes are mad

By Charlie Sawyer

Here’s the real reason Armie Hammer shut down Louis Theroux’s questions about cannibalism

By Alma Fabiani

From ugly crying to reliving Y2K dreams: 6 audiobooks for every mood on Amazon Music

By Abby Amoakuh

Mikey Madison tells Pamela Anderson why she rejected an intimacy coordinator on Anora set

By Charlie Sawyer

Interview with Lazo, the TikTok viral app exposing cheaters and testing relationships

By Charlie Sawyer

If you think Sabrina Carpenter’s tour is inappropriate for young audiences, leave the kids at home

By Kit Warchol

Is Dry January sexist? A look into the gendered politics behind Gen Z’s favourite wellness trend

By Abby Amoakuh

First ever porn app launches on iOS devices to coincide with iPhone’s 18th birthday

By Abby Amoakuh

German AfD party under fire for handing out Nazi-inspired fake deportation tickets to migrants 

By Fatou Ferraro Mboup

Rosanna Pansino shocks fans after smoking her dead dad’s ashes in new podcast episode

By Abby Amoakuh

Julia Fox reveals her ex-husband secretly baptised her son and warns women of loser fathers

By Fatou Ferraro Mboup

Jeffree Star makes inappropriate comment after Kanye West posts disturbing incest confession