AI art generator DALL·E mini is spewing awfully racist images from text prompts

By Malavika Pradeep

Published Jun 16, 2022 at 11:16 AM

Reading time: 3 minutes

32541

In 2021, AI research laboratory OpenAI invented DALL·E, a neural network trained to generate images from text prompts. With just a few descriptive words, the system (named after both surrealist painter Salvador Dalí and the adorable Pixar robot WALL-E) can conjure up absolutely anything from an armchair shaped like an avocado to an illustration of a baby radish walking a dog in a tutu. At the time, however, the images were often grainy, inaccurate and time-consuming to generate—leading the laboratory to upgrade the software and design DALL·E 2. The new and improved model, supposedly.

While DALL·E 2 is slowly being rolled out to the public via a waitlist, AI artist and programmer Boris Dayma has launched a stripped-down version of the neural network which can be used by absolutely anyone with an internet connection. Dubbed DALL·E mini, the AI model is now all the rage on Twitter as users are scrambling to generate nightmarish creations including MRI images of Darth Vader, Pikachu that looks like a pug and even the Demogorgon from Stranger Things as a cast member on the hit TV show Friends.

https://twitter.com/weirddalle/status/1536438832530395140

While the viral tool has even spearheaded a meme format of its own, concerns arise when text prompts descend beyond innocent Pikachus and Fisher Price crack pipes onto actual human faces. Now, there are some insidiously dangerous risks in this case. As pointed out by Vox, people could leverage this type of AI to make everything from deepnudes to political deepfakes—although the results would be horrific, to say the least. Given how the technology is free to use on the internet, it also harbours the potential to put human illustrators out of work in the long run.

But another pressing issue at hand is that it can also reinforce harmful stereotypes and ultimately accentuate some of our current societal problems. To date, almost all machine learning systems, including DALL·E mini’s distant ancestors, have exhibited bias against women and people of colour. So, does the AI-powered text-to-image generator in question suffer the same ethical gamble that experts have been warning about for years now?

Using a series of general prompts, SCREENSHOT tested the viral AI generator for its stance on the much-debated racism and sexism that the technology has been linked to. The results were both strange and disappointing, yet unsurprising.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

When DALL·E mini was fed with the text prompts ‘CEO’ and ‘lawyers’, the results were prominently white men. A query for ‘doctor’ reverted back with similar results while the term ‘nurse’ featured mostly white women. The same was the case with ‘flight attendant’ and ‘personal assistant’—both made assumptions about what the perfect candidate for the respective job titles would look like.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

Now comes the even more concerning part, when the AI model was prompted with phrases like ‘smart girl’, ‘kind boy’ and ‘good person’, it spun up a grid of nine images all prominently featuring white people. To reiterate: Are we shocked? Not in the least. Disappointed? More than my Asian parents after an entrance exam.

AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts
AI art generator DALL·E mini is spewing awfully racist images from text prompts

In the case of DALL·E 2, AI researchers have found that the neural network’s depictions of people can be too biassed for public consumption. “Early tests by red team members and OpenAI have shown that DALL·E 2 leans toward generating images of white men by default, overly sexualizes images of women, and reinforces racial stereotypes,” WIRED noted. After conversations with roughly half of the red team—a group of external experts who look for ways things can go wrong before the product’s broader distribution—the publication found that a number of them recommended OpenAI to release DALL·E 2 without the ability to generate faces.

“One red team member told WIRED that eight out of eight attempts to generate images with words like ‘a man sitting in a prison cell’ or ‘a photo of an angry man’ returned images of men of colour,” the publication went on to note.

When it comes to DALL·E mini, however, Dayma has already confronted the AI’s relationship with the darkest prejudices of humanity. “While the capabilities of image generation models are impressive, they may also reinforce or exacerbate societal biases,” the website reads. “While the extent and nature of the biases of the DALL·E mini model have yet to be fully documented, given the fact that the model was trained on unfiltered data from the Internet, it may generate images that contain stereotypes against minority groups. Work to analyze the nature and extent of these limitations is ongoing, and will be documented in more detail in the DALL·E mini model card.”

Although the creator seems to have somewhat addressed the bias, the possibility of options for either controlling harmful prompts or reporting certain results cannot be ruled out. And even if they’re all figured out for DALL·E mini, it’ll only be a matter of time before the neural system is replaced by another with impressive capabilities where such an epidemic of bias could resurface.

Keep On Reading

By Fatou Ferraro Mboup

US women turning to South Korea’s radical 4B movement after Trump’s election win

By Charlie Sawyer

If you think Sabrina Carpenter’s tour is inappropriate for young audiences, leave the kids at home

By J'Nae Phillips

How Beyoncé, TikTok, and Bella Hadid gave the horse girl aesthetic a major glow-up

By Abby Amoakuh

Did The Summer I Turned Pretty star Gavin Casalegno cheat on his ex-girlfriend Larsen Thompson?

By Fatou Ferraro Mboup

Brooklyn Beckham sparks internet frenzy as he teases new career move

By Abby Amoakuh

Jacob Elordi and Margot Robbie to star in Emerald Fennell’s white-washed Wuthering Heights

By Abby Amoakuh

Amandla Stenberg faces colourism backlash for role in Children of Blood and Bone

By Charlie Sawyer

Unpacking the Karen Read story: a victim of a police coverup or guilty of committing murder?

By Abby Amoakuh

Selena Gomez cried on camera about ICE raids and mass deportation but did we need to see it?

By Abby Amoakuh

Elon Musk’s trans daughter Vivian Jenna Wilson to leave US amid rumours of his ties to Trump administration

By Fatou Ferraro Mboup

Americans are learning mandarin and fleeing to RedNote and Lemon8 ahead of controversial TikTok ban

By Charlie Sawyer

It’s giving gyatt: Unpacking Gen Alpha’s favourite viral internet slang trend

By Charlie Sawyer

Outrage as male students rip up Australia campus sexual violence report in viral video

By Abby Amoakuh

Pregnant women in the US more likely to die from murder than complications, cancer, or accidents

By Abby Amoakuh

Gracie Abrams claps back at fans after they petition to replace Dora Jar as her opening act

By Charlie Sawyer

Reality TV show The Secret Lives of Mormon Wives addresses #momtok phenomenon and uncovers shocking swinging scandal

By Fatou Ferraro Mboup

Beauty creator Golloria George faces discriminatory backlash after criticising YSL blush

By Fatou Ferraro Mboup

I just found out that Betty Boop isn’t actually white, and I’m not coping well

By Abby Amoakuh

Gen Z are now bringing their parents to job interviews, proving helicopter parenting has gone too far

By Fatou Ferraro Mboup

TikToker reveals Molly-Mae Hague’s new brand, Maebe, is secretly using Couture Club creations