Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description

By Alma Fabiani

Published Apr 14, 2022 at 11:58 AM

Reading time: 2 minutes

AI research laboratory OpenAI is currently making headlines again for its latest invention DALL·E 2—or should we say, for its update to the success that was its predecessor, DALL·E. To put it simply, DALL·E 2 is a machine learning model that can generate stunning images from text descriptions in less time than ever before.

As many of you probably know, AI systems being able to create images and art from text is nothing new. We’ve previously seen how the technology could help transform your favourite celebrities into Disney characters or even how it could reimagine your childhood cartoon characters as humans. But DALL·E 2, when compared to other machine learning models out there, can generate more realistic and accurate images with four times greater resolution thanks to OpenAI’s advanced deep learning techniques. Not to mention the images are scarily realistic.

@karenxcheng

A demo of DALL-E 2 🤯 will be doing a live demo and taking audience requests, see my IG for details #dalle2 #openai #artificialintelligence

♬ original sound - Karen X

Announced on 6 April 2022 on the company’s Twitter account, the reveal of DALL·E 2 was accompanied by a thread of wonderful photos which quickly grabbed the attention of the platform’s users.

A short video that successfully harnessed the power of the technology—just letting you know, you’re about to see a Panda bear ice skating and a Koala bear dunk a basketball—and what it can do followed the thread:

Like every milestone OpenAI announcement, DALL·E 2 comes with a detailed paper as well as a unique landing page for enthusiasts to read more about how the machine learning model works. A video providing more of an overview of what the technology is capable of doing and what its limitations are has also been shared online.

If you’re not sure you’re up for reading the full paper on DALL·E 2, we’ve got you covered. To put it as simply as possible, the system is a generative model, which is a special branch of machine learning, that creates complex output instead of performing prediction or classification tasks on input data. Basically, you provide DALL·E 2 with a text description and it generates an image that fits the description.

Generative models are a hot area of research that received much attention with the introduction of generative adversarial networks (GAN) in 2014. You probably remember websites such as ThisPersonDoesNotExist or ThisStartUpDoesNotExist, right? Well, these were early examples of what GANs could help us do.

Since then, however, the field has seen tremendous improvements, and generative models have been used for a vast variety of tasks including creating artificial faces, deepfakes, synthesised voices, and more. What sets DALL·E 2 apart from other generative models is its capability to maintain semantic consistency in the images it creates. This consistency is clearly shown in OpenAI’s shared examples.

Let’s say you enter the description “Teddy bears shopping for groceries in the style of ukiyo-e” into the AI system. DALL·E 2 will offer you those images (among many others).

Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description

Now, imagine that you changed the description you’ve given it slightly to “Teddy bears shopping for groceries in ancient Egypt,” because why not? In only a few seconds, DALL·E 2 would give you some of these instead:

Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description

But what if you wanted those cute bears to be shown shopping again, only using a one-line drawing style instead?

Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description
Koala bears dunking basketballs? Meet the new AI tech creating realistic images from any description

The point is, the model remains consistent in the examples it offers you depending on the text prompt you give it. This same consistency shows itself in most examples OpenAI has shared so far. Furthermore, DALL·E 2 seems to understand depth and dimensionality, a great challenge for algorithms that process 2D images.

Even if the examples currently shown on OpenAI’s website were cherry-picked, they are still impressive. In fact, to prove how good the technology is, OpenAI’s CEO Sam Altman took to Twitter and asked users to suggest prompts to feed to the generative model. The results (see the thread below) are fascinating.

All that said, it remains to be seen how deep DALL·E 2’s commonsense and semantic stability goes, and how its successors will deal with more complex concepts such as compositionality. In the meantime, though OpenAI’s website invites enthusiasts to get on their waitlist for DALL·E access, in a blog post, Altman suggested a possible product launch as soon as this summer. So start prepping your written descriptions for an AI girl summer.

Keep On Reading

By Abby Amoakuh

After School Satan Club causes uproar in US elementary school

By Charlie Sawyer

Florida plans to expand Ron DeSantis’ Don’t Say Gay law into workplaces and ban use of preferred pronouns

By Abby Amoakuh

Donald Trump’s mental fitness comes into question as Joe Biden focuses on abortion

By Abby Amoakuh

GQ Australia Man of the Year Troye Sivan dominated 2023. Here are all the receipts

By Fatou Ferraro Mboup

Who was the goblin who crashed the 2024 Emmy Awards red carpet?

By Charlie Sawyer

Home Office to pay TikTok influencers up to £5K to warn migrants not to cross the Channel

By Charlie Sawyer

Family of man who died because of Google Maps sues tech giant

By Alma Fabiani

Cult leader accused of being behind 400 deaths including 191 children

By Alma Fabiani

Bad Bunny asks journalism students to help promote his new album

By Abby Amoakuh

Gen Z just played a crucial role in South Korea finally banning the dog meat industry

By Fatou Ferraro Mboup

North West’s performance with Kanye proves that 2024 is going to be her big year

By Alma Fabiani

TikTok trend has women telling men no one knew Travis Kelce before he dated Taylor Swift

By Alma Fabiani

Las Vegas Sphere to open in East London but here’s the issue…

By Jack Ramage

Is your boss tripping on acid? New research suggests so

By Fatou Ferraro Mboup

UK police left children at mercy of grooming gang paedophiles, review finds

By Charlie Sawyer

Russian scientist injects himself with 3.5-million-year-old bacteria to try and live forever

By Fatou Ferraro Mboup

Plane forced to turn back after horse breaks lose on board

By Emma O'Regan-Reidy

Do you watch or listen to content at 1.5x speed? Here’s what it actually does to you

By Abby Amoakuh

Celebrity podcaster Bobbi Althoff comes forward as deepfake porn video of her goes viral

By Charlie Sawyer

Is the internet finally falling out of love with Emma Chamberlain?