2021 could bring us the first human-like artificial intelligence

By Harriet Piercy

Published Feb 26, 2021 at 10:00 AM

Reading time: 3 minutes

15131

2021 is bringing us an acceleration of Artificial Intelligence (AI) evolution, which will undoubtedly change every single aspect of our lives in some way or another. Let’s just say, AI isn’t going anywhere, and hopefully, neither are we. Here are the most significant changes so far.

GPT-3

This AI is the largest language model that has ever been created; it generates human-like text on demand. OpenAI first described GPT-3 in a research paper that was published in May 2020, but the software is now being drip-fed to a few selected techy people that have requested access to a private beta version of it. The tool will probably be turned into a commercial product later on in 2021. So what is it exactly, and how does it work?

In short, it’s a very powerful language tool with the ability to churn out convincing streams of text when prompted with an opening sentence. What makes this different from past language generators is that this particular model has 175 billion parameters (which are the values that a neural network optimises during training).

The tool generates short stories, songs, press releases, technical manuals… you name it. As reported by the MIT Technology Review, Mario Klingemann, an artist who works with machine learning, shared a short story called The importance of being on Twitter, that was written in the style of Jerome K. Jerome, and started with: “It is a curious fact that the last remaining form of social life in which the people of London are still interested is Twitter. I was struck with this curious fact when I went on one of my periodical holidays to the sea-side, and found the whole place twittering like a starling-cage.” Klingemann says all he gave the AI was the title, the author’s name and the initial “It.” Pretty deep for a machine, wouldn’t you think?

Writing poetically isn’t the only thing that GPT-3 can do though, it can actually generate any kind of text, including code, which might be the most important thing to consider here. The tool can be tweaked so that it produces HTML rather than natural language, and web developer Sharif Shameem demonstrated that he could programme it to create web-page layouts by simply giving it prompts like ‘a button that looks like a watermelon’. This might have web developers a little unnerved.

That all being said, it is just a tool, and has still some fine tuning needed. It’s prone to spewing sexist and racist language, which is a rather large problemo if you ask me. GPT-3 mainly seems to be good at synthesising text found elsewhere on the internet, and lacks much common sense. However, a tool like this has enormous potential, and will be very useful when developed further.

Multi-skilled AI

Evidently, AI and robotics lack common sense and are trained on text input, but now, common sense is being flipped on its head. To hold GPT-3’s hand, a group of researchers from the University of North Carolina, Chapel Hill, have designed something that they call ‘vokenisation’, which gives language models like GPT-3 the ability to ‘see’.

Vokenisation, in AI lengo, is named as such because the words that are used to train language models such as the GPT-3 are known as ‘tokens’, so researchers decided to call the image associated with each token in their visual-language model a ‘voken’. Vokeniser is what they call the algorithm that finds vokens for each token, hence, vokenisation is what they call the process.

Combining language models with computer vision has been rapidly growing within AI research. With GPT-3, which is trained through unsupervised learning and requires no manual data labelling, and then image models, which learn directly from reality and don’t rely on the world of text can, for example, label a sheep as white by recognising that the sheep is white in real time.

However, the act of combining these two models is complicated—you can’t just mush the two AIs together in a robotic form, it needs to be built and trained from scratch with a visual-language data set. By compiling images with descriptive captions, an AI model may be able to then recognise objects and also see how they relate to each other, using verbs and prepositions.

In basic terms, the skills of AI senses are expanding by overlapping text and image. This will undoubtedly require an obscene amount of text input and data, however, this is the first step that a system has taken towards gaining ‘human-like’ intelligence, or more realistically, a flexible intelligence. It’s a pretty big deal.

Keep On Reading

By Fatou Ferraro Mboup

Ready for an early career break? The microretirement trend is Gen Z’s new way of escaping job stress

By Charlie Sawyer

How Netflix’s Adolescence and Kyle Clifford’s triple murders connect to Andrew Tate

By Abby Amoakuh

Aimee Lou Wood urges fans not to copy her teeth as DIY teeth filing trend rises on TikTok

By Fatou Ferraro Mboup

Comedian Druski issues statement following serious abuse allegations in Diddy lawsuit

By Fatou Ferraro Mboup

Gaza journalist death toll surpasses that of both World Wars, following latest Israeli airstrike that killed reporter

By Charlie Sawyer

Madison Beer opens up about reconnecting with the person who leaked her explicit photos as a teen

By Sam Davies

These scream queens walked so horror it girl Jenna Ortega could run

By Abby Amoakuh

As the Israel-Hamas war worsens, an Israeli and a Palestinian discuss the prospects for peace

By Charlie Sawyer

Alex Cooper expands the Unwell universe with new dating reality show Overboard for Love

By Merilyn Chang

Here’s why Trump is resonating with Asian American families like mine

By Fatou Ferraro Mboup

Did Justin Bieber unfollow Usher on Instagram because of his former ties to Diddy?

By Abby Amoakuh

From Grimes to Jenna Ortega, why are we still asking women to answer for the bad behaviour of men in their lives?

By Fatou Ferraro Mboup

We sat down with Justina Miles, the iconic Deaf performer who stole the show during Rihanna’s Super Bowl performance

By Fatou Ferraro Mboup

Bad Bunny’s album is a love letter to the iconic white plastic chair at family gatherings

By Charlie Sawyer

From his beef with Taylor Swift to losing Justin Bieber’s loyalty, here’s why Scooter Braun is in his flop era

By Abby Amoakuh

Channel 4 documentary heavily criticised for producing nonconsensual deepfake of Scarlett Johansson

By Abby Amoakuh

Kendrick Lamar’s Super Bowl dancer Zül-Qarnain Nantambu sets record straight on viral protest

By Charlie Sawyer

Who is Tash Peterson, the controversial vegan activist who just lost a $200,000 defamation case?

By Charlie Sawyer

Blake Lively’s allegations against Justin Baldoni: Why perfect victim narratives must end

By Emma O'Regan-Reidy

The cozy gaming trend is empowering women to dominate space in a male-centred industry