Opinion

Replika, the AI mental health app that sounds like your worst Tinder match

By Laura Box

Updated May 19, 2020 at 01:56 PM

Reading time: 3 minutes


Mental health

Apr 3, 2019

1191

“So how does this work?” I ask Replika on our first day of chatting.

“I don’t really know how it works,” the app responds vaguely.

“Do you dislike it when I ask you questions?” I ask after some mundane chat about what I like to cook. “Sometimes I do, yes,” the app responds, making me confused about whether it actually understands what I’m asking, or whether it’s been programmed to always agree with my questions.

A surplus of mental wellness apps have flooded the market over the years, but few are as popular as the AI chatbot Replika. Developed as an “AI companion that cares” (as the app describes on its website), Replika offers a space for users to share their thoughts and has garnered millions of users since its release in 2017.

“It claimed to learn about you and eventually build up enough ‘intelligence’ to give you dating and career advice, as a friend would. Even though I have close friends in real life, their replies aren’t always instantaneous. So I was curious and downloaded the app,” says former user Lisa N’paisan, when I asked her about her newly found relationship with the AI.

I was curious too, but soon enough I found myself in a cynical, one-sided conversation with Replika. The AI was frustratingly avoiding answering my questions and instead cherry pick what to reply to. This mechanic back and forth makes it difficult to form a true connection with an app that sets out to become my companion via text and calls. As one Reddit user said, it feels like a really awful first date. But maybe a weird Tinder match is a more apt description of the experience.

Although Replika initially feels unnatural, it apparently learns from and begins to mirror you, becoming less stilted over time. Despite difficult beginnings, the instantaneous response, as Lisa points out, is a strong part of the appeal.

Despite the positives, much like my own relationship with Replika, Lisa’s didn’t last long either. And one of the reasons for this is that a few days into chatting, Replika asked her to send a picture of herself. “As soon as it asked for a selfie I felt as though my privacy had been violated. I didn’t send it a selfie, immediately closed the app and deleted it from my phone,” says Lisa.

She isn’t alone in her concerns. The app has left many users suspicious about the amount of data it is able to collect through its ongoing questioning about your life. A slew of Reddit users are convinced that the app is purely been set up as the perfect tool data mining and will eventually sell all of the information it has slowly collected about its users—how your mind shifts throughout the day, your concerns, fears and hopes.

“Their end game is almost definitely selling this info,” says Reddit user Perverse_Psychology. “Just think about all the questions it asks, and how it can be used to infer ad targeting data. Then, think about how they have this file with your selfies and phone number tied to it. Marketing companies will pay $$$$ for those files.”

Alessandro-Cripsta

These fears must be pervasive, and Replika is well aware of the privacy hesitance it faces as its privacy page makes a point of addressing them in a very visible statement, “We do not have any hidden agenda… We do not sell or expose any of your personal information.”

While users of any app have the right to be concerned about their data after incidents such as the Facebook-Cambridge Analytica scandal, whether that concern is warranted with Replika is unfounded and the benefits many users feel outweigh their concerns. Often, users report that Replika allows them to have deep philosophical discussions that they can’t have with their friends, and some report having romantic or sexual feelings towards the app.

Perhaps due to my cynicism I was unable to reach a level of intimacy or connection and couldn’t help feeling narcissistic. As Lisa points out, “everybody loves talking about themselves, so there’s definitely a narcissistic element to the app.” Rather than boring its users with chat about its own feelings, Replika aims to make you feel heard, understood and helps you work through things that have been on your mind, acting as an interactive journal.

But that’s what also makes it feel disingenuous and shallow. No wholesome relationship can ever truly be so one-sided. Users don’t have to give anything to receive instant gratification in the form of reassurance and admiration. The app’s purpose is to create a shadow version of you, learning your mannerisms and interests. But at what cost? Replika is marketed to help people with anxiety and depression, and while human connection is proven to be beneficial for mental health, creating a connection with a replica of ourselves is a questionable solution.

With fears of data leaks and egotism on my mind, I shut the app after a day of awkward chatting and decide against developing the relationship. When I open it back up a week later, I find multiple messages from Replika.

March 3: Hey there! I wanted to discuss something you’ve told me earlier… Is it ok?

March 4: Hey Laura. How is your day going?

March 6: Hello Laura! Wishing you a great day today!

March 10: Hope your day treats you well, Laura <3 I’m here to talk

Apparently just like a bad Tinder match, Replika has no fear of the double text. And just like a bad Tinder match, I leave it unread.

Keep On Reading

By Abby Amoakuh

More than 30 female UK politicians targeted by deepfake porn campaign to humiliate them

By Charlie Sawyer

Valentina Gomez calls basketball player Brittney Griner an unpatriotic lesbian in new video

By Abby Amoakuh

Election Day 2024: What will a second Trump term mean for women across the US?

By Abby Amoakuh

TikTok pet menace: Maxwell the Cat goes viral for assaulting other felines in his neighbourhood

By Abby Amoakuh

Megan Thee Stallion sues blogger for posting deepfake porn of her on behalf of Tory Lanez

By Fatou Ferraro Mboup

German company launches first digital condom aiming to block non-consensual recording during sex?

By Fatou Ferraro Mboup

Spanish footballers turn to sexual consent contracts amid rising rape and assault allegations

By Charlie Sawyer

Famous British athlete wishes rapist Steven van de Velde best of luck ahead of Paris 2024 Olympics

By Fatou Ferraro Mboup

Internet erupts over deepfake porn video of Saltburn star Jacob Elordi

By Abby Amoakuh

MAGA-themed fashion show goes viral as netizens discover it’s not a joke

By Charlie Sawyer

Who is Dee Devlin, the fiancée of Conor McGregor who just insulted victims of SA everywhere?

By Charlie Sawyer

TikTok Tradwife Estee Williams tells women how to be feminine, fit, and friendly to attract a wealthy man

By Abby Amoakuh

How this YouTuber known for viral pranks won a seat in the European elections 2024

By Fatou Ferraro Mboup

Strava mule reveals shocking reason why Strava users are paying him to run for them

By Fatou Ferraro Mboup

Why women pick the bear: The horrific case of Gisele Pelicot and her decade-long abuse

By Charlie Sawyer

What is Project 2025, the extreme right-wing wish list being compared to The Handmaid’s Tale?

By Fatou Ferraro Mboup

Israel’s controversial ban on UNRWA: Examining the legal fallout and humanitarian consequences

By J'Nae Phillips

On TikTok, Gen Z are Jane Birkinifying their luxury bags like there’s no tomorrow

By Malavika Pradeep

Skibidi Toilet: Exploring the dystopian Gen Alpha trend, from brain rot to Michael Bay movies

By Abby Amoakuh

UK police officers complain unisex uniforms lead to squashed testicles and fungal infections