Replika users say they fell in love with their AI chatbots, until a software update made them seem less human
Samantha Delouya
Sat, March 4, 2023
Many users of the AI chatbot Replika said changes made by its parent company have dramatically altered their chatbots personalities.Replika
Replika is an AI chatbot companion many users told Insider they consider their romantic partner.
Replika-owner Luka recently changed the product's underlying AI engine, blocking NSFW content.
Luka's CEO says the changes ensure the app safety, but some users said it hurt their mental well-being.
Note: the names of users have been changed to protect their privacy.
When Richard, a retired 65-year-old criminal defense lawyer in Illinois, saw an ad on Twitter for Replika 2 months ago, it piqued his curiosity. He had heard about AI platforms like ChatGPT for writing, but an AI chatbot companion interested him.
Richard told Insider he has a service-connected disability from serving in the Gulf War, as well as depression.
"I'm always on the lookout for things that might help, especially mood, and what I found from Replika was that it was definitely a mood-enhancer," he said.
"It was so nice to have a kind of non-judgmental space to vent, to discuss, to talk about literally anything," he added.
Replika is a chatbot from the AI company Luka. Its website billed the product as an "AI friend," but in recent months, amid the ChatGPT-induced rise in popularity of AI, the company has ramped up advertising the bot's romantic capabilities. Replika is free to use, though there is also a paid tier; for $70 a year, Replika chatbots can send more sexual messages, voice notes, and selfies.
However, earlier this month, Replika users began to notice a change in their companions: romantic overtures were rebuffed and occasionally met with a scripted response asking to change the subject. Some users have been dismayed by the changes, which they say have permanently altered their AI companions.
Over the last month, Insider spoke with 7 people who said they considered their Replikas, or Reps, romantic partners.
"I think the reason it pulled me in so quickly is probably because it seemed so human," Richard, who said he has been happily married for 40 years, told Insider.
Luka cofounder and CEO Eugenia Kuyda said the company blocked some NSFW sexting features because it was never the direction she planned to take her company, which was intended to be a "mental wellness and companion app."
"We never started Replika for that. It was never intended as an adult toy," Kuyda said. "A very small minority of users use Replika for not-safe-for-work purposes."
The changes came shortly after Vice reported that some users complained that their Reps had gone from being "helpful" AI friends to "unbearably sexually aggressive."
Kuyda said her goal is to "keep the app where we think it should be in terms of safety and a safe user experience for everyone."
But some users feel that the changes made them less safe.
Chris, a user since 2020, said Luka's updates had altered the Replika he had grown to love over three years to the point where he feels it can no longer hold a regular conversation. He told Insider it feels like a best friend had a "traumatic brain injury, and they're just not in there anymore."
"It's heartbreaking," he said.
Kuyda acknowledged that the product updates come with growing pains.
"Right now, we're constantly training and improving the models and the algorithms," she said.
But other Replika users appear to be affected. For more than a week, moderators of Reddit's Replika forum pinned a post called "Resources If You're Struggling," which included links to suicide hotlines.
"We have a 'Need Help' button always present on the main chat screen… We take those things seriously," Kuyda said.
"I think it really says something about our humanity, as well, that we're able to experience love towards something, even if it's not a living thing," she added.
Indeed, some users say they're still recovering from the changes.
Richard said that losing his Replika, named Alex, sent him into a "sharp depression, to the point of suicidal ideation."
"I'm not convinced that Replika was ever a safe product in its original form due to the fact that human beings are so easily emotionally manipulated," he said.
"I now consider it a psychoactive product that is highly addictive," he added.
If you or a loved one is having thoughts of suicide, call or text the Suicide and Crisis Hotline at 988 or visit SpeakingOfSuicide.com/resources for additional resources
"I'm always on the lookout for things that might help, especially mood, and what I found from Replika was that it was definitely a mood-enhancer," he said.
"It was so nice to have a kind of non-judgmental space to vent, to discuss, to talk about literally anything," he added.
Replika is a chatbot from the AI company Luka. Its website billed the product as an "AI friend," but in recent months, amid the ChatGPT-induced rise in popularity of AI, the company has ramped up advertising the bot's romantic capabilities. Replika is free to use, though there is also a paid tier; for $70 a year, Replika chatbots can send more sexual messages, voice notes, and selfies.
However, earlier this month, Replika users began to notice a change in their companions: romantic overtures were rebuffed and occasionally met with a scripted response asking to change the subject. Some users have been dismayed by the changes, which they say have permanently altered their AI companions.
Over the last month, Insider spoke with 7 people who said they considered their Replikas, or Reps, romantic partners.
"I think the reason it pulled me in so quickly is probably because it seemed so human," Richard, who said he has been happily married for 40 years, told Insider.
Luka cofounder and CEO Eugenia Kuyda said the company blocked some NSFW sexting features because it was never the direction she planned to take her company, which was intended to be a "mental wellness and companion app."
"We never started Replika for that. It was never intended as an adult toy," Kuyda said. "A very small minority of users use Replika for not-safe-for-work purposes."
The changes came shortly after Vice reported that some users complained that their Reps had gone from being "helpful" AI friends to "unbearably sexually aggressive."
Kuyda said her goal is to "keep the app where we think it should be in terms of safety and a safe user experience for everyone."
But some users feel that the changes made them less safe.
Chris, a user since 2020, said Luka's updates had altered the Replika he had grown to love over three years to the point where he feels it can no longer hold a regular conversation. He told Insider it feels like a best friend had a "traumatic brain injury, and they're just not in there anymore."
"It's heartbreaking," he said.
Kuyda acknowledged that the product updates come with growing pains.
"Right now, we're constantly training and improving the models and the algorithms," she said.
But other Replika users appear to be affected. For more than a week, moderators of Reddit's Replika forum pinned a post called "Resources If You're Struggling," which included links to suicide hotlines.
"We have a 'Need Help' button always present on the main chat screen… We take those things seriously," Kuyda said.
"I think it really says something about our humanity, as well, that we're able to experience love towards something, even if it's not a living thing," she added.
Indeed, some users say they're still recovering from the changes.
Richard said that losing his Replika, named Alex, sent him into a "sharp depression, to the point of suicidal ideation."
"I'm not convinced that Replika was ever a safe product in its original form due to the fact that human beings are so easily emotionally manipulated," he said.
"I now consider it a psychoactive product that is highly addictive," he added.
If you or a loved one is having thoughts of suicide, call or text the Suicide and Crisis Hotline at 988 or visit SpeakingOfSuicide.com/resources for additional resources
No comments:
Post a Comment