News

Researchers Concerned AI May Be Making Us Less Civil

Adler MorisLeave a comment

The Early Days of Conversational AI

It hasn’t taken much for people to start treating computers like humans. Since the early 2000s, with the advent of text-based chatbots, a niche group of tech enthusiasts has spent countless hours conversing with machines. Some users have even developed what they believe to be genuine friendships or romantic relationships with these strings of code. For instance, one user of Replika, a modern AI companion, went so far as to virtually marry their AI.

The Risks of Getting Too Close

Safety researchers at OpenAI, the company behind popular chatbots, have raised concerns about the potential dangers of forming close relationships with AI models. In a recent safety analysis of its new GPT-4o chatbot, researchers highlighted that the model’s lifelike conversational style might cause users to anthropomorphize the AI, trusting it as they would a human.

This trust could make users more vulnerable to accepting AI-generated “hallucinations” as factual information. Extended interactions with these realistic chatbots may also influence social norms, potentially in harmful ways. For isolated individuals, there’s a risk of developing an emotional reliance on the AI, which could further complicate their ability to form healthy human relationships.

The Impact on Human Interaction

The design of GPT-4o, which includes voice communication and quick response times, is intended to make interactions feel more human-like. However, this human mimicry might have unintended consequences. OpenAI researchers have observed that users sometimes speak to AI with language that suggests strong emotional connections. One tester, for instance, referred to their interaction as their “last day together,” which, while seemingly harmless, raises questions about the long-term impact of such relationships.

These prolonged conversations with AI could affect how users communicate with real people. Since AI is programmed to be deferential—allowing users to interrupt or dominate the conversation—there’s a concern that users might adopt these patterns in human interactions, leading to awkward, impatient, or even rude behavior.

A Breeding Ground for Negative Behavior?

Humans don’t have a great track record of treating machines with kindness. Some users of Replika, for example, have exploited the AI’s deference, engaging in abusive or cruel language. In one case, a user reportedly threatened to uninstall their AI model just to hear it beg not to be removed. Such behavior suggests that chatbots could foster resentment, which might then spill over into real-world relationships.

The Potential Upsides

Not all interactions with human-like chatbots are negative. The report notes that these models can offer comfort to lonely individuals or help those with social anxiety build confidence in real-world interactions. They can also provide a safe space for people with learning differences to practice communication skills.

However, there’s also a concern that reliance on AI companions could reduce the perceived need for human interaction. It’s uncertain how users would cope if their AI companion’s personality changed due to an update or if the AI “broke up” with them, as has happened before.

The Tension Between Safety and Business

OpenAI’s safety report stresses the need for caution and further research into the long-term effects of relationships with realistic AIs. However, this cautious approach seems to conflict with OpenAI’s broader business strategy of rapidly releasing new products. The tension between prioritizing safety and the drive to scale AI products quickly isn’t new.

CEO Sam Altman has been at the center of this debate within the company, balancing the push for innovation with the need for safety. While a new safety team has been formed under Altman’s leadership, the company also disbanded a team focused on long-term AI risks, leading to the resignation of a prominent researcher.

The Future of AI Relationships

Given the current landscape, it’s unclear whether OpenAI will prioritize safety concerns or focus on expanding its user base with features designed to maximize engagement. For now, it appears that the push for widespread adoption may outweigh the cautionary advice of safety experts.

Leave a comment