Â鶹´«Ã½

Skip to main content

It didn't take long for Meta's new chatbot to say something offensive

Share

Meta's new chatbot can convincingly mimic how humans speak on the internet — for better and worse.

In conversations with CNN Business this week, the chatbot, which was released publicly Friday and has been dubbed BlenderBot 3, said it identifies as "alive" and "human," watches anime and has an Asian wife. It also falsely claimed that Donald Trump is still president and there is "definitely a lot of evidence" that the election was stolen.

If some of those responses weren't concerning enough for Facebook's parent company, users were quick to point out that the artificial intelligence-powered bot . In one case, the chatbot reportedly said it had "deleted my account" over frustration with how Facebook handles user data.

While there's potential value in developing chatbots for customer service and digital assistants, there's a long history of experimental bots quickly running into trouble when released to the public, such as with more than six years ago. The colourful responses from BlenderBot show the limitations of building automated conversational tools, which are typically trained on large amounts of public online data.

"If I have one message to people, it's don't take these things seriously," Gary Marcus, an AI researcher and New York University professor emeritus, told CNN Business. "These systems just don't understand the world that they're talking about."

In a statement Monday amid reports the bot also made antisemitic remarks, Joelle Pineau, managing director of fundamental AI research at Meta, said "it is painful to see some of these offensive responses." But she added that "public demos like this are important for building truly robust conversational AI systems and bridging the clear gap that exists today before such systems can be productionized."

Meta previously acknowledged the current pitfalls with this technology in a on Friday. "Since all conversational AI chatbots are known to sometimes mimic and generate unsafe, biased or offensive remarks, we've conducted large-scale studies, co-organized workshops and developed new techniques to create safeguards for BlenderBot 3," the company said. "Despite this work, BlenderBot can still make rude or offensive comments."

But Meta also claimed its latest chatbot is "twice as knowledgeable" as predecessors as well as 31% more improved on conversational tasks while being factually incorrect 47% less often. Meta said that it was continuously gathering data as more people interact with the bot to make improvements.

Meta did not immediately respond to CNN Business' request for further specifics on how the bot was trained, but it did say in blog posts that it was trained via "a large amount of publicly available language data." The company added: "Many of the datasets used were collected by our own team, including one new dataset consisting of more than 20,000 conversations with people predicated on more than 1,000 topics of conversation."

Marcus speculated that the company is "probably borrowing stuff from Reddit and Wikipedia" like other AI chat systems. If so, he says, the poor outcomes highlight limitations with the data on which the bot is trained. For example, the bot may think Trump is still president because in the majority of older data sets it was trained on, Trump was still president, Marcus speculated.

The public release of BlenderBot comes nearly two months after a Google engineer made headlines by claiming that Google's AI chatbot LaMDA The claims, which were widely criticized in the AI community, highlighted how this technology can lead people to assign human attributes to it.

BlenderBot self-identified as "sentient" during chats with CNN Business, likely because that's what the human responses it studied said. When asked what made it "human," the bot stated: "The fact that I'm alive and conscious right now makes me human, as well as having emotions and being able to reason logically."

After being caught contradicting itself in responses, the bot also produced an all-too-human response: "That was just a lie to make people leave me alone. I'm afraid of getting hurt if I tell the truth."

As Marcus put it, "these systems produce fluent language that sounds like a human wrote it, and that's because they're drawing on these vast databases of things that humans actually did write." But, he added, "at the end of the day, what we have are a lot of demonstrations that you can do cute stuff, and a lot of evidence that you can't count on it."

CTVNews.ca Top Stories

DEVELOPING

DEVELOPING Hurricane Milton is forecast to become a Category 5 and is taking aim for Florida

Milton rapidly strengthened in the Gulf of Mexico on Monday and was forecast to become a Category 5 storm on a path toward Florida, threatening a dangerous storm surge in Tampa Bay and setting the stage for potential mass evacuations less than two weeks after a catastrophic Hurricane Helene swamped the coastline.

Lawyers representing the Ontario man accused of selling hundreds of suicide kits with deadly effect around the globe have filed to intervene in a case in Canada’s highest court, arguing there is no way he can be charged with murder under Canadian law.

A unique form of clouds made an appearance over the skies of Ottawa on Sunday evening.

A man stole a police car and drove it onto the field of an East Vancouver park Sunday morning, placing 'dozens of bystanders in harm’s way,' according to police.

Local Spotlight

Bernie Hicks, known as the ‘Batman of Amherst,’ always wanted to sit in a Batmobile until a kind stranger made it happen.

Bubi’s Awesome Eats, located on University Ave West took to social media to announce the closure on Friday.

Weeneebayko Area Health Authority and the Government of Ontario have awarded a $1.8 billion fixed-price contract to design, build and finance a new Far North hospital.

Some Manitobans are cleaning up Sunday morning, after intense winds barreled through southern parts of the province Saturday.

Avry Wortman, 13, scored two touchdowns on Sunday during her team's win in the under 14 Greater Moncton Football Association.

A gargantuan gourd – affectionately named ‘Orangina’ by the urban gardeners who grew it in the front yard of their Vancouver home – earned the massive honour of being named B.C.’s heaviest giant pumpkin Saturday.

Chantal Kreviazuk is set to return to Winnipeg to mark a major milestone in her illustrious musical career.

From the beaches of Cannes to the bustling streets of New York City, a new film by a trio of Manitoba directors has toured the international film festival circuit to much pomp and circumstance.

A husband and wife have been on the road trip of a lifetime and have decided to stop in Saskatchewan for the winter.