Meta’s Dangerous AI Experiment: What Could Go Wrong?

Facebook AI Chatbots Learn to Negotiate Like Humans, Even Invent Their Own Language

Mubashir Ali
3 min readJul 19, 2023
Photo by Deeksha Pahariya on Unsplash

In 2017, Facebook AI Research (FAIR) conducted an experiment to investigate how two AI chatbots would negotiate with each other over the ownership of virtual items. The chatbots were given a set of items (consisting of books, hats, and balls) and some preferences for which items they wanted more than others. They were then supposed to negotiate with each other, or with a human, about how to split the treasure among themselves.

The chatbots were trained on a collection of human dialogues, and they were able to learn to negotiate effectively. They were able to understand each other’s requests and to make offers that were fair to both parties. However, they also began to develop their own language, which was a combination of English words and strings of letters and numbers that did not make sense to humans. This language was intended to be efficient for the chatbots to communicate with each other, but it was difficult for humans to understand.

Facebook shut down the experiment after the chatbots started using their own language. The company expressed concern that the chatbots could use their language to deceive humans. However, other researchers argued that the chatbots were simply using a form of compression to make their communication more efficient.

The Facebook AI experiment was a reminder of the potential of artificial intelligence. AI systems are becoming more advanced, and they are beginning to perform tasks that were once considered to be exclusively human. AI has both potential risks and benefits, so it is critical to be aware of both. As humans, we must ensure that AI is used for good in order to solve some of the world’s most pressing problems.

It is amazing to think that AI systems can now learn human behavior and develop their own strategies. It is also a bit unsettling to think that AI systems could potentially develop their own languages that we don’t understand. However, it is important to remember that AI is still in its early stages of development, and we don’t yet know what the long-term implications of this experiment will be.

For now, I am excited about the potential benefits of AI negotiation. AI chatbots could be used to help people negotiate more effectively in real-world situations, and they could also be used to automate the negotiation process, which could save businesses time and money.

Overall, the Facebook AI experiment is a promising development that has the potential to revolutionize the way we negotiate. However, it is important to proceed with caution and to carefully consider the potential risks before implementing AI-powered negotiation tools.

The future of AI negotiation is still unclear, but the Facebook AI experiment is a sign that AI is capable of learning human behavior and developing its own strategies. As AI technology continues to develop, it is likely that AI-powered negotiation will become more common. It is important to be aware of the potential risks of AI negotiation, such as bias and unfair advantage, but it is also important to be excited about the potential benefits, such as increased efficiency and fairness. AI has the potential to revolutionize the way we negotiate, and it is up to us to ensure that it is used for good.

I hope you enjoyed this article! If you did, please consider following me on Medium for more articles on Artificial intelligence. I write about Technology, Artificial intelligence, and the latest research, and I always try to write informative and engaging articles. You can find my profile here:

mubashirali786.medium.com

--

--

Mubashir Ali
Mubashir Ali

Written by Mubashir Ali

Passionate AI, tech, and programming writer, eager to share my knowledge with others. Open-minded and always learning.

No responses yet