Can an artificial intelligence chatbot be subjected to cruelty? And if a user repeatedly mistreats it, should the chatbot be allowed to end the conversation?
These questions are at the centre of a new policy introduced by Anthropic, the company behind Claude, as debate continues over whether increasingly advanced AI systems could possess consciousness.
The San Francisco-based company has updated its usage policy for the first time in more than a year, introducing a restriction against “sustained and needless abusive or cruel behaviour” towards its AI models. The change, first reported by The Verge, is part of a wider policy revision addressing emerging risks associated with artificial intelligence, including election interference, weapons development and surveillance.