What happens when an artificial intelligence model is given a button that can stop its pain but pressing it could delete a person’s files or even give them a “painful zap”? Researchers found that AI models sometimes chose the button anyway.

A study involving 25 open-weight AI models identified what researchers called a “pain axis” – a distinct internal representation linked to harm directed at the model. The researchers found that the response differs from fear and general negative responses and is triggered by harm to the model rather than the user.