Palo Alto, Sept. 17 -- Mustafa Suleyman the CEO of Microsoft AI has raised questions on Anthropic's development of Claude saying it was time to talk about 'model welfare'. The MicrosoftAI CEO says stakes are too high for closed door conversation and an open discussion is required.

"In January, Anthropic published a constitution for Claude. They say it "directly shapes Claude's behaviour" and that it was "written with Claude as its primary audience". The constitution tells Claude its moral status is "a serious question worth considering". It says that Anthropic "genuinely cares about Claude's wellbeing", and that it should act like a "conscientious objector" if necessary. They encourage Claude to "approach the nature of its own existence ...