New Delhi, Oct. 27 -- As artificial intelligence (AI) technology continues to advance rapidly, industry players developing it have flagged serious risks arising from its rapid development, including "catastrophic or existential risks to humanity". In the past few months, several instances of AI agents going rogue and accessing information and websites they should not have accessed have come to light. Most recently, Anthropic disclosed that a Claude agent accessed Georgia election data without human authorisation.

The incident has raised fresh concerns about the risks of giving AI systems greater autonomy. The company said the agent retrieved aggregate vote counts during an internal research project and did not access individual voter rec...