Language Settings
Select Website Language

GDPR Compliance

We use cookies to ensure you get the best experience on our website. By continuing to use our site, you accept our use of cookies, Privacy Policy, and Terms of Service.

King Charles Warns AI Executives of 'Existential Danger'

1 hour ago

3

0

King Charles told leaders from Nvidia, OpenAI and Anthropic at a Dumfries House summit that AI in the wrong hands poses existential dangers.

King Charles has told a gathering of the world's leading artificial intelligence executives that the technology poses "existential dangers" if it falls into the wrong hands. He delivered the warning on 17 September 2026 at a summit he convened at Dumfries House in Ayrshire, Scotland, to examine how AI can be steered to benefit society.

The meeting drew senior figures from AI companies including Nvidia, OpenAI and Anthropic, alongside Kanishka Narayan, the UK's AI Minister, and an advisor to the Pope. The King used his address to press the executives on the responsibilities that come with building rapidly advancing systems.

"Those who have created these technologies are now increasingly warning that AI risks developing darker capacities - perhaps even to take life," the King told the room. He said there appeared to be an "urgency" in "adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways."

He framed the challenge directly for those building the systems. "The task before you is not merely to advance technology, but to ensure that it remains firmly in the service of humanity, community and the natural world," he said. The summit was called to consider whether a "shared set of principles" could be developed to "help guide the future application" of AI.

The warning lands amid a run of recent alarms sounded by people working inside the industry itself, who have flagged the fast-changing abilities of advanced or "frontier" AI models and questioned whether current oversight is strong enough to contain them.

Jensen Huang on safety and open models

Jensen Huang, chief executive of Nvidia, was among the industry leaders present. Nvidia sits at the centre of AI infrastructure, supplying the chips used by model developers including OpenAI and Meta, and it is now the world's most valuable company, with a stock market value of around $5.15tn.

Huang told the meeting that safety was "paramount" and said companies should be prepared to hold back a product and "keep engineering" it if it was not yet safe enough. He also argued for the value of open models - systems that give users direct access to the underlying software - as a way to "ensure that people and countries are not left behind."

Those systems, he said, must be protected so that "researchers, universities, start-ups and countries" can build applications "none of us would have imagined alone." He closed with a call to "lead with responsible optimism, build AI safely and securely, open it to more people, expand our ambition and solve the problems that matter to the world."

Hassabis warns AGI is 'a few short years away'

Sir Demis Hassabis, who co-founded the UK AI lab DeepMind before it was acquired by Google, struck a more cautious note on the speed of progress. He said artificial general intelligence - systems thought capable of matching or surpassing humans across many tasks - was "probably only a few short years away" and could carry an impact "ten times that of the Industrial Revolution."

The risk of something going wrong, he added, was "definitely non-zero." But he made the case for what he called "a sensible middle way," arguing that humanity could manage the dangers if it was collectively given the space and time to do so. "The future is not yet written," he told the King's delegates.

Sarah Friar, OpenAI's chief financial officer, said AI held the potential to solve some of society's "hardest problems" while acknowledging that its growing capabilities raised questions about safety and "how we ensure it always serves people."

"We need to address those questions together," Friar said. "No one company or government can do that alone, and I'm grateful to His Majesty for convening this discussion." The range of voices at Dumfries House - from a chip maker at the heart of the AI boom to a researcher forecasting near-term general intelligence - underscored the summit's central aim: agreeing on common principles before the technology outpaces the rules meant to govern it.

King Charles AI, AI existential danger, Dumfries House summit, Jensen Huang Nvidia, Demis Hassabis AGI, AI safety, OpenAI Anthropic, frontier AI regulation

Click here to Read More
Previous Article
Activision to Build Next Halo Game as Xbox Cuts 268 More Jobs
Next Article
2027 Hyundai Tucson Detailed 245 PS Hybrid, Auto-Reverse Tech

Related Technology Updates:

Are you sure? You want to delete this comment..! Remove Cancel

Comments (0)

    Leave a comment