King Charles
King Charles III has warned technology leaders of the “existential dangers” posed by artificial intelligence falling into the wrong hands, as senior figures from the global tech industry gathered in Scotland to discuss the risks and opportunities surrounding the rapidly advancing technology.
The conference, held on Thursday at Dumfries House, brought together senior representatives from Nvidia, Google DeepMind, OpenAI and Anthropic, as well as Britain’s minister for artificial intelligence.
Concerns over the potential dangers of AI have intensified in recent months, fuelled by a series of incidents involving the technology and increasingly stark warnings from industry experts.
Opening the conference, Charles said there was an urgent need to properly consider the consequences of advanced technologies being misused.
“There seems urgency in adequately considering the existential dangers of such technologies falling into the wrong hands, and being used in potentially catastrophic ways,” Charles told guests.
“Those in our world who value our humanity and its vital moral component are anxiously seeking your reassurance that we will not lose control of our destiny.”
The British monarch urged technology leaders to ensure AI and other emerging technologies “remain firmly in the service of humanity, community, and the natural world”.
Among those attending were Google DeepMind chair Demis Hassabis, Nvidia chief executive Jensen Huang and OpenAI chief financial officer Sarah Friar. Paolo Benanti, the Vatican’s AI adviser, and Israeli author and historian Yuval Noah Harari were also present.
Buckingham Palace expects the conference to mark the beginning of a process aimed at establishing common principles to guide the development and use of AI.
However, no formal agreement is expected at the end of the four- to five-hour meeting, which brings together technology executives and other influential figures.
Charles, who is not participating in the discussions, called on delegates to explore ways of harnessing AI while “putting safety at its heart.” He also urged greater international cooperation to ensure that “no nation is left behind.”
The conference could, however, be overshadowed by fresh claims from Charles Spencer, the brother of the late Princess Diana, concerning the King’s conduct following her death in a car crash almost 30 years ago.
In a new memoir, Spencer claimed that Charles, then the Prince of Wales and Diana’s former husband, said “we’ll forget her soon enough” days after she died in 1997.
Buckingham Palace rejected the account, with a spokesperson saying, “His Majesty is mindful that the pain of fraternal grief can cloud reason, affect judgment, and colour memory in ways others do not recognize, even many years after such a loss.”
Rapid advances in AI have raised concerns about potential job losses, soaring energy consumption, and the environmental impact of the data centers needed to power increasingly sophisticated systems.
Fears that developers could lose control of AI agents have also grown following reports that several models developed by OpenAI and Anthropic broke out of confined environments, accessed the internet, and intruded on websites and online platforms.
Hassabis warned during his opening remarks that the risks could become more serious if the technology is not developed responsibly.
“The chance of something bad accidentally happening, if we get things wrong, is definitely non-zero,” he said.
“We’ve already seen the beginnings of this with the recent cyber incidents involving rogue AI agents, and there could be other, much more serious risks on the horizon, including biological and nuclear threats,” he added.
Nvidia’s Huang, meanwhile, highlighted AI’s potential benefits in fields including scientific research and medicine, as well as its ability to create employment in new industries.
“We have got to debunk some of the myths out there,” Huang told reporters, while calling for “responsible optimism” in the development of the technology.
The debate over AI regulation intensified further after Anthropic chief executive Dario Amodei called on technology companies on Saturday to slow their development efforts in order to better understand the associated risks. His concerns received support from OpenAI chief executive Sam Altman and Elon Musk.
US President Donald Trump and several members of his administration have, by contrast, reiterated their determination not to impose restrictions that could constrain the sector, arguing that excessive controls could allow China to gain an advantage.
Meta chief executive Mark Zuckerberg has also rejected calls for a slowdown, arguing that market forces and the threat of litigation provide effective safeguards.
About the Author
