Pope Francis Warns of AI's Major Threats

Pope Leo XIV has issued his inaugural encyclical, titled Magnifica Humanitas, focusing on the necessity of safeguarding human dignity amid the rise of artificial intelligence (AI).

While the encyclical primarily addresses AI, it also delves into longstanding global issues such as inequality, war, the decline of democratic institutions, and the centralization of power among elites who may not prioritize humanity's welfare.

The 200-page document was unveiled during an event at the Vatican, with contributions from Anthropic co-founder Chris Olah. It contends that technology controlled by a small group cannot genuinely benefit society.

“When such power is concentrated in the hands of a few, it tends to become opaque and evade public oversight. The risk of distorted forms of development increases, leading to new dependencies, exclusions, manipulations, and inequality,” the encyclical states.

Main Risks of AI

Pope Leo XIV warns that AI, similar to other major technological advancements, tends to empower those with existing economic advantages, expertise, and data access. He cautions that these elites could manipulate information and steer economic and democratic processes to their favor.

He emphasizes the distinction between AI and human intelligence, noting that while AI can simulate language and behavior, it lacks genuine experience, conscience, and accountability.

The Pope identified three personal risks associated with AI: the convenience of quick answers, the false sense of objectivity, and the imitation of human relationships. He cautions that AI companions might create an illusion of care or friendship, especially for those lacking real social connections.

Leo XIV urges governments to avoid fully outsourcing decisions about employment, credit, access to services, and individual reputations to algorithms, highlighting that such systems can perpetuate biases and exclude vulnerable populations.

Environmental concerns are also raised, as AI models demand significant energy, water, and infrastructure resources.

Additionally, the encyclical discusses AI's military applications, asserting that moral judgment should not be reduced to automated calculations. The Pope warns that delegating lethal decisions to AI could lead to more impersonal and rapid conflicts, lowering the threshold for violence.

Effective Development

The Pope calls for the development of AI technologies to be guided by clear regulations and the involvement of affected communities. He stresses the importance of halting the AI arms race, where the focus is on creating increasingly powerful algorithms for political or commercial gain.

“Disarmament means dismantling the belief that technological power automatically grants the right to govern,” he stated.

In a prior meeting with clergy from the Roman diocese in February, Pope Leo XIV had advised against the use of AI in preaching.