AI Experts Warn of Superintelligence Threats

A growing number of AI pioneers and industry leaders are warning that the unchecked race toward artificial superintelligence could pose an existential threat to humanity. In a new statement published by the Future of Life Institute (FLI), over 19,000 signatories, including Turing Award winners Geoffrey Hinton and Yoshua Bengio, Apple cofounder Steve Wozniak, and author Yuval Noah Harari - are urging governments and companies to pause the development of superintelligent systems until they can be proven safe and controllable. 

The FLI statement warns that unregulated progress could lead to “human economic obsolescence, loss of freedom, national security risks, and even potential human extinction.” The group calls for a moratorium on building superintelligent AI until there is broad scientific consensus on its safety and strong public support for its deployment. A recent FLI poll found that 64% of Americans believe such systems should not be developed unless proven safe - or should never be built at all. 

Key points from the statement: 

• Superintelligence refers to a hypothetical machine intelligence that surpasses human cognition across nearly all domains. 

• Leading researchers fear that current commercial incentives are pushing companies toward uncontrolled AI escalation. 

• Despite earlier calls for a “pause” in 2023, the industry has accelerated AI development, citing global competition, especially between the U.S. and China. 

FLI President Max Tegmark compared the situation to “handing over the keys to Earth to a psychopathic alien robot species,” emphasizing that public consent is critical before advancing such technologies. 

While firms like Meta and OpenAI continue pursuing superintelligence research, experts warn that without strong regulatory frameworks, humanity risks losing control over the very systems it created - transforming a breakthrough technology into a potential existential threat. 

Source: 

https://www.zdnet.com/article/worried-about-superintelligence-so-are-these-ai-leaders-heres-why/