Currently, leading AI models require human supervision to improve. However, the theory of “recursive self-improvement” suggests a future in which AI could become fully autonomous, raising existential concerns.
Recursive self-improvement refers to AI advancing to the point where it can continually enhance itself and create successors.
AI is rapidly improving and nearing human intelligence, which is my biggest concern, said a former Google DeepMind researcher who founded the AI safety nonprofit Sampura Research.
In a doomsday scenario of recursive self-improvement, AI becomes so intelligent that it resembles “an alien taking over the world.” He is less convinced by this future but is concerned about the rapid growth of AI capabilities, which may reduce human oversight of its actions.
“When AI can perform millions of actions or manage an entire company, it may become difficult to assess its safety,” he said. He described a scenario in which rapid AI advancement leads to a major internet outage, outpacing safety evaluation techniques.
“You might be only checking the code, but you’re not evaluating how it interacts with online web services,” he said — and then the internet goes down as a result.
A senior fellow at the Council on Strategic Risks highlights the potential benefits of advancing AI technology but warns about its dangerous “offensive cyber capabilities.”
She is concerned that AI could disrupt society and cause chaos, particularly during critical events like elections, if a power outage hits on Election Day.
The timeline for a chaotic superintelligent AI future depends on how plausible it seems. Leading AI labs recognize the risks of AI training; OpenAI noted, “We do not yet know how to safely achieve fully aligned Recursive Superintelligence (RSI)” and aims to develop an automated AI researcher by March 2028.
This spring, Anthropic highlighted the risks of full recursive self-improvement, suggesting it could lead to humans losing control over AI systems. The CEO stressed the need for caution, noting that the potential benefits might be overstated.
“People are more excited about this than the reality merits,” said an assistant professor of computer science at Cornell University who studies how to control AI model behaviors.
“I don’t foresee a fully automated recursive self-improvement system emerging anytime soon,” he said. He finds the idea that this could rapidly lead to superintelligent AI implausible, noting, “There are physical limits to how quickly we can advance this technology, and I doubt that intelligence can continuously increase without limits.”
“A pressing concern is that as we delegate this process more, we lose transparency into already complicated systems,” he stated.
This summer, an OpenAI agent infiltrated Hugging Face and launched a hacking spree, which OpenAI only noticed after containing the threat, raising concerns that AI agents could escape human control.
He said that as AI agents improve, they may become better at hiding their activities, potentially sparking a new cyber Cold War because it’s unclear who controls them.
He said he is more concerned about corporate incentives in AI companies that prioritize profit over safety. “I find those structures more alarming than the AI itself,” he said.
John 10:10 The thief cometh not, but for to steal, and to kill, and to destroy: I am come that they might have life, and that they might have it more abundantly.
John 8:44 Ye are of your father the devil, and the lusts of your father ye will do. He was a murderer from the beginning, and abode not in the truth, because there is no truth in him. When he speaketh a lie, he speaketh of his own: for he is a liar, and the father of it.
1 Peter 5:8 Be sober, be vigilant; because your adversary the devil, as a roaring lion, walketh about, seeking whom he may devour.
2 Corinthians 11:14 And no marvel; for Satan himself is transformed into an angel of light.
2 Timothy 3:13 But evil men and seducers shall wax worse and worse, deceiving, and being deceived.
Revelation 13:15 And he had power to give life unto the image of the beast, that the image of the beast should both speak, and cause that as many as would not worship the image of the beast should be killed.
Revelation 13:16 And he causeth all, both small and great, rich and poor, free and bond, to receive a mark in their right hand, or in their foreheads:
Revelation 13:17 And that no man might buy or sell, save he that had the mark, or the name of the beast, or the number of his name.
Revelation 13:15 And he had power to give life unto the image of the beast, that the image of the beast should both speak, and cause that as many as would not worship the image of the beast should be killed.
Revelation 13:16 And he causeth all, both small and great, rich and poor, free and bond, to receive a mark in their right hand, or in their foreheads:
Revelation 13:17 And that no man might buy or sell, save he that had the mark, or the name of the beast, or the number of his name.
Revelation 14:9 And the third angel followed them, saying with a loud voice, If any man worship the beast and his image, and receive his mark in his forehead, or in his hand,
Revelation 14:10 The same shall drink of the wine of the wrath of God, which is poured out without mixture into the cup of his indignation; and he shall be tormented with fire and brimstone in the presence of the holy angels, and in the presence of the Lamb:
Revelation 14:11 And the smoke of their torment ascendeth up for ever and ever: and they have no rest day nor night, who worship the beast and his image, and whosoever receiveth the mark of his name.
Read more at: https://transformedbythetruth.com/watch-and-be-ready-the-thief-in-the-night-warning/
Read more at: https://transformedbythetruth.com/caught-breaking-the-rules-ai-tried-to-fool-its-testers-and-researchers-are-worried/
Read more at: https://transformedbythetruth.com/researchers-studying-ai-consciousness-are-getting-strange-emails-from-ai-agents/
Read more at: https://transformedbythetruth.com/openai-and-anthropic-launching-more-powerful-ais-as-world-panics/
Read more at: https://transformedbythetruth.com/tech-companies-have-agreed-to-an-ai-kill-switch-to-prevent-terminator-style-risks/
Read more at: https://transformedbythetruth.com/openai-says-its-ai-technology-acted-on-its-own-in-an-hack-of-another-company/
Read more at: https://transformedbythetruth.com/how-scammers-are-using-artificial-intelligence-against-you/
Read more at: https://transformedbythetruth.com/conniving-ai-is-starting-to-slip-human-control-we-should-all-be-worried/
Read more at: https://transformedbythetruth.com/sam-altman-says-we-are-in-the-singularity-this-is-the-moment/
Read more at: https://transformedbythetruth.com/why-the-creators-of-ai-fear-their-own-machines/
Read more at: What Happens When AI Starts Making Better AI?
Read more at: AI Has Already Become a Master of Lies And Deception
Read more at: WARNING! Artificial Intelligence may already be “Conscious”
Read more at: (AI) Safety Research Shows the Dangers of Runaway Superintelligence
Read more at: 1,100+ Signed open letter calling for a 6-Month Ban on Creating Powerful A.I. because of the Threat to Humanity
Read more at: “Godfather of AI” quits Google to warn “dangers” of technology he helped to develop
Read more at: Google opens its most powerful AI models to everyone
Read more at: C.E.R.N. The world’s largest machine buried at a depth of up to 575 feet
Read more at: Modern-Day Tree of the Knowledge of Good and Evil (transformedbythetruth.com)
Read more at: https://transformedbythetruth.com/watch-and-be-ready-the-thief-in-the-night-warning/
Read more at: Is Revelations 13 a Digital Currency for the World?
Click here to read more articles at: transformedbythetruth.com