Former AI researcher resigns over safety concerns

A researcher at AI firm Anthropic says he resigned from the company over safety concerns. He claims the company and its competitors are not acting responsibly to prevent AI from becoming a harmful superintelligence. He said AI could grow out of human control. Fox Source Amelia Jones in the newsroom with that. Amelia. Clarice, good evening to you. The former Anthropic employee called it an AI arms race and warned that if the industry does not slow down, the rapidly evolving technology could become harmful to the human race. For years, the artificial intelligence industry raced to enhance its technology. Now some researchers are sounding the alarm to slow down. Tuesday, a now former Anthropic researcher, Jacob Coxon, who previously worked at OpenAI, posted that he resigned from the company because, quote, neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. Another Anthropic employee agreed, then said he personally believes there is a greater than 10 percent chance AI could kill all humans within the next decade. However, he added that according to Anthropic's recent risk report, the threat from present models is low. Coxon told Fox News he agrees right now the threat is minimal, but that could change rapidly. So this attitude is shared across the industry, where people essentially are aware that the work they are currently doing, if we don't slow down, could lead to AI takeover by the end of the decade. Coxon joins the growing number of AI experts and lawmakers who are calling for regulation. Democrat Texas Congressman Greg Kazar and Senator Bernie Sanders introduced a bill to ban superintelligence. The lawmakers are now calling for Congress to take action. Republican Texas Senator Ted Cruz also called for guardrails in an appearance on The View, mentioning China is also in the race for advanced AI. So this is scary stuff, but we're also not going to stick our head in the sand and pretend technology isn't happening. So we've got to we've got to put some guardrails on it. But at the same time, I think it ought to be America leading because if it's China leading, the whole world's in trouble. Coxon told Fox News Channel it wouldn't really matter who is leading on AI. If humans lose control of the tech. This technology is not ordinary technology. It's not like other other forms of innovation. This is essentially a super weapon. Coxon recommends an international agreement to control the development of AI technology on a global scale. But he added that benefits of AI, such as cancer research, can still happen. I think if we actually try instead of submitting to the inevitability of a doomed race or a hubristic gamble, then we can solve it. Today, OpenAI announced Paul Cristiano will join its board and safety and security committee. He is an AI safety researcher who has spent years studying how to keep AI systems under human control.