1. Home
  2. >
  3. AI 🤖
Posted

AI Pioneer Calls for Practical Regulations to Address AI's Real-World Risks

  • AI pioneer Mustafa Suleyman thinks existential AI risk concerns are overblown distractions and we should focus on more practical issues like privacy, bias, and regulation.

  • Suleyman believes governments can and should regulate AI like they have with past technologies such as aviation and the internet.

  • He wants broad international regulations as well as granular policies limiting things like an AI's ability to self-improve without human oversight.

  • Governments like the EU and China have already begun enacting AI regulations, while the US is starting to have discussions on the issue.

  • Suleyman believes "nation-states" must take action to regulate AI properly given what's at stake.

fortune.com
Relevant topic timeline:
In this episode of the "Have a Nice Future" podcast, Gideon Lichfield and Lauren Goode interview Mustafa Suleyman, the co-founder of DeepMind and InflectionAI. The main topic of discussion is Suleyman's new book, "The Coming Wave," which examines the potential impact of AI and other technologies on society and governance. Key points discussed include Suleyman's concern that AI proliferation could undermine nation-states and increase inequality, the potential for AI to help lift people out of poverty, and the need for better AI assessment tools.
### Summary The rapid advancement of artificial intelligence (AI) presents both beneficial possibilities and concerning risks, as experts warn about potential negative impacts including the threat of extinction. Government and industry efforts are being made to manage these risks and regulate AI technology, while also addressing concerns about misinformation, bias, and the need for societal literacy in understanding AI. ### Facts - The use of AI is rapidly growing in various areas such as health care, the workplace, education, arts, and entertainment. - The Center for AI Safety (CAIS) issued a warning signed by hundreds of individuals, including tech industry leaders and scientists, about the need to prioritize mitigating the risks of AI alongside global-scale dangers like pandemics and nuclear war. - CEO of OpenAI, Sam Altman, expressed both the benefits and concerns associated with AI technology, emphasizing the need for serious consideration of its risks. - Some experts believe that the warnings about potential risks from AI are more long-term scenarios rather than immediate doomsday situations, and caution against the hype surrounding AI. - The National Council of State Legislatures is working on regulating AI at the state level, with several states already introducing AI bills and forming advisory groups. - State legislators aim to define responsible AI utilization by governments and protect constituents engaging with AI in the private sector. - The federal government is establishing National Artificial Intelligence Research Institutes to invest in long-term AI research. - Misinformation and disinformation are concerns related to AI, as certain AI algorithms can generate biased and inaccurate information. - OpenAI acknowledges the potential for AI tools to contribute to disinformation campaigns and is collaborating with researchers and industry peers to address this issue. - The NCSL report highlights the need for policymakers to understand the programming decisions behind AI systems and their potential impact on citizens. - Society lacks the ability and literacy to distinguish truth from false information, leading to the proliferation and belief in generative misinformation. ### 🤖 AI - The use of artificial intelligence is rapidly advancing across various fields. - Concerns have been raised about the potential risks and negative impacts of AI. - Government and industry efforts are underway to manage AI risks and regulate the technology. - Misinformation, bias, and the lack of societal literacy in understanding AI are additional challenges.
### Summary President Joe Biden consults with Arati Prabhakar, his science adviser, on matters related to artificial intelligence (AI). Prabhakar is working with major tech companies like Amazon, Google, Microsoft, and Meta to shape the U.S. approach to safeguarding AI technology. ### Facts - 🤖 Prabhakar has had several discussions with President Biden on artificial intelligence. - 📚 Making AI models explainable is a priority for Senate Majority Leader Chuck Schumer, but it is technically challenging. - 💡 Prabhakar believes that despite the opacity of deep-learning AI systems, we can learn enough about their safety and effectiveness to leverage their value. - ⚠️ Concerns include chatbots being coerced into providing instructions for building weapons, biases in AI systems trained on human data, wrongful arrests from facial recognition systems, and privacy issues. - 💼 Seven companies, including Google, Microsoft, and OpenAI, voluntarily committed to AI safety standards, but more companies need to step up, and government action is necessary. - ⏰ Timeline for future actions is fast, according to Prabhakar, as President Biden has made it clear that AI is an urgent issue.
AI executives may be exaggerating the dangers of artificial intelligence in order to advance their own interests, according to an analysis of responses to proposed AI regulations.
President Joe Biden relies on his science adviser Arati Prabhakar to guide the US approach to safeguarding AI technology, with cooperation from tech giants like Amazon, Google, Microsoft and Meta. Prabhakar discusses the need for understanding the implications and consequences of AI, the challenge of making AI models explainable, concerns about biases and privacy, and the importance of voluntary commitments from tech companies along with government actions.
Mustafa Suleyman, co-founder of DeepMind and InflectionAI, explains in his new book, "The Coming Wave," why our systems are ill-equipped to handle the advancements in technology, including the potential threats posed by AI and the need for better assessment methods.
A new poll conducted by the AI Policy Institute reveals that 72 percent of American voters want to slow down the development of AI, signaling a divergence between elite opinion and public opinion on the technology. Additionally, the poll shows that 82 percent of American voters do not trust AI companies to self-regulate. To address these concerns, the AI Now Institute has proposed a framework called "Zero Trust AI Governance," which calls for lawmakers to vigorously enforce existing laws, establish bold and easily administrable rules, and place the burden of proof on companies to demonstrate the safety of their AI systems.
The U.S. is falling behind in regulating artificial intelligence (AI), while Europe has passed the world's first comprehensive AI law; President Joe Biden recently met with industry leaders to discuss the need for AI regulation and companies pledged to develop safeguards for AI-generated content and prioritize user privacy.
The increasing investment in generative AI and its disruptive impact on various industries has brought the need for regulation to the forefront, with technologists and regulators recognizing the importance of ensuring safer technological applications, but differing on the scope of regulation needed. However, it is argued that existing frameworks and standards, similar to those applied to the internet, can be adapted to regulate AI and protect consumer interests without stifling innovation.
The UK government has been urged to introduce new legislation to regulate artificial intelligence (AI) in order to keep up with the European Union (EU) and the United States, as the EU advances with the AI Act and US policymakers publish frameworks for AI regulations. The government's current regulatory approach risks lagging behind the fast pace of AI development, according to a report by the science, innovation, and technology committee. The report highlights 12 governance challenges, including bias in AI systems and the production of deepfake material, that need to be addressed in order to guide the upcoming global AI safety summit at Bletchley Park.
Artificial intelligence regulation varies across countries, with Brazil focusing on user rights and risk assessments, China emphasizing "true and accurate" content generation, the EU categorizing AI into three risk levels, Israel promoting responsible innovation and self-regulation, Italy allocating funds for worker support, Japan adopting a wait-and-see approach, and the UAE prioritizing AI development and integration.
Nvidia's processors could be used as a leverage for the US to impose its regulations on AI globally, according to Mustafa Suleyman, co-founder of DeepMind and Inflection AI. However, Washington is lagging behind Europe and China in terms of AI regulation.
Mustafa Suleyman, co-founder of Google's DeepMind, predicts that within the next five years, everyone will have their own AI-powered personal assistants that intimately know their personal information and boost productivity.
Mustafa Suleyman, CEO of Inflection AI, argues that restricting the sale of AI technologies and appointing a cabinet-level regulator are necessary steps to combat the negative effects of artificial intelligence and prevent misuse.
The entrepreneur Mustafa Suleyman calls for urgent regulation and containment of artificial intelligence in his new book, emphasizing the need to tap into its opportunities while mitigating its risks.
Countries around the world, including Australia, China, the European Union, France, G7 nations, Ireland, Israel, Italy, Japan, Spain, the UK, the UN, and the US, are taking various steps to regulate artificial intelligence (AI) technologies and address concerns related to privacy, security, competition, and governance.
AI has the potential to fundamentally change governments and society, with AI-powered companies and individuals usurping traditional institutions and creating a new world order, warns economist Samuel Hammond. Traditional governments may struggle to regulate AI and keep pace with its advancements, potentially leading to a loss of global power for these governments.
China's targeted and iterative approach to regulating artificial intelligence (AI) could provide valuable lessons for the United States, despite ideological differences, as the U.S. Congress grapples with comprehensive AI legislation covering various issues like national security, job impact, and democratic values. Learning from China's regulatory structure and process can help U.S. policymakers respond more effectively to the challenges posed by AI.
Historian Yuval Noah Harari and DeepMind co-founder Mustafa Suleyman discuss the risks and control possibilities of artificial intelligence in a debate with The Economist's editor-in-chief.
Eight new technology companies, including Adobe, IBM, Nvidia, Palantir, and Salesforce, have made voluntary commitments on artificial intelligence (AI) to drive safe and secure development while working towards comprehensive regulation, according to a senior Biden administration official. The commitments include outside testing of AI systems, cybersecurity measures, information sharing, research on societal risks, and addressing society's challenges. The White House is partnering with the private sector to harness the benefits of AI while managing the risks.
A bipartisan group of senators is expected to introduce legislation to create a government agency to regulate AI and require AI models to obtain a license before deployment, a move that some leading technology companies have supported; however, critics argue that licensing regimes and a new AI regulator could hinder innovation and concentrate power among existing players, similar to the undesirable economic consequences seen in Europe.
Adversaries and criminal groups are exploiting artificial intelligence (AI) technology to carry out malicious activities, according to FBI Director Christopher Wray, who warned that while AI can automate tasks for law-abiding citizens, it also enables the creation of deepfakes and malicious code, posing a threat to US citizens. The FBI is working to identify and track those misusing AI, but is cautious about using it themselves. Other US security agencies, however, are already utilizing AI to combat various threats, while concerns about China's use of AI for misinformation and propaganda are growing.
Governments worldwide are grappling with the challenge of regulating artificial intelligence (AI) technologies, as countries like Australia, Britain, China, the European Union, France, G7 nations, Ireland, Israel, Italy, Japan, Spain, the United Nations, and the United States take steps to establish regulations and guidelines for AI usage.
A new poll reveals that 63% of American voters believe regulation should actively prevent the development of superintelligent AI, challenging the assumption that artificial general intelligence (AGI) should exist. The public is increasingly questioning the potential risks and costs associated with AGI, highlighting the need for democratic input and oversight in the development of transformative technologies.
China's new artificial intelligence (AI) rules, which are among the strictest in the world, have been watered down and are not being strictly enforced, potentially impacting the country's technological competition with the U.S. and influencing AI policy globally; if maximally enforced, the regulations could pose challenges for Chinese AI developers to comply with, while relaxed enforcement and regulatory leniency may still allow Chinese tech firms to remain competitive.
Wikipedia founder Jimmy Wales believes that regulating artificial intelligence (AI) is not feasible and compares the idea to "magical thinking," stating that many politicians lack a strong understanding of AI and its potential. While the UN is establishing a panel to investigate global regulation of AI, some experts, including physicist Reinhard Scholl, emphasize the need for regulation to prevent the misuse of AI by bad actors, while others, like Robert Opp, suggest forming a regulatory body similar to the International Civil Aviation Organisation. However, Wales argues that regulating individual developers using freely available AI software is impractical.
The U.S. government must establish regulations and enforce standards to ensure the safety and security of artificial intelligence (AI) development, including requiring developers to demonstrate the safety of their systems before deployment, according to Anthony Aguirre, the executive director and secretary of the board at the Future of Life Institute.
Deputy Prime Minister Oliver Dowden will warn the UN that artificial intelligence (AI) poses a threat to world order unless governments take action, with fears that the rapid pace of AI development could lead to job losses, misinformation, and discrimination without proper regulations in place. Dowden will call for global regulation and emphasize the importance of making rules in parallel with AI development rather than retroactively. Despite the need for regulation, experts note the complexity of reaching a quick international agreement, with meaningful input needed from smaller countries, marginalized communities, and ethnic minorities. The UK aims to take the lead in AI regulation, but there are concerns that without swift action, the European Union's AI Act could become the global standard instead.
AI-generated deepfakes pose serious challenges for policymakers, as they can be used for political propaganda, incite violence, create conflicts, and undermine democracy, highlighting the need for regulation and control over AI technology.
Sen. Mark Warner, a U.S. Senator from Virginia, is urging Congress to take a less ambitious approach to regulating artificial intelligence (AI), suggesting that lawmakers should focus on narrowly focused issues rather than trying to address the full spectrum of AI risks with a single comprehensive law. Warner believes that tackling immediate concerns, such as AI-generated deepfakes, is a more realistic and effective approach to regulation. He also emphasizes the need for bipartisan agreement and action to demonstrate progress in the regulation of AI, especially given Congress's previous failures in addressing issues related to social media.
Artificial intelligence (AI) will have a significant impact on geopolitics and globalization, driving a new globalization but also posing risks that the world is not yet ready for, according to political scientist Ian Bremmer. Global leaders and policymakers are now catching up and discussing the implications of AI, but a greater understanding of the technology is needed for effective regulation. Bremmer suggests international cooperation, such as a United Nations-driven process, to establish global oversight and prevent the U.S. versus China competition in AI development.
AI leaders including Alphabet CEO Sundar Pichai, Microsoft president Brad Smith, and OpenAI's Sam Altman are supporting AI regulation to ensure investment security, unified rules, and a role in shaping legislation, as regulations also benefit consumers by ensuring safety, cracking down on scams and discrimination, and eliminating bias.
China's use of artificial intelligence (AI) for surveillance and oppression should deter the United States from collaborating with China on AI development and instead focus on asserting itself in international standards-setting bodies, open sourcing AI technologies, and promoting explainable AI to ensure transparency and uphold democratic values.
Ukraine's Ministry of Digital Transformation has unveiled a regulatory roadmap for artificial intelligence (AI), aiming to help local companies prepare for adopting a law similar to the EU's AI Act and educate citizens on protecting themselves from AI risks. The roadmap follows a bottom-up approach, providing tools for businesses to prepare for future requirements before implementing any laws.
Artificial intelligence (AI) will surpass human intelligence and could manipulate people, according to AI pioneer Geoffrey Hinton, who quit his role at Google to raise awareness about the risks of AI and advocate for regulations. Hinton also expressed concerns about AI's impact on the labor market and its potential militaristic uses, and called for governments to commit to not building battlefield robots. Global efforts are underway to regulate AI, with the U.K. hosting a global AI summit and the U.S. crafting an AI Bill of Rights.
Mustafa Suleyman, co-founder of AI firm DeepMind and author of The Coming Wave, supports regulating AI to control its use by state actors.
Governments around the world are considering AI regulations to address concerns such as misinformation, job loss, and the misuse of AI technologies, with different approaches taken by countries like the US, UK, EU, China, Japan, Brazil, and Israel.
AI technology has advanced rapidly, bringing both positive and negative consequences such as improved accuracy and potential risks to the economy, national security, and various industries, requiring government regulation and ethical considerations to prevent misuse and protect human values.
AI tools have the potential to both enhance and hinder internet freedom, as they can be used for censorship and propaganda by autocratic regimes, but also for evading restrictions and combating disinformation. Countries should establish frameworks for AI tool creators that prioritize civil liberties, transparency, and safeguards against discrimination and surveillance. Democratic leaders need to seize the opportunity to ensure that AI technology is used to enhance freedom rather than curtail it.
The UK government is positioning itself as a global leader in AI regulation, citing its tech sector's success and historical contributions to computing, despite some skepticism from attendees at a recent reception in Washington. Meanwhile, mayors in the US are exploring how AI can optimize city governance, with a focus on transportation, infrastructure, and public safety. Additionally, rapper Pras Michel is countersuing his lawyer, claiming that relying on AI deprived him of competent counsel.