1. Home
  2. >
  3. AI 🤖
Posted

AI Set to Transform Science, But Concerns Remain Over Bias and Reliability, Researchers Say

  • Nature survey of 1,600+ researchers found over half think AI will be very important or essential to their fields in the next decade, though concerns exist about impacts.

  • Machine learning techniques are established in science, while generative AI like large language models are advancing rapidly and being tested for uses like writing papers.

  • While AI provides advantages like faster data processing, concerns include overreliance on patterns, entrenching bias, enabling fraud, and irreproducibility.

  • ChatGPT topped choices for most impressive but also most concerning AI tools, with worries about misinformation and plagiarism.

  • Barriers include computing resources, funding, data, skills, and commercial dominance; many are unsure if journals can adequately review AI-using papers.

nature.com
Relevant topic timeline:
### Summary The rapid advancement of artificial intelligence (AI) presents both beneficial possibilities and concerning risks, as experts warn about potential negative impacts including the threat of extinction. Government and industry efforts are being made to manage these risks and regulate AI technology, while also addressing concerns about misinformation, bias, and the need for societal literacy in understanding AI. ### Facts - The use of AI is rapidly growing in various areas such as health care, the workplace, education, arts, and entertainment. - The Center for AI Safety (CAIS) issued a warning signed by hundreds of individuals, including tech industry leaders and scientists, about the need to prioritize mitigating the risks of AI alongside global-scale dangers like pandemics and nuclear war. - CEO of OpenAI, Sam Altman, expressed both the benefits and concerns associated with AI technology, emphasizing the need for serious consideration of its risks. - Some experts believe that the warnings about potential risks from AI are more long-term scenarios rather than immediate doomsday situations, and caution against the hype surrounding AI. - The National Council of State Legislatures is working on regulating AI at the state level, with several states already introducing AI bills and forming advisory groups. - State legislators aim to define responsible AI utilization by governments and protect constituents engaging with AI in the private sector. - The federal government is establishing National Artificial Intelligence Research Institutes to invest in long-term AI research. - Misinformation and disinformation are concerns related to AI, as certain AI algorithms can generate biased and inaccurate information. - OpenAI acknowledges the potential for AI tools to contribute to disinformation campaigns and is collaborating with researchers and industry peers to address this issue. - The NCSL report highlights the need for policymakers to understand the programming decisions behind AI systems and their potential impact on citizens. - Society lacks the ability and literacy to distinguish truth from false information, leading to the proliferation and belief in generative misinformation. ### 🤖 AI - The use of artificial intelligence is rapidly advancing across various fields. - Concerns have been raised about the potential risks and negative impacts of AI. - Government and industry efforts are underway to manage AI risks and regulate the technology. - Misinformation, bias, and the lack of societal literacy in understanding AI are additional challenges.
AI executives may be exaggerating the dangers of artificial intelligence in order to advance their own interests, according to an analysis of responses to proposed AI regulations.
Proper research data management, including the use of AI, is crucial for scientists to reproduce prior results, combine data from multiple sources, and make data more accessible and reusable, ultimately improving the scientific process and benefiting all forms of intelligence.
Professionals are optimistic about the impact of artificial intelligence (AI) on their productivity and view it as an augmentation to their work rather than a complete replacement, according to a report by Thomson Reuters, with concerns centered around compromised accuracy and data security.
AI-based tools are being widely used in hiring processes, but they pose a significant risk of exacerbating discrimination in the workplace, leading to calls for their regulation and the implementation of third-party assessments and transparency in their use.
The potential impact of robotic artificial intelligence is a growing concern, as experts warn that the biggest risk comes from the manipulation of people through techniques such as neuromarketing and fake news, dividing society and eroding wisdom without the need for physical force.
The use of AI algorithms by insurance companies to assess claims is raising concerns about potential bias and lack of human oversight, leading Pennsylvania legislators to propose legislation that would regulate the use of AI in claims processing.
The use of copyrighted material to train generative AI tools is leading to a clash between content creators and AI companies, with lawsuits being filed over alleged copyright infringement and violations of fair use. The outcome of these legal battles could have significant implications for innovation and society as a whole.
Regulating artificial intelligence (AI) should be based on real market failures and a thorough cost-benefit analysis, as over-regulating AI could hinder its potential benefits and put the US at a disadvantage in the global race for AI leadership.
Artificial intelligence (AI) is seen as a tool that can inspire and collaborate with human creatives in the movie and TV industry, but concerns remain about copyright and ethical issues, according to Greg Harrison, chief creative officer at MOCEAN. Although AI has potential for visual brainstorming and automation of non-creative tasks, it should be used cautiously and in a way that values human creativity and culture.
A recent poll conducted by Pew Research Center shows that 52% of Americans are more concerned than excited about the use of artificial intelligence (AI) in their daily lives, marking an increase from the previous year; however, there are areas where they believe AI could have a positive impact, such as in online product and service searches, self-driving vehicles, healthcare, and finding accurate information online.
Corporate America is increasingly mentioning AI in its quarterly reports and earnings calls to portray its projects in a more innovative light, although regulators warn against deceptive use of the term.
A global survey by Salesforce indicates that consumers have a growing distrust of firms using AI, with concerns about unethical use of the technology, while an Australian survey found that most people believe AI creates more problems than it solves.
The increasing adoption of AI in the workplace raises concerns about its potential impacts on worker health and well-being, as it could lead to job displacement, increased work intensity, and biased practices, highlighting the need for research to understand and address these risks.
The rapid integration of AI technologies into workflows is causing potential controversies and creating a "ticking time bomb" for businesses, as AI tools often produce inaccurate or biased content and lack proper regulations, leaving companies vulnerable to confusion and lawsuits.
Artificial intelligence (AI) tools can put human rights at risk, as highlighted by researchers from Amnesty International on the Me, Myself, and AI podcast, who discuss scenarios in which AI is used to track activists and make automated decisions that can lead to discrimination and inequality, emphasizing the need for human intervention and changes in public policy to address these issues.
The UK government has been urged to introduce new legislation to regulate artificial intelligence (AI) in order to keep up with the European Union (EU) and the United States, as the EU advances with the AI Act and US policymakers publish frameworks for AI regulations. The government's current regulatory approach risks lagging behind the fast pace of AI development, according to a report by the science, innovation, and technology committee. The report highlights 12 governance challenges, including bias in AI systems and the production of deepfake material, that need to be addressed in order to guide the upcoming global AI safety summit at Bletchley Park.
The use of AI in the entertainment industry, such as body scans and generative AI systems, raises concerns about workers' rights, intellectual property, and the potential for broader use of AI in other industries, infringing on human connection and privacy.
The rapid advancement of AI technology poses significant challenges for democratic societies, including the need for nuanced debates, public engagement, and ethical considerations in regulating AI to mitigate unintended consequences.
More than half of Americans believe that misinformation spread by artificial intelligence (AI) will impact the outcome of the 2024 presidential election, with supporters of both former President Trump and President Biden expressing concerns about the influence of AI on election results.
Eight big tech companies, including Adobe, IBM, Salesforce, and Nvidia, have pledged to conduct more testing and research on the risks of artificial intelligence (AI) in a meeting with White House officials, signaling a "bridge" to future government action on the issue. These voluntary commitments come amidst congressional scrutiny and ongoing efforts by the White House to develop policies for AI.
AI is revolutionizing scientific research by accelerating drug discovery, predicting protein structures, improving weather forecasting, controlling nuclear fusion, automating laboratory work, and enhancing data analysis, allowing scientists to explore new frontiers and increase research productivity.
The article discusses the potential impact of AI on the enterprise of science and explores the responsible development, challenges, and societal preparation needed for this new age of ubiquitous AI.
Artificial intelligence (AI) has the potential to revolutionize scientific discovery by accelerating the pace of research through tools such as literature-based discovery and robot scientists, but the main obstacle is the willingness and ability of human scientists to use these tools.
A survey conducted by Canva found that while many professionals claim to be familiar with artificial intelligence (AI), a significant number exaggerate or even fake their knowledge of AI in order to keep up with colleagues and superiors, highlighting the need for more opportunities to learn and explore AI in the workplace.
The United Nations is increasingly focusing on artificial intelligence (AI) at its General Assembly, with discussions on the risks, benefits, and governance of the technology, and plans to launch an AI advisory board to address these concerns.
AI tools were given to consultants at Boston Consulting Group, resulting in increased productivity and higher quality work for certain tasks, but also an increased likelihood of errors for tasks that were beyond AI capabilities, ultimately benefiting lower-performing consultants the most.
Over 55% of AI-related failures in organizations are attributed to third-party AI tools, highlighting the need for thorough risk assessment and responsible AI practices.
Artificial intelligence (AI) is rapidly transforming various fields of science, but its impact on research and society is still unclear, as highlighted in a new Nature series which explores the benefits and risks of AI in science based on the views of over 1,600 researchers worldwide.
The use of AI in journalism is on the rise, with over 75 percent of newsrooms incorporating AI tools in the news gathering, production, and distribution process; however, concerns about ethical implications and the misrepresentation of marginalized groups still exist among journalists.
Users' preconceived ideas and biases about AI can significantly impact their interactions and experiences with AI systems, a new study from MIT Media Lab reveals, suggesting that the more complex the AI, the more reflective it is of human expectations. The study highlights the need for accurate depictions of AI in art and media to shift attitudes and culture surrounding AI, as well as the importance of transparent information about AI systems to help users understand their biases.
A new study from Deusto University reveals that humans can inherit biases from artificial intelligence, highlighting the need for research and regulations on AI-human collaboration.
Artificial intelligence (AI) has become an undeniable force in our lives, with wide-ranging implications and ethical considerations, posing both benefits and potential harms, and raising questions about regulation and the future of humanity's relationship with AI.
AI has the potential to transform healthcare, but there are concerns about burdens on clinicians and biases in AI algorithms, prompting the need for a code of conduct to ensure equitable and responsible implementation.
An organization dedicated to the safe development of artificial intelligence has released a breakthrough paper on understanding and controlling AI systems to mitigate risks such as deception and bias.
As the 2023 election campaign in New Zealand nears its end, the rise of Artificial Intelligence (AI) and its potential impact on the economy, politics, and society is being largely overlooked by politicians, despite growing concerns from AI experts and the public. The use of AI raises concerns about job displacement, increased misinformation, biased outcomes, and data sovereignty issues, highlighting the need for stronger regulation and investment in AI research that benefits all New Zealanders.
Artificial intelligence (AI) has the potential to disrupt the creative industry, with concerns raised about AI-generated models, music, and other creative works competing with human artists, leading to calls for regulation and new solutions to protect creators.
Governments around the world are considering AI regulations to address concerns such as misinformation, job loss, and the misuse of AI technologies, with different approaches taken by countries like the US, UK, EU, China, Japan, Brazil, and Israel.
AI technology has advanced rapidly, bringing both positive and negative consequences such as improved accuracy and potential risks to the economy, national security, and various industries, requiring government regulation and ethical considerations to prevent misuse and protect human values.
Japan is drafting AI guidelines to reduce overreliance on the technology, the SEC Chair warns of AI risks to financial stability, and a pastor who used AI for a church service says it won't happen again. Additionally, creative professionals are embracing AI image generators but warn about their potential misuse, while India plans to set up a large AI compute infrastructure.
Efforts to regulate artificial intelligence are gaining momentum worldwide, but important ethical and controversial issues are being overlooked.
Companies are competing to develop more powerful generative AI systems, but these systems also pose risks such as spreading misinformation and distorting scientific facts; a set of "living guidelines" has been proposed to ensure responsible use of generative AI in research, including human verification, transparency, and independent oversight.
The European Association of Research Managers and Administrators (EARMA) is exploring the potential applications of artificial intelligence (AI) in research management and administration, including AI-generated grant proposals, data management, and more, while also recognizing the need for transparency and policy guidelines regarding the use of AI. The field of research management has gained recognition and visibility in recent years, but there is still a need for improvement in training and development opportunities for new research managers.
Actor Dolph Lundgren believes that artificial intelligence (AI) will be extremely useful, especially in cancer research, citing examples of AI's contribution in finding the COVID-19 vaccine quickly and its potential application in cancer research. Lundgren, who has battled cancer himself, expresses hope for the positive aspects of AI but acknowledges the need for control and responsible use.
The publishing industry is grappling with concerns about the impact of AI on copyright, as well as the quality and ownership of AI-generated content, although some authors and industry players believe that AI writing still has a long way to go before it can fully replace human authors.
Top AI researchers are calling for at least one-third of AI research and development funding to be dedicated to ensuring the safety and ethical use of AI systems, along with the introduction of regulations to hold companies legally liable for harms caused by AI.
A group of 24 AI experts, including Geoffrey Hinton and Yoshua Bengio, have released a paper urging governments to take action in managing the risks associated with AI, particularly extreme risks posed by advanced systems, and have made policy recommendations to promote safe and ethical use of AI.
New research suggests that human users of AI programs may unconsciously absorb the biases of these programs, incorporating them into their own decision-making even after they stop using the AI. This highlights the potential long-lasting negative effects of biased AI algorithms on human behavior.