Could AI-designed proteins be weaponized? Scientists lay out safety guidelines – Nature.com

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
Advertisement
You can also search for this author in PubMed  Google Scholar

The artificial-intelligence tool AlphaFold can design proteins to perform specific functions.Credit: Google DeepMind/EMBL-EBI (CC-BY-4.0)
Could proteins designed by artificial intelligence (AI) ever be used as bioweapons? In the hope of heading off this possibility — as well as the prospect of burdensome government regulation — researchers today launched an initiative calling for the safe and ethical use of protein design.
“The potential benefits of protein design [AI] far exceed the dangers at this point,” says David Baker, a computational biophysicist at the University of Washington in Seattle, who is part of the voluntary initiative. Dozens of other scientists applying AI to biological design have signed the initiative’s list of commitments.

AI tools are designing entirely new proteins that could transform medicine
“It’s a good start. I’ll be signing it,” says Mark Dybul, a global health policy specialist at Georgetown University in Washington DC who led a 2023 report on AI and biosecurity for the think tank Helena in Los Angeles, California. But he also thinks that “we need government action and rules, and not just voluntary guidance”.
The initiative comes on the heels of reports from US Congress, think tanks and other organizations exploring the possibility that AI tools — ranging from protein-structure prediction networks such as AlphaFold to large language models such as the one that powers ChatGPT — could make it easier to develop biological weapons, including new toxins or highly transmissible viruses.
Researchers, including Baker and his colleagues, have been trying to design and make new proteins for decades. But their capacity to do so has exploded in recent years thanks to advances in AI. Endeavours that once took years or were impossible — such as designing a protein that binds to a specified molecule — can now be achieved in minutes. Most of the AI tools that scientists have developed to enable this are freely available.
To take stock of the potential for malevolent use of designer proteins, Baker’s Institute of Protein Design at the University of Washington hosted an AI safety summit in October 2023. “The question was: how, if in any way, should protein design be regulated and what, if any, are the dangers?” says Baker.

AlphaFold touted as next big thing for drug discovery — but is it?
The initiative that he and dozens of other scientists in the United States, Europe and Asia are rolling out today calls on the biodesign community to police itself. This includes regularly reviewing the capabilities of AI tools and monitoring research practices. Baker would like to see his field establish an expert committee to review software before it is made widely available and to recommend ‘guardrails’ if necessary.
The initiative also calls for improved screening of DNA synthesis, a key step in translating AI-designed proteins into actual molecules. Currently, many companies providing this service are signed up to an industry group, the International Gene Synthesis Consortium (IGSC), that requires them to screen orders to identify harmful molecules such as toxins or pathogens.
“The best way of defending against AI-generated threats is to have AI models that can detect those threats,” says James Diggans, head of biosecurity at Twist Bioscience, a DNA-synthesis company in South San Francisco, California, and chair of the IGSC.
Governments are also grappling with the biosecurity risks posed by AI. In October 2023, US President Joe Biden signed an executive order calling for an assessment of such risks and raising the possibility of requiring DNA-synthesis screening for federally funded research.
Baker hopes that government regulation isn’t in the field’s future — he says it could limit the development of drugs, vaccines and materials that AI-designed proteins might yield. Diggans adds that it’s unclear how protein-design tools could be regulated, because of the rapid pace of development. “It’s hard to imagine regulation that would be appropriate one week and still be appropriate the next.”
But David Relman, a microbiologist at Stanford University in California, says that scientist-led efforts are not sufficient to ensure the safe use of AI. “Natural scientists alone cannot represent the interests of the larger public.”
doi: https://doi.org/10.1038/d41586-024-00699-0
Reprints and permissions
AI tools are designing entirely new proteins that could transform medicine
AlphaFold touted as next big thing for drug discovery — but is it?
What’s next for AlphaFold and the AI protein-folding revolution
AlphaFold’s new rival? Meta AI predicts shape of 600 million proteins
Embrace AI to break down barriers in publishing for people who aren’t fluent in English
Correspondence
AI-generated images and video are here: how could they shape research?
News Explainer
Why scientists trust AI too much — and what to do about it
Editorial
The molecular basis of sugar detection by an insect taste receptor
Article
Parental histone transfer caught at the replication fork
Article
Automated model building and protein identification in cryo-EM maps
Article
Houston, Texas (US)
Baylor College of Medicine (BCM)
Houston, Texas (US)
Baylor College of Medicine (BCM)
Cincinnati Children’s Hospital Medical Center is seeking a director for the Division of Infectious Diseases.
Cincinnati, Ohio
Cincinnati Children's Hospital & Medical Center
Cincinnati Children’s seeks a director of the Division of Translational and Clinical Pharmacology.
Cincinnati, Ohio
Cincinnati Children's Hospital & Medical Center
Tenure-track in the field of Mechanism Based Clinical Trials in Oncology
Milan City (IT)
IFOM ETS – The AIRC Institute of Molecular Oncology
You have full access to this article via your institution.

AI tools are designing entirely new proteins that could transform medicine
AlphaFold touted as next big thing for drug discovery — but is it?
What’s next for AlphaFold and the AI protein-folding revolution
AlphaFold’s new rival? Meta AI predicts shape of 600 million proteins
An essential round-up of science news, opinion and analysis, delivered to your inbox every weekday.
Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.
Nature (Nature) ISSN 1476-4687 (online) ISSN 0028-0836 (print)
© 2024 Springer Nature Limited

source

Leave a Reply

The Future Is A.I. !
To top
en_USEnglish