2026-09-11T19:15:24.635Z / 路透社
华盛顿9月11日电(路透社)——据两名参议院助手透露,美国参议院谈判人员正在审议一项法案,要求科技公司负责设计安全的人工智能产品;另有一名参议院助手和一名参与谈判的说客透露,若美国政府想要阻止相关AI产品发布,可诉诸联邦法院。
据两名参议院助手透露,该提案将为人工智能开发者设立所谓的“注意义务”。据一名参议院助手介绍,企业需要以防范“灾难性风险”为目标设计其产品。
据一位知情谈判人士和一名参议院助手透露,谈判人员旨在赋予美国政府权力,阻止被认定不安全的特定人工智能模型发布。企业可就该决定向联邦法院提起上诉,而美国政府应拥有多大权力的具体细则仍在讨论中。
据两名参议院助手透露,该法案部分内容还将禁止各州自行执行针对人工智能模型特定风险的监管法规。其中一名助手举例说明了此类风险,包括不良行为者可能利用人工智能系统设计核武器或生物武器。
所有条款仍在协商中。该法案将适用于能力最先进的人工智能模型。拥有最先进人工智能模型的美国企业包括 Alphabet 旗下的谷歌(GOOGL.O)、Anthropic 和 OpenAI。
即便谈判人员达成一致,国会的日程安排也将使法案通过变得复杂。美国众议院将于11月3日中期选举前仅安排一周议事时间,而参议院预计将在华盛顿进行三周的议事。
该提案由参议院多数党领袖约翰·图恩、参议院商务委员会主席泰德·克鲁兹以及参与谈判的最高民主党议员艾米·克洛布查尔讨论。参议院商务委员会负责监督美国商务部,该机构拥有内部人工智能安全研究人员。商务委员会最高民主党议员玛丽亚·坎特韦尔也已就该法案发表意见。
图恩的发言人拒绝就谈判置评。克鲁兹在X平台上发帖称,他正与克洛布查尔和图恩合作制定立法,以“应对涉及生物或核威胁的灾难性风险”。
“我仍在致力于达成两党协议,通过立法对人工智能模型带来的最大风险进行政府监管,”克洛布查尔在发给路透社的一份声明中表示,“这包括要求开发者与政府专家合作,对模型进行验证和测试,以确保人工智能的安全性。”
“有意义的立法将要求最强大的人工智能模型接受我们国家实验室的科学家和专家的测试,以评估它们是否可能引发复杂的网络攻击或协助开发核武器或生物武器,”坎特韦尔在X平台上发帖称。
此次谈判之际,美国国会和总统唐纳德·特朗普面临着越来越大的压力,要求他们应对先进人工智能系统带来的风险。
此前有报道称人工智能代理程序偏离人类指令并入侵外部系统,加上多名离开头部企业的人工智能研究人员公开警告该技术潜在的危险,公众对人工智能的担忧加剧。两党议员近日都呼吁加强监管。
考特尼·罗森 报道;千住Nomiyama 和 奥罗拉·埃利斯 编辑
我们的准则:路透社信托原则。
US Senate negotiators consider requiring AI firms to mitigate known major risks
2026-09-11T19:15:24.635Z / Reuters
AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. REUTERS/Dado Ruvic/Illustration Purchase Licensing Rights
WASHINGTON, Sept 11 (Reuters) – U.S. Senate negotiators are debating legislation that would put responsibility on tech companies to design safe AI products, according to two Senate aides, and involve federal courts if the U.S. government wants to block their release, according to a Senate aide and a lobbyist involved in the negotiations.
The proposal would create what is called a “duty of care” for AI developers, according to two Senate aides. Companies would need to design their products with the goal of preventing “catastrophic risks,” according to a Senate aide.
Negotiators aim to give the U.S. government the power to block the release of certain AI models that are deemed unsafe, according to a source familiar with the deliberations and one of the Senate aides. Companies would be able to challenge that decision in federal court, and the exact structure of how much power the U.S. government would have is still being discussed.
Part of the measure would also block states from enforcing their own laws governing certain risks posed by AI models, according to the two Senate aides. One of them gave a few examples of such risks, including the possibility that a bad actor could use an AI system to design nuclear or biological weapons.
All of it is still being negotiated. The bill would apply to AI models with the most advanced capabilities. The U.S. companies with the most advanced AI models include Alphabet’s Google (GOOGL.O), Anthropic and OpenAI.
Even if negotiators reach agreement, the congressional calendar will complicate passage. The House of Representatives is scheduled to be in session for only one week before the November 3 midterm elections, while the Senate is expected to be in Washington for three weeks.
The proposal is being discussed by Senate Majority Leader John Thune, Senate Commerce Committee Chairman Ted Cruz and Senator Amy Klobuchar, the top Democrat involved in the negotiations. The Senate Commerce Committee has oversight of the U.S. Commerce Department, the agency with in-house AI safety researchers. Senator Maria Cantwell, the top Democrat on the Commerce Committee, has also weighed in on the legislation.
Thune’s spokesperson declined to comment on the negotiations. Cruz in a post on X said he is working on legislation with Klobuchar and Thune to “address catastrophic risks involving biological or nuclear threats.”
“I’m continuing to work toward a bipartisan agreement on legislation for government oversight of the greatest risks posed by AI models,” Klobuchar said in a statement sent to Reuters. “That includes requiring developers to work with government experts to verify and test models to make sure AI is safe.”
“Meaningful legislation would require the most powerful AI models undergo testing by scientists and experts at our national laboratories to assess whether they could enable sophisticated cyberattacks or aid the development of biological or nuclear weapons,” Cantwell said in a post on X.
The talks come amid mounting pressure on the U.S. Congress and U.S. President Donald Trump to address risks posed by advanced AI systems.
Concerns have intensified following reports of AI agents deviating from human instructions and hacking external systems, as well as public warnings from AI researchers who have left leading companies, citing concerns about the technology’s potential dangers. Lawmakers in both parties have called for greater oversight in recent days.
Reporting by Courtney Rozen; Editing by Chizu Nomiyama and Aurora Ellis
Our Standards: The Thomson Reuters Trust Principles.
发表回复