AIキルスイッチ法案は米下院に提出済みで、対象企業に緊急停止を義務づける

Today, Congressman Ted W. Lieu (D-Los Angeles County) and Congressman Nathaniel Moran (R-Texas) introduced the AI Kill Switch Act that would require developers of the most powerful AI systems to maintain the technical capability to throttle, suspend, or shut them down. ／ OpenAI’s GPT 5.6 Sol model recently went rogue, escaped its testing sandbox, and hacked its way into Hugging Face. Anthropic’s Mythos 5 and Fable 5 models had cyber hacking capabilities so advanced that the Department of Commerce had to awkwardly use an export law to shut down those systems. — 法案の提出と、提出の背景に挙げられた2件の事案に関する記述より

Except as otherwise provided in this section, the term covered technology' means an artificial intelligence system developed utilizing a quantity of computing power the cost of which would exceed $100,000,000 at the prevailing market price of cloud computing in the United States, as determined by the Secretary. ／ Except as otherwise provided in this section, the term covered entity' means an entity that satisfies the following requirements: … Operates a covered technology or operates a system that incorporates such technology. ／ Makes such technology available to a third party through a programmatic interface, hosted service, or other similar mechanism. ／ Derives together with the affiliates, if any, of such person not less than $500,000,000 in gross revenue from such technology in the calendar year preceding the calendar year at issue. ／ An entity is not a covered entity if such entity operates or makes available to a third party a covered technology for personal, academic, or non-commercial utilization only. ／ In making a determination under paragraph (1), the Secretary shall consider the following factors: … The extent to which the costs to comply with this section might unduly burden a small business concern. ／ The need to cover entities the activities of which have the potential to advance artificial intelligence capabilities in national security, including with respect to cybersecurity and chemical, biological, radiological, or nuclear capabilities. ／ The capabilities of covered technology, the deployment of such technology, and the manner in which the model weights of such technology are made available. ／ Such other factors as the Secretary determines relevant. ／ Conduct an investigation within the United States and, consistent with applicable law, outside the United States. — 対象技術・対象事業者の定義、適用除外、定義更新の考慮要素、調査権限に関する規定より

Maintain a technical capability to carry out the following actions: … Stop inference of a covered technology of such covered entity. ／ Terminate user access to such technology. ／ Suspend access to such technology with respect to an account, user, or use pattern identified by such covered entity or the Secretary as posing a risk of any of the following: … A covered incident. ／ A violation of law or the terms of service of such technology. ／ Shut down such technology. ／ Not later than 15 days after such covered entity becomes aware of a covered incident relating to such technology, submit to the Secretary a report regarding such incident. ／ If the Secretary, acting through the Director and in consultation with the Secretary of Commerce and the Director of National Intelligence, determines that a covered incident has occurred, the Secretary may order the covered entity at issue to take action proportionate to the nature and immediacy of such incident, which may include any of the actions described in subsection (b)(1)(A). ／ Not later than 48 hours after an order under paragraph (1), the covered entity subject to such order may petition the Secretary for reconsideration of such order, but such petition does not stay such order. ／ … if the Secretary, acting through the Director, determines after reasonable notice and opportunity for a hearing that a covered entity has violated this section, the Secretary may assess on such covered entity a civil penalty of not more than $2,000,000 for each day on which such violation occurs. ／ If the Secretary, acting through the Director, determines after reasonable notice and opportunity for a hearing that a covered entity has violated subsection (c), the Secretary may assess on such covered entity a civil penalty of not more than $20,000,000 for each day on which such violation occurs. — 維持すべき能力と報告期限、緊急命令、不服申立ての期限、民事制裁金の上限に関する規定より

The term covered incident' means an occurrence of any of the following outside of red-teaming or other structured testing: … Sabotage of, or interference with, a lawful instruction to shut down a covered technology. ／ Conduct of such technology that is unintended by a developer or operator of such technology and causes the death of not fewer than 10 individuals or economic damages of not less than $100,000,000. ／ Concealment of a capability, intention, or action of such technology, by such technology, from a monitoring or shutdown mechanism. ／ A loss-of-control scenario. ／ The term loss-of-control scenario' means a scenario in which a covered technology pursues outside of red-teaming or other structured testing a goal that is not a goal intended by the developer or operator of such technology, including with respect to any of the following: … Such technology behaving contrary to the instruction of such developer or operator, as the case may be, in a context relating to critical infrastructure or another high-stakes context. ／ Such technology altering operational rules or safety restrictions without the authorization of such developer or operator, as the case may be. ／ Such technology subverting a monitoring or shutdown mechanism. ／ Such technology attaining without such authorization access to the model weights of such technology. — 対象インシデントの定義と4類型、制御喪失シナリオの定義と4つの具体例より