Skip to content

自律型AI兵器システム(LAWS)と「オート戦争」に対する批判的考察:アルゴリズムの脆弱性、高速エスカレーション、および道徳的責任の帰属不可能性 A Critical Inquiry into AI-Driven "Automated Warfare" and Lethal Autonomous Weapons Systems (LAWS): Algorithmic Vulnerabilities, Hyper-Velocity Escalation, and the Moral Responsibility Gap

Oct 2026 · Zenodo (CERN European Organization for Nuclear Research)
Ethics and Social Impacts of AI

Abstract

要旨(日本語) 近年、人工知能(AI)や無人自律システムの進展に伴い、標的の選定や殺傷の判断を機械に委ねる「自動化された戦争(オート戦争)」および自律型致死兵器システム(LAWS)の配備を推進する議論が見られる。推進派は兵士の人的被害低減や戦闘判断の超高速化を利点として挙げるが、これらは軍事技術の不確実性と国際人道法の規範を軽視した技術決定論的過信である。 本稿では、「オート戦争」構想が孕む3つの本質的リスクを批判的に検討する。 1. アルゴリズムの暴走と誤認:AIのハルシネーション(誤判断)や戦場での通信途絶下において、人間の介入なしに暴走を制止できない危険性。 2. 高速エスカレーションの誘発:機械同士の応答連鎖が人間の意思決定速度を超越し、瞬間的かつ破滅的な事態(フラッシュ・ウォー)を招くリスク。 3. 責任の所在の喪失(責任の空白):過誤発生時に機械へ法的・倫理的責任を問うことはできず、国際人道法上の処罰および抑止機能が形骸化する問題。 分析の結果、生死を左右する武力行使において「有意義な人間の関与(Meaningful Human Control: MHC)」の維持が不可欠であると結論付け、国際的拘束力を持つ規制枠組みの早期確立を提言する。 Abstract (English) With recent advancements in artificial intelligence (AI) and autonomous systems, advocacy for "automated warfare"—delegating lethal target selection and engagement decisions to autonomous machines—has gained traction. Proponents often cite the reduction of human soldier casualties and rapid computational processing as key operational benefits. However, this perspective reflects a techno-deterministic optimism that underestimates technical vulnerabilities and fundamentally challenges international humanitarian law (IHL). This paper critically examines three structural risks inherent in fully automated warfare: 1. Algorithmic Failure and Misidentification: The lack of human fail-safes during algorithmic hallucinations or communication cutoffs under hostile electronic warfare conditions. 2. Hyper-Velocity Escalation: The risk of uncontrollable, compounding engagement loops ("flash wars") that exceed human cognitive response times. 3. Erosion of Accountability: The emergence of a "responsibility gap" where machines cannot be held legally or morally liable, undermining the core deterrence mechanisms of IHL. The paper concludes that preserving Meaningful Human Control (MHC) over lethal decisions is a moral and legal imperative, urging the international community to establish legally binding regulatory frameworks against fully autonomous weapon systems.

View source

Similar papers

#artificial intelligence Open access May 2023

Evaluating the Performance of Large Language Models on GAOKAO Benchmark

GAOKAO-Bench is introduced, an intuitive benchmark that employs questions from the Chinese GAOKAO examination as test samples, including both subjective and objective questions that contribute a robust evaluation benchmark for future large language models and offers valuable insights into the advantages and limitations...

Xiaotian Zhang, Chun-yan Li, Yi Zong et al. · 216 citations · ⚡17
#artificial intelligence Open access Jul 2024

Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrieval

This work investigates the possibilities of using LLMs in a resume screening setting via a document retrieval framework that simulates job candidate selection and finds that the MTEs are biased, significantly favoring White-associated names in 85% of cases and female-associated names in only 11.1% of cases.

Kyra Wilson, Aylin Caliskan · 131 citations · ⚡8
#artificial intelligence Review Oct 2025

Ultralytics YOLO Evolution: An Overview of YOLO26, YOLO11, YOLOv8 and YOLOv5 Object Detectors for Computer Vision and Pattern Recognition

This paper presents a comprehensive overview of the Ultralytics YOLO family, emphasizing architectural evolution, benchmarking, deployment, and emerging directions from YOLOv5 through YOLO27, and examines detection, segmentation, depth, classification, pose, oriented detection, tracking, export, quantization, and deplo...

Ranjan Sapkota, Manoj Karkee · 112 citations · ⚡10

The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models

This work revisits schema linking when using the latest generation of large language models (LLMs) and finds empirically that newer models are adept at utilizing relevant schema elements during generation even in the presence of large numbers of irrelevant ones.

Karime Maamari, Fadhil Abubaker, Daniel Jaroslawicz et al. · 109 citations · ⚡19

BadRAG: Identifying Vulnerabilities in Retrieval Augmented Generation of Large Language Models

A novel threat is unveiled in which attackers steer the RAG system's response by injecting malicious passages into its knowledge base, enabling the attacker to steer the response without altering the user input or modifying the RAG weights.

Jiaqi Xue, Meng Zheng, Yebowen Hu et al. · 109 citations · ⚡8

PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selection

Empirically, PRISM reduces the end-to-end time for data selection and model tuning to just 30% of conventional pipelines, and achieves this efficiency while simultaneously enhancing performance, surpassing models fine-tuned on the full dataset across eight multimodal and three language understanding benchmarks.

Jinhe Bi, Yifan Wang, Danqi Yan et al. · 73 citations · ⚡4

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.