Many users criticized military AI contracts involving frontier LLMs for enabling mass surveillance and autonomous systems without ethical safeguards or corporate transparency.
Based on 16 visible X reactions from 1 accounts; directional sample.
Ask a question below.
Published answers will appear here.
None of this is new. DeepMind's governance record: 2014: independent ethics board — reportedly a condition of the sale 2015: one informal meeting; then effectively abandoned 2018: AI Principles exclude weapons & surveillance 2025: exclusions dropped 2026: Pentagon contract https://x.com/BlackHC/status/2077009664794046875/photo/1
An AI system instructed to suppress a protest does not feel the moral weight of that order. It will not hesitate, unless it is appropriately aligned. Soldiers are required by law to refuse manifestly illegal orders. I know of no such requirement for autonomous military AI.
The reported contract does not exclude mass surveillance, and it keeps paths open that could extend to autonomous policing. These don't defend us against foreign adversaries. They shift power from citizens toward the state, in ways that are very hard to reverse.
What should happen now? Google should publish the terms, or enough of them to show whether enforceable safeguards exist and what visibility remains in classified deployments. And it should tell employees what was signed. We need laws, not policy memos.
None of this is new. DeepMind's governance record: 2014: independent ethics board — reportedly a condition of the sale 2015: one informal meeting; then effectively abandoned 2018: AI Principles exclude weapons & surveillance 2025: exclusions dropped 2026: Pentagon contract https://x.com/BlackHC/status/2077009664794046875/photo/1
An AI system instructed to suppress a protest does not feel the moral weight of that order. It will not hesitate, unless it is appropriately aligned. Soldiers are required by law to refuse manifestly illegal orders. I know of no such requirement for autonomous military AI.
The reported contract does not exclude mass surveillance, and it keeps paths open that could extend to autonomous policing. These don't defend us against foreign adversaries. They shift power from citizens toward the state, in ways that are very hard to reverse.
What should happen now? Google should publish the terms, or enough of them to show whether enforceable safeguards exist and what visibility remains in classified deployments. And it should tell employees what was signed. We need laws, not policy memos.
But today's LLMs are not robust enough to make life-and-death decisions on their own. They hallucinate. They fail in surprising, banal ways. They should not be used for targeting decisions or as part of autonomous weapons. And the bigger problem isn't military use at all.
This is not science fiction. ICE reportedly used facial recognition around protesters earlier this year. Connecting such tools to frontier models is a small step. And purported protections often cover only "U.S. persons." Non-Americans abroad don't appear covered at all.
Many users criticized military AI contracts involving frontier LLMs for enabling mass surveillance and autonomous systems without ethical safeguards or corporate transparency.
Based on 16 visible X reactions from 1 accounts; directional sample.
Ask a question below.
Published answers will appear here.
This is not science fiction. ICE reportedly used facial recognition around protesters earlier this year. Connecting such tools to frontier models is a small step. And purported protections often cover only "U.S. persons." Non-Americans abroad don't appear covered at all.