Tjheir "ELITE" guide says that during "special operations" normal safeguards may need to be turned off.
Palantir's Maven Smart System ha grown into a Pentagon program of record with 20,000+ active users. "Human in the loop" may become "human rubber stamp" when the number and speed of AI recommendations exceed real human review capacity.
A Palantir-backed program reportedly operated secretly from city council members, defense attorneys, and the public.
Vendor lock-in issue: once a system becomes embedded in agency workflows, switching vendors becomes politically and operationally hard and they are trying their best to achieve this. The Army's $10 billion enterprise agreement consolidating many contracts into one Palantir platform is the cleanest example of institutional dependence.
--- tldr;
The accountability chain is broken: when harm happens, the agency blames the tool, the vendor blames the customer, the operator blames policy, and the model blames the data.
---
Also, I won't share the full report link since whenever I share something like that here, I get banned/flagged for a day.