By Lina Irawan 
Palmer Luckey, the visionary founder of defense technology company Anduril, which is dedicated to modernizing the U.S. military, offers a decidedly unequivocal answer: the power must reside with the government. In a recent candid interview with the New York Post, the billionaire entrepreneur weighed in on this burgeoning debate, asserting that ceding control to private corporations risks undermining the very foundations of democracy. For Luckey, the determination of how AI is deployed, particularly in sensitive government and defense applications, should be made by elected officials and their appointed agencies, acting on behalf of the populace. To suggest otherwise, he contends, is to advocate for a "corporatocracy" where unelected tech executives wield undue influence over national policy and security.
Luckey’s philosophy is rooted in a belief that democratic accountability is paramount when dealing with technologies as transformative and potentially disruptive as AI. "We need to stick to a position that this is in the hands of the people," he stated emphatically. "Anyone who says that a defense company should be going beyond the law, beyond what legislators and elected leaders say in terms of who they’ll work with and not, you are effectively saying you do not believe in this democratic experiment, that you want a ‘corporatocracy.’" He continued, clarifying his own company’s position: "In all cases, whoever the United States government tells me that I can and cannot sell to, to have any other position is to fall further into… basically corporate executives having de facto control over U.S. foreign policy." His stance underscores a traditional view of civilian control over the military and governmental functions, arguing that the private sector’s role is to serve, not dictate.
Luckey’s comments arrive amidst a high-profile confrontation between the Pentagon and Anthropic, a prominent AI research company co-founded by former OpenAI executives who explicitly prioritize AI safety. Anthropic CEO Dario Amodei has publicly refused to grant the Department of Defense full, unrestricted access to the company’s advanced AI systems for purposes such as mass surveillance or to power fully autonomous weapons that operate without human oversight. This ethical stand, driven by the company’s stated mission to develop "safe and beneficial AI," has placed it in direct opposition to the Pentagon’s operational demands.
The fallout was swift and significant. The Department of Defense, viewing Anthropic’s refusal as a critical impediment to national security interests, officially designated the AI company as a "supply-chain risk." This label is typically reserved for foreign adversarial firms, most notably Chinese technology giants like Huawei, which the U.S. government has long suspected of posing national security threats through potential backdoors or state influence. The severity of this designation highlights the Pentagon’s perception of the strategic importance of AI and its frustration with private companies setting boundaries on its use. Amodei, however, has downplayed the immediate business impact of the label and has indicated Anthropic’s intention to sue to overturn the designation, signaling a protracted legal and ethical battle. Despite the escalating tension, Anthropic maintains it remains in discussions with the Pentagon, seeking common ground on the responsible deployment of its AI models and tools.
Amodei, along with Anthropic’s other co-founders, many of whom departed OpenAI over concerns about the perceived commercialization and safety compromises there, firmly believe that the Pentagon’s requests cross an unacceptable ethical line. In a recent press release, Amodei reiterated their unwavering commitment: "These threats do not change our position: We cannot in good conscience accede to their request." This principled stand reflects a growing movement within the AI community to establish ethical guardrails, particularly concerning military applications where the potential for harm, unintended consequences, and the erosion of human control is highest. The debate isn’t merely about who controls the technology, but how it is controlled and for what purposes.
The conflict between Silicon Valley’s ethical frameworks and Washington’s strategic needs is not new, but the stakes have been dramatically raised with the advent of powerful, general-purpose AI. The Department of Defense, supported by figures like Luckey, asserts that it is not within the purview of a private contractor to dictate the terms of engagement for national defense. They argue that such decisions are the exclusive domain of the government, reflecting the will of the people and guided by national security doctrines.
In stark contrast to Anthropic’s resistance, other leading AI companies have shown a willingness to collaborate more closely with the Pentagon. Shortly after the Anthropic agreement reportedly faltered, Sam Altman’s OpenAI, a former partner of Anthropic’s founders, reportedly reached an agreement with the Pentagon to allow the use of its AI models and tools for military applications. Similarly, Elon Musk’s xAI also secured a deal to provide its AI, including the Grok model, to the Pentagon, adding a layer of competition and further demonstrating the divergent paths within the tech industry. These agreements underscore the complex motivations at play: competitive advantage, financial incentives, and perhaps a belief that working with the government is the most effective way to shape AI’s deployment.
This isn’t the first time a major tech company has drawn a line in the sand regarding military contracts. As Luckey himself referenced during his interview, Google famously withdrew from Project Maven in 2018. This initiative involved using AI to analyze drone footage, a project that sparked widespread internal dissent among Google employees. Thousands protested, expressing profound ethical concerns that their work could be contributing to the development of autonomous weapons systems and potentially lead to unintended civilian casualties or a lack of human accountability in warfare. Google’s decision to pull out was a landmark moment, demonstrating the power of employee activism and establishing a precedent for tech companies to define their own moral boundaries, even at the cost of lucrative government contracts.
Luckey views such corporate withdrawals as fundamentally dangerous. "What you would have had is a world where Silicon Valley executives would have had more foreign policy power than the president of the United States," he argued. "That’s really, really dangerous." For Luckey, the core issue boils down to a fundamental question of authority: do top-level decisions on AI’s usage belong to Silicon Valley or Washington? His unwavering view is that regardless of who occupies the White House, tech companies and the private sector broadly have a moral and civic responsibility to adhere to that administration’s foreign policy decisions. This perspective aligns with traditional notions of corporate citizenship, where private enterprise supports national objectives within legal and regulatory frameworks.
However, the counter-argument from companies like Anthropic is not necessarily about dictating foreign policy, but about upholding universal ethical principles and mitigating catastrophic risks inherent in powerful AI. They argue that as the creators of these technologies, they bear a unique responsibility to ensure they are used safely and ethically. The concern isn’t just about autonomous weapons, but also the potential for mass surveillance to erode civil liberties, or for AI to make decisions without sufficient human oversight, leading to unintended and irreversible consequences. This perspective often emphasizes the "dual-use" nature of AI—its capacity for both immense good and profound harm—and the moral obligation of its developers to prevent the latter.
The ongoing global competition in AI development further complicates this debate. Nations like China are investing heavily in AI, including for military applications, often without the same ethical constraints or public scrutiny found in democratic societies. This creates immense pressure on the U.S. government to ensure it maintains a technological edge, leading to calls for rapid integration of advanced AI into its defense infrastructure. From Washington’s perspective, restrictions imposed by private companies could be seen as hindering national security and potentially ceding strategic advantages to adversaries.
Despite the pronounced disagreements, both sides acknowledge the necessity of dialogue. Amodei, in a subsequent press release, reflected this sentiment, stating, "Anthropic has much more in common with the Department of War than we have differences." This suggests that while the specific terms of deployment remain contentious, there is an underlying recognition of shared goals, perhaps in maintaining technological leadership or ensuring national security, albeit through different means and with different ethical red lines.
The struggle between Silicon Valley and Washington over AI control is more than a mere contract dispute; it is a microcosm of a larger societal challenge. It forces a reckoning with fundamental questions of democratic accountability, corporate responsibility, technological ethics, and national sovereignty in the age of artificial intelligence. As AI continues its rapid evolution, the frameworks for its governance—whether led by legislative bodies, international treaties, or the self-imposed ethics of its creators—will determine not only the future of warfare and surveillance but also the very fabric of democratic societies. The resolution, or ongoing tension, in this debate will profoundly shape the ethical landscape of the 21st century.