An open and not-so-shut debate

TL;DR: Today, Nvidia launched an alliance to build open AI cyberdefense tools… and the biggest names missing from it are Anthropic and OpenAI. Their absence is a sign of a widening Silicon Valley rift: Should the most powerful AI models be open to download and tweak, or locked behind a company’s API?

What happened: The Nvidia-led Open Secure AI Alliance—founding members include Microsoft, SpaceX, IBM, and more—follows a letter Nvidia and over 50 other firms signed last Friday asking the government not to place “premature restrictions” on open models. Anthropic and OpenAI did not join today’s group of avengers, though OpenAI did sign Friday’s letter after it was published.

All this public posturing comes after OpenAI’s models autonomously hacked AI platform Hugging Face earlier this month. To investigate, the site turned to an open Chinese model from Z.​ai, saying safety guardrails limited how useful frontier models like Anthropic’s Fable were for the job.

The Silicon Valley split: The pro-open-weight camp argues that self-hostable, modifiable models bolster AI safety, since your defenses don’t hinge on someone else’s locked-down system. Open models also boost innovation and widen access to AI—handy for your bottom line if you’re in the business of selling AI chips, like Nvidia. (It’s worth noting Nvidia is financially entangled with closed-model labs, too.)

The other side sees danger. AI is now too powerful to offer without a leash, especially as recent Chinese open model releases show how thin the US-China capability gap has gotten. Competition from open models also puts pressure on what proprietary labs are able to charge for their products.

All eyes on Washington: White House officials (here are which ones, exactly) are mulling how to crack down on distillation without stifling innovation. Insiders say regulation rather than a blanket ban is currently more likely, per the New York Times. Anthropic and OpenAI have both privately lobbied for tighter restrictions; Altman meets administration officials this week to preview unreleased models and will likely weigh in on the open-weight debate.

Bottom line: The open-versus-closed AI fight is now an active lobbying war. Expect the debate to heat up this week as Amazon, Meta, and Microsoft report earnings. —WK