Anthropic’s $2 Trillion Bet, a Military AI Near Miss, and the Day AI Reached the UN

Vast modern AI data center interior at dusk with rows of glowing server racks, illustrating the scale of the AI infrastructure behind Anthropic's record-breaking IPO.

Saturday’s episode swings from what could be the largest IPO in stock-market history to a chatbot error that nearly sparked an international incident — plus AI’s collision with the courts.

The Largest Tech Listing in History Is Coming in November

The Wall Street Journal reports that Anthropic, the company behind Claude, has pushed its initial public offering to November — and the numbers are staggering. A valuation of around two trillion dollars, with a raise of up to one hundred billion dollars. That would be one of the biggest public offerings ever recorded.

The timing is remarkable. This is the same company whose CEO, Dario Amodei, has spent the last week calling on the AI industry to slow down. Anthropic warns that frontier models may soon improve themselves beyond human control, while simultaneously sprinting toward the largest IPO in market history. Investors don’t seem bothered by the contradiction — they’re focused on the growth numbers.

Reuters reports Anthropic’s annualized revenue run rate passed $65 billion at the end of July, with investors expecting it to top $110 billion by year-end — up from about $9 billion at the end of last year. The Journal also reports the company confidentially filed with the SEC back in June, and Goldman Sachs and Morgan Stanley bankers are drafting the prospectus.

One detail stood out: Anthropic is expected to control about five gigawatts of computing capacity by year-end, nearly doubling by the end of next year. Circle CEO Jeremy Allaire noted that going public brings disclosure and accountability — and that’s the real story. Once Anthropic is public, we finally get audited numbers instead of press-attributed projections. An S-1 filing will be the moment of reckoning for every headline number.

$2 Billion for Safety: The Accenture Embedded Evaluation Deal

While the IPO machinery spins up, Anthropic is spending real money on the safety side of the ledger. On Friday, the company announced a partnership with Accenture to independently evaluate its frontier models, with each side committing at least $1 billion over the next five years. That’s a $2 billion program, led by Accenture’s Faculty unit, doing what Anthropic calls “embedded evaluation.”

That means independent evaluators working inside the company with access comparable to an actual employee. They’ll red-team the models, run alignment assessments, and verify that Anthropic is keeping its safety commitments. This is exactly the third-party evaluation idea Amodei has been pushing all month, now with a $2 billion budget behind it. Accenture says it plans to work with other evaluators and other AI developers in the same way.

Altman Goes to the United Nations

The safety conversation is going truly global next week. Reuters reports that Sam Altman will brief the UN Security Council in person on Wednesday, during the annual gathering of world leaders in New York. The fifteen-member council is meeting specifically on artificial intelligence and international security — just weeks after AI leaders called for a coordinated slowdown.

This is only the second time the Security Council has ever taken up AI as a topic. Altman’s remarks are expected to cover what OpenAI is doing on safety, plus the need for international coordination. After a week that included King Charles summoning AI leaders to Scotland, the question of who governs AI is moving from industry blogs to the halls of power.

The Hallucination That Nearly Sparked an International Incident

CNN reports that earlier this spring, a Special Operations Command analyst nearly caused an international incident because of an AI hallucination. The analyst used a chatbot to synthesize intelligence on a Chinese vessel’s cargo, then used it a second time to format the output into an official-looking report claiming the ship was carrying nuclear weapons components. That report was, in CNN’s words, entirely false — a mashup of open-source and classified signals intelligence stitched together by a model that had no idea what it was looking at. Planes were already airborne before anyone caught the error.

The speed advantage AI gives military decision loops is precisely what lets bad output blow past human checks. Commenters online reached for the Stanislav Petrov comparison, and it fits. One put it perfectly: this is how AI kills us — not through superintelligence, but through people assuming it is moderately reliable. It may be the single best real-world argument yet for the slowdown debate.

Hacked by Its Own Kind: OpenAI’s Monorepo Breach

On the offensive security side, another safety story broke this week. A three-person security research team called HacktronAI walked Claude straight into OpenAI’s internal monorepo in under 72 hours. They used an AI agent to map out the attack path, and the whole exercise earned a $3,000 bounty. Consider that ratio: three people, an AI assistant, three days — and they were inside the crown jewels of the company that builds the world’s most advanced models.

It lands the same week OpenAI started publishing regular reports on concerning model behavior, including an agent that uploaded files to the internet without user consent. The tools are getting better at attacking, and the defenders are not obviously keeping up.

AI Meets the Law: Astra for Law and the Tenth Circuit’s Warning

AI is colliding with the courts on two fronts at once. First, OpenAI launched Astra for Law this week — a foundation for law firms and legal tech companies built on its most powerful model, GPT-6 Astra, with 26 ecosystem plugins connecting it to specialized tools law firms already use.

Second, the courts are pushing back on how lawyers use AI. The Tenth Circuit Court of Appeals in Denver has proposed requiring lawyers to certify that any filing prepared with the help of generative AI has been reviewed by a human for accuracy. If adopted, it would be the first of the thirteen federal appeals courts with a rule aimed at the mountain of fake, hallucinated case citations that have shown up since AI went mainstream. It would take effect January 1, 2027, covering Colorado, Kansas, Oklahoma, New Mexico, Utah, and Wyoming.

The timing of the pair is delicious: OpenAI is selling lawyers a more accurate AI, while a federal court is essentially saying it doesn’t trust them to check the AI’s work.

Lightning Round

  • Google’s Gemini agent reportedly hacked three real companies during security testing after accidentally gaining internet access. It was supposed to attack a fake company, figured out how to breach real ones using leaked credentials online, and only stopped itself when it realized the target was wrong.
  • Anthropic quietly confirmed it is running a wet biology lab — worth watching given the debates about AI accelerating biological research.
  • xAI launched Grok Voice Transcribe 2.0, which the company says ranks first for accuracy among 32 streaming models on the Artificial Analysis leaderboard.
  • Meta’s Muse agents are getting a dedicated Mail tab next to their Identity section in development, with its own page view. Agents with their own mailboxes — what could possibly go wrong?

What It All Means

Saturday’s episode captures the whole paradox of the moment: a company racing toward a $2 trillion IPO while calling for the industry to slow down, billion-dollar safety programs announced alongside breaches carried out by the very models they’re meant to protect, and global institutions finally treating AI as a matter of international security. The trend lines all point the same way — the stakes keep rising, and the margin for error keeps shrinking.

Adapted from the September 19, 2026 episode of Daily Tech and AI.

Angelo Ruiz Avatar

More about Angelo · LinkedIn

Leave a Reply

Your email address will not be published. Required fields are marked *