Google adds TPU 8tx and TPU 8i Max, its fourth TPU system this year
- Google expanded its eighth-generation TPU lineup with TPU 8tx for hardware-level secure and confidential inference and TPU 8i Max for massive context windows and the highest compute density per rack.
- This is the first time Google has introduced four TPU systems in a single year, after TPU 8t and TPU 8i debuted at Cloud Next in April with up to 2.7x better training performance and 80% better inference price performance versus the prior generation.
- Google says TPUs are now a rapidly growing business with nearly 100 customers, including frontier labs, trading firms, retailers and universities, and that customers can now deploy TPUs directly into their own data centers.
- The post says Google is widening access with PyTorch (TorchTPU) support, open-source software and automated developer tools, and that TPUs are increasingly co-designed with feedback from external organizations, not just Google DeepMind.
- The announcement carries no specs, watt per token or price per token figures, a gap Hacker News commenters flagged repeatedly; the post itself points readers to a broadcast and the Google Cloud site for details.
Hacker News opinions
Typical Google. The headline says they're opening TPUs up to every developer and then there's zero info on how I actually use one. No link, no tutorial, nothing.
It's just a simple twenty-seven step process neatly spread across three portals. Documentation coming soon, of course.
There's a TorchTPU section with a link, and the quickstart is one search away. 'TPU developer hub' gets you there.
Why doesn't Google just sell these? Feels like they're leaving money on the table.
They do sell them now, and Anthropic bought a bunch. Oracle said it's putting TPUs in its cloud next year too, alongside Cerebras systems.
Keeping them mostly in-house is the competitive advantage. That's how they get lower cost per inference, and you can rent them on GCP anyway.
Nearly 100 customers in 10 years is not the flex they think it is.
Plenty of people use them indirectly. Apple Intelligence and Anthropic both run on TPUs, and all your Gemini traffic does too.
Where's the watt per token or dollars per token for each of these? And how does each compare to the Nvidia part at the same price?
A product announcement page with zero links to purchase is useless.
You're not the target market. That's like calling a chemotherapy announcement useless because there's no buy button for you.
Am I the only one who finds this writeup thin? I genuinely can't tell how this compares to anything else.
It's a marketing announcement, so that's the right level of detail for the audience. The technical stuff is available elsewhere.
The article says TPU 79 times and never once spells out Tensor Processing Unit.
If you're reading the follow-up about two new variants of the eighth generation, you probably already know what a TPU is. Click the earlier links.
I just want a newer TPU on Colab. The best we can get is v6e-1 and that's too small for serious work.
I work in this space at Google, opinions my own. You benefit indirectly because it gives Nvidia a competitor in the datacenter and takes pressure off the GPU market.
I'm ready for the post-agentic era. Agentic has to be the most proclaimed era in history.
I can't take anyone who says agentic seriously.
8t for training, 8i for reasoning, 8i Max for context, 8tx for security. You had one job, Google.