Cerebras: Insights from the Mega IPO

Steven Guan

• 6 min read

chat.jpg

I just attended an event featuring Cerebras CEO Andrew Feldman, where I listened to him share the story behind this dark horse AI chip company that recently completed a mega IPO valued at nearly $100 billion. The biggest question in the industry right now is whether they can truly gain a firm foothold under the monopoly of the tech giants, and from a secondary market perspective, whether this is a core asset worth holding long-term. Combining his on-stage sharing with my follow-up discussions with him alongside other audience members, here are a few of my genuine takeaways.


Breaking the "Memory Wall"

To understand this company, we have to go back to their early days.

The Status Quo: When they started in 2016, the entire industry was focused on standard horizontal clustering of small chips. At the time, some startups chose a relatively safe route: manufacturing normal-sized chips filled entirely with SRAM.

The Latency Cost: This approach was less error-prone technically, but the cost was steep: to hold a large model, you have to tile and connect thousands of chips, and the moment data transfers across chips, the speed drops exponentially—running about 10,000 times slower.

The Wafer-Scale Bet: From the very beginning, Andrew's team refused to make marginal 8% improvements in a lane carved out by others. They bet on an incredibly difficult path—building a giant chip that takes up the largest square you can cut out of an entire 300-millimeter wafer. By tightly integrating massive amounts of memory and compute cores on the same giant silicon wafer, they completely contained data communication within the chip.

Overcoming Yield: At the time, the entire industry thought it was impossible because if even a single physical flaw appeared on the wafer, the whole chip would be ruined. To overcome this yield trap, they managed to figure out a redundancy design borrowed from the memory industry, utilizing redundant identical tiles so the system can naturally withstand flaws.

The Culture of Grit

What sustained them through those darkest hours was a fundamental character trait ingrained in the team's bones. When discussing hiring and team culture, Andrew specifically emphasized grit and determination.

  • He shared an interesting story regarding a famous Stanford University study tracking geniuses.
  • The study recruited a large group of kids with unbelievably high scores on IQ tests, but ultimately, not a single one of those super-geniuses won a Nobel Prize.
  • Conversely, two individuals who were initially rejected from the program for failing to meet the IQ test threshold later became Nobel laureates.
  • He used this to illustrate that once you cross the baseline of being smart, what truly accounts for the ceiling of your achievements is persistence and grit.

Future Technical Conflicts

During the Q&A, I asked him about some future technical conflicts.

Software Ecosystem: Facing NVIDIA's CUDA and Google TPU's JAX and XLA ecosystems, will Cerebras's own software stack become a shortcoming? His answer was very direct: this is not a question of whether the technology can be built, it's simply a matter of time. Rebuilding the software ecosystem relies on continuous time and capital investment, which they have clear expectations for and are willing to wait out.

End-to-End Efficiency: Right now, their inference speed is blazingly fast, but in actual business operations, a massive amount of prerequisite tasks and scheduling runs on the CPU. How do they solve this? His answer showed extreme restraint: leave the CPU problems to the companies that make CPUs. Their strategy is highly focused—putting all their energy into a single breakthrough point to push inference to the absolute limit.

The TSMC Supply Chain

Audience members also raised the widely-held concern about the supply chain: given the massive scale of current tech giants, why would TSMC allocate capacity to Cerebras?

Ecosystem Balance: Andrew revealed that TSMC's long-term strategy is to maintain the balance of its customer ecosystem and prevent being completely hijacked by one or two giants.

Historical Precedents: He cited real historical examples: when Apple first decided to step in and make its own chips, and when AWS acquired an Israeli startup to start building chips, they both started as very small customers. TSMC knows full well that disruptive innovation often comes from these early game-changers.

Capacity Allocation: Consciously reserving capacity for high-growth innovative companies is TSMC's strategy for checks and balances. Last year, Cerebras wasn't even in the top 150 of TSMC's customers, but this year they will be a top 15 customer, and next year top 8. As long as there is real growth, capacity is not an insurmountable obstacle.


Conclusion and a "Fun Fact"

Overall, on whether this company is a worthwhile long-term hold: they are not an opportunistic startup, but trailblazers with a pragmatic engineering culture, extremely high barriers to entry, and a resilient character flowing in their veins. If you believe in the logic of fundamentally restructuring hardware and are willing to give its software stack a period to mature, this is an asset with very solid fundamentals that is absolutely worth holding long-term.

Finally, I'll share an interesting story: When the moderator asked how the company plans to deploy the $5.5 billion in fresh cash they just raised from the IPO, Andrew didn't immediately paint a blueprint for expanding production. Instead, he mentioned an anecdote—the sum of money was so large that Morgan Stanley couldn't even wire it all at once because their single wire limit is $5 billion, forcing them to send it in two separate wires. Facing this astronomical amount of funds, Andrew recalled with considerable emotion, "We didn't start out that way". He remembered the long years from 2017 to 2019 when they couldn't solve their technical problems, burning through $8 million a month and having to bite the bullet every six weeks at board meetings to tell investors, "Yeah, we're continuing to destroy your money". Contrasting that with today's nearly $100 billion market cap, this is perhaps the most authentic and awe-inspiring portrayal of hardcore tech entrepreneurship.

all.jpg

Share this post

📬 Stay Updated

Get notified when I publish new posts. No spam, unsubscribe anytime.

Already have an account? sign in to manage subscription.

RELATED_SIGNALS
In the AI Era, the Boundary of Expertise Has Blurred

In the AI Era, the Boundary of Expertise Has Blurred

A family member had a nosebleed that wouldn't stop for two hours. Every consumer AI told me to go to the ER and refused to say anything useful. Then I changed the question — and got the actual protocol.

3 MIN