Stewart Squared
Episode #109: Are We Building the Dark Fiber of AI?
- AI & Agents
- Anthropic IPO
- Dario Amodai
- existential risk
- regulatory capture
- OpenAI
- product liability
- Sam Altman
- alignment
This video isn't available here. Try YouTube, or listen to the audio below.
Watch on YouTubeAudio only
Download MP3The podcast cut, with the show intro. For low bandwidth, listening with the screen off, or taking it with you.
About this episode
Key Insights
1. The Anthropic IPO is expected to proceed despite concerns about existential AI risk because the company and its banks have assessed liability issues and determined they can move forward with the offering. Both Anthropic and OpenAI need to go public to access capital, as they are consuming cash at rates that will eventually push private investors to demand public markets access. The companies can raise additional private rounds, but going public provides access to much larger pools of capital through both initial offerings and secondary offerings that would be necessary to sustain their operations over time. 2. Product liability is emerging as the critical regulatory framework for AI companies, comparable to how Boeing is responsible for making safe aircraft. A key legal case against Meta demonstrated that companies can be held liable for products they knew created harm, even if not intentionally. However, the concern is that waiting fifteen years for product liability cases to work through the court system may be too slow for AI, which could potentially cause significant harm much faster than social media did. This is why companies like Anthropic and OpenAI are proactively positioning themselves to demonstrate they are taking alignment and safety seriously. 3. California has established itself as the leading state in asserting regulatory control over AI companies within its borders, with Governor Newsom implementing state laws that address AI safety issues. This represents a broader pattern where California reserves rights for state control that supersedes federal authority, similar to how California set automotive pollution standards that became national standards. Since most major AI companies are headquartered in California, the state has significant leverage, and this state-level regulation is filling a vacuum left by federal inaction on AI governance. 4. Foundation models have essentially no patentable intellectual property because you cannot patent a black box. Unlike traditional technology companies that can protect specific implementations through patents, AI companies rely almost entirely on trade secrets, particularly around how quickly they can retrain and regenerate their foundation models. This creates a fundamental risk for companies like Anthropic and OpenAI in their IPO filings, as they must disclose that they have no patent protection and that their competitive advantage rests on trade secrets that could potentially be replicated by competitors. 5. Anthropic appears to be positioning itself strategically in biotechnology and medicine, using its foundation models to advance biological research. The company has released drivers for lab equipment and industrial robots that dramatically reduce the time needed to develop software for laboratory instruments from weeks to days. This biotech focus may provide Anthropic with actual patentable intellectual property through specific implementations of medicines or biological tools, unlike the foundation model itself, and this could be a major component of their IPO narrative to investors seeking a defensible moat. 6. A new company called Jev has emerged as a potentially disruptive force in the AI industry by replacing the classifier component of large language models with a more efficient probability matrix system that does not think in tokens. Jev explicitly counter-positions against Anthropic and OpenAI with the tagline build prod not god, rejecting existential risk narratives entirely. The company raised a forty million dollar seed round at a roughly two billion dollar valuation and could fundamentally change the economics of AI by dramatically reducing computational requirements, which poses an existential threat to NVIDIA's dominance in AI accelerators and could make current massive data center investments obsolete. 7. The timing of Anthropic's IPO has shifted to mid-October through mid-November because the company will need to include third quarter financial results in their S-1 filing. Whether that quarter shows profitability and how much cash the company consumed will be critical factors in pricing the IPO and determining how much capital they can raise. Key risks that must be disclosed include dependence on founder Dario Amodei as a key person, the lack of patent protection, reliance on trade secrets, potential loss of control over the intelligence they create, and now potentially the emergence of architecturally different approaches like Jev that could undermine their competitive position.
Timestamps
00:00 Discussion begins about whether Anthropic's IPO will happen despite liability concerns around Dario's frontier pacing post and existential risk warnings to investors 05:00 Exploring product liability frameworks for AI through Meta case study and examining why OpenAI and Anthropic need public markets for sustained capital access 10:00 Breaking down federal versus state regulatory control with California's leading role as Newsom establishes state-level AI regulations where most companies are headquartered 15:00 Analyzing the duopoly between OpenAI and Anthropic while introducing new entrant JEV as potential disruptor to the foundation model economics 20:00 Understanding classification systems evolution from eighties ontologies through neural networks to modern transformer architectures and their computational requirements 25:00 Examining how robots will adapt to existing human spaces rather than redesigning homes, comparing to failed barcode experiments and autonomous vehicle development 30:00 Discussing industrial robotics applications like leak detection with ultrasonic sensors while consumer humanoid robots remain decades away from solving tactile challenges 35:00 Evaluating Anthropic's biotech IP strategy as core IPO positioning since foundation models lack patentable black box protection unlike traditional university technology 40:00 Comparing SpaceX IPO risk disclosure template while questioning whether regulatory capture through METR creates competitive moats beyond existential risk narratives 45:00 Debating government versus private evaluation frameworks as Dario proposes multinational oversight rather than single nation control over AI safety standards 50:00 Introducing JEV's probabilistic classifier replacing token-based reasoning with dramatically lower hallucination rates and reduced compute costs threatening incumbent economics 55:00 Speculating whether architectural shifts like JEV could obsolete GPU-dependent hyperscale infrastructure creating dark fiber scenario for existing data center investments 60:00 Projecting October to November IPO timeline requiring third quarter profitability disclosure while assessing whether JEV represents material risk requiring s-one documentation
Episode transcript
Observer there. They can hear us. We haven't started recording yet, and we are about to. Welcome to the Stewart Squared podcast. Got another exciting episode.
Yes. Because they know they obviously knew that Dario was gonna post the the frontier should be paced. And they obviously had studied that and understood the liability issues
As a risk. This will all be m e s one once it's published, and they felt and their banks felt that they could get out despite despite the threat of wiping out humanity. So I think they've scoped that out. OpenAI also still plans on going public, actually needs to go public, so does Anthropic. They just Why
The money. They need the cash. They can keep raising privately, but at some point, the private investors are gonna push back. And Open Air is in the process of raising another round. So they'll raise another, you know, x billions of dollars somewhere between 50 and 75.
So they'll have the cash, but it but they are consuming cash prospectively for so long that they need to be public to get the cash from the offering and to be able to raise, you know, the secondary offerings. And and to be public, they they get access to much more capital. So And yeah. Yeah. So going forward, right, that's the plan, obviously, the plan.
Your first full transcript is free. After that, an email opens every transcript in the index — a list of readers we can write to, not a guest book.