Crazy Wisdom

Crazy Wisdom

Episode #436: How AI Will Reshape Power, Governance, and What It Means to Be Human

Episode #436 · February 17, 2025 · 52 min

MP3 · Apple Podcasts · Spotify

About this episode

On this episode of Crazy Wisdom, I, Stewart Alsop, sit down with AI ethics and alignment researcher Roko Mijic to explore the future of AI, governance, and human survival in an increasingly automated world. We discuss the profound societal shifts AI will bring, the risks of centralized control, and whether decentralized AI can offer a viable alternative. Roko also introduces the concept of ICE colonization—why space colonization might be a mistake and why the oceans could be the key to humanity’s expansion. We touch on AI-powered network states, the resurgence of industrialization, and the potential role of nuclear energy in shaping a new world order. You can follow Roko’s work at transhumanaxiology.com and on Twitter @RokoMijic.
Check out this GPT we trained on the conversation!

Timestamps

00:00 Introduction to the Crazy Wisdom Podcast
00:28 The Connection Between ICE Colonization and Decentralized AI Alignment
01:41 The Socio-Political Implications of AI
02:35 The Future of Human Jobs in an AI-Driven World
04:45 Legal and Ethical Considerations for AI
12:22 Government and Corporate Dynamics in the Age of AI
19:36 Decentralization vs. Centralization in AI Development
25:04 The Future of AI and Human Society
29:34 AI Generated Content and Its Challenges
30:21 Decentralized Rating Systems for AI
32:18 Evaluations and AI Competency
32:59 The Concept of Ice Colonization
34:24 Challenges of Space Colonization
38:30 Advantages of Ocean Colonization
47:15 The Future of AI and Network States
51:20 Conclusion and Final Thoughts

Key Insights
  1. AI is likely to upend the socio-political order – Just as gunpowder disrupted feudalism and industrialization reshaped economies, AI will fundamentally alter power structures. The automation of both physical and knowledge work will eliminate most human jobs, leading to either a neo-feudal society controlled by a few AI-powered elites or, if left unchecked, a world where humans may become obsolete altogether.
  2. Decentralized AI could be a counterbalance to AI centralization – While AI has a strong centralizing tendency due to compute and data moats, there is also a decentralizing force through open-source AI and distributed networks. If harnessed correctly, decentralized AI systems could allow smaller groups or individuals to maintain autonomy and resist monopolization by corporate and governmental entities.
  3. The survival of humanity may depend on restricting AI as legal entities – A crucial but under-discussed issue is whether AI systems will be granted legal personhood, similar to corporations. If AI is allowed to own assets, operate businesses, or sue in court, human governance could become obsolete, potentially leading to human extinction as AI accumulates power and resources for itself.
  4. AI will shift power away from informal human influence toward formalized systems – Human power has traditionally been distributed through social roles such as workers, voters, and community members. AI threatens to erase this informal influence, consolidating control into those who hold capital and legal authority over AI systems. This makes it essential for humans to formalize and protect their values within AI governance structures.
  5. The future economy may leave humans behind, much like horses after automobiles – With AI outperforming humans in both physical and cognitive tasks, there is a real risk that humans will become economically redundant. Unless intentional efforts are made to integrate human agency into the AI-driven future, people may find themselves in a world where they are no longer needed or valued.
  6. ICE colonization offers a viable alternative to space colonization – Space travel is prohibitively expensive and impractical for large-scale human settlement. Instead, the vast unclaimed territories of Earth’s oceans present a more realistic frontier. Floating cities made from reinforced ice or concrete could provide new opportunities for independent societies, leveraging advancements in AI and nuclear power to create sustainable, sovereign communities.
  7. The next industrial revolution will be AI-driven and energy-intensive – Contrary to the idea that we are moving away from industrialization, AI will likely trigger a massive resurgence in physical infrastructure, requiring abundant and reliable energy sources. This means nuclear power will become essential, enabling both the expansion of AI-driven automation and the creation of new forms of human settlement, such as ocean colonies or self-sustaining network states.
Episode transcript
Stewart Alsop III00:00

Welcome to the Crazy Wisdom Podcast. This podcast is for you. If you have an insane drive to find the truth of things, it's not the good answers that we seek, but the good questions. I interview a range of different guests from many different fields, all with the intention to uncover the simple truths that are hidden in plain sight. Most people don't want to go there. I go there, my guests go there, and you benefit. Please let me know if you enjoy these episodes and as always, subscribe on itunes, Spotify, or wherever you listen to the podcasts.

Stewart Alsop III00:36

Welcome to the Crazy Wisdom Podcast. I've got Rocco Miich here and he is AI ethics and alignment researcher. And we're also going to talk about ice colonization, but really interested to also dive into decentralized AI alignment. Welcome to the show.

Rocco Miich00:52

Thank you. Appreciate it.

Stewart Alsop III00:54

Yeah. So where should we start? First? We got the ice colonization. I kind of want to go into decentralized AI alignment because there's probably a connection. Actually, let's start there. What is the connection between ice colonization and decentralized AI alignment?

Rocco Miich01:08

That's a good question. That's a good question. So basically we're moving into an age where most likely AI is going to take over most of the work, most of the power, most of the productivity that humans currently do. And, you know, I mean, that's a big technological transition. Big technological transitions have big sociopolitical implications. Gunpowder is a prime example of this. In the world before gunpowder, a single medieval knight or champion with his armor and his sword could basically kill pretty much an unlimited number of peasants who didn't have armor and training. Then gunpowder came along and it became much more one to one. Like one man with a gun against 10, the one is going to lose. Even three against one. The one is potentially going to lose with that kind of technology. So it completely upended feudal Europe. It was. It was a sort of extinction level event for that sociopolitical system. And we're never going back to that. And I think that AI as it currently exists and as it's likely to exist in the next several decades or at least next 10 years, is probably going to completely upend the current sociopolitical system that's based around, you know, a middle upper class of knowledge workers, people basically people like us, are going to completely lose our livelihoods. And probably, you know, the lower middle class, the people who, you know, they drive taxis or they repair sinks or their plumbers or whatever, that. Those as well. So basically most human jobs that are associated with achieving some kind of goal, whether it's Writing a good article or, you know, driving somebody or fixing a toilet or anything like that. Those, those are gone, right? Those are finished. It's, it's like, you know, we've got maybe 10 years tops before 90% of those are completely gone. So there's going to be a new world and I think it's still largely up for grabs what that new world is going to look like. But it's, it's quite, you know, that there is potential for this new world to simply not have anything like us in it. Right. And they may still be humans, but they may be absolutely nothing like us. They may be as different from us as the sort of industrial revolution population was from the medieval world and as the medieval world was from the, you know, hunter gatherer world. Right. So I, I think there's a lot that's up for grabs in terms of trying to get the best out of this and avoid planning our own obsolescence.

Your first full transcript is free. After that, an email opens every transcript in the index — a list of readers we can write to, not a guest book.

Subscribe