Crazy Wisdom
Episode #495: The Black Box Mind: Prompting as a New Human Art
- AI & Agents
- Creativity & Craft
- PromptLayer
- AI engineering
- large language models
- prompting
- reasoning
- implicit knowledge
- explicit knowledge
- evals
This video isn't available here. Try YouTube, or listen to the audio below.
Watch on YouTubeAbout this episode
Timestamps
- 00:00Stewart Alsop opens with Jared Zoneraich, who explains PromptLayer as an AI engineering workbench and discusses reasoning, prompting, and Codex.
- 05:00They explore implicit vs. explicit knowledge, how subject matter experts shape prompts, and why evals matter for scaling AI workflows.
- 10:00Jared explains eval methodologies, backtesting, hallucination checks, and the difference between rigorous testing and iterative sprint-based prompting.
- 15:00Discussion turns to observability, debugging, and the shift from deterministic to probabilistic systems, highlighting skill issues in prompting.
- 20:00Jared introduces “LM idioms,” vibe coding, and context versus content—how syntax, tone, and vibe shape AI reasoning.
- 25:00They dive into vibe coding as a company practice, cloud code automation, and prompt versioning for building scalable AI infrastructure.
- 30:00Stewart reflects on coding through meditation, architecture planning, and how tools like Cursor and Claude Code are shaping AGI development.
- 35:00Conversation expands into AI’s cultural effects, optimism versus doom, and critical thinking in the age of AI companions.
- 40:00They discuss philosophy, history, social fragmentation, and the possible decline of social media and liberal democracy.
- 45:00Jared predicts a fragmented but resilient future shaped by agents and decentralized media.
- 50:00Closing thoughts on AI-driven markets, polytheistic model ecosystems, and where innovation will thrive next.
- PromptLayer as AI Infrastructure – Jared Zoneraich presents PromptLayer as an AI engineering workbench—a platform designed for builders, not researchers. It provides tools for prompt versioning, evaluation, and observability so that teams can treat AI workflows with the same rigor as traditional software engineering while keeping flexibility for creative, probabilistic systems.
- Implicit vs. Explicit Knowledge – The conversation highlights a critical divide between what AI can learn (explicit knowledge) and what remains uniquely human (implicit understanding or “taste”). Jared explains that subject matter experts act as the bridge, embedding human nuance into prompts and workflows that LLMs alone can’t replicate.
- Evals and Backtesting – Rigorous evaluation is essential for maintaining AI product quality. Jared explains that evals serve as sanity checks and regression tests, ensuring that new prompts don’t degrade performance. He describes two modes of testing: formal, repeatable evals and more experimental sprint-based iterations used to solve specific production issues.
- Deterministic vs. Probabilistic Thinking – Jared contrasts the old, deterministic world of coding—predictable input-output logic—with the new probabilistic world of LLMs, where results vary and control lies in testing inputs rather than debugging outputs. This shift demands a new mindset: builders must embrace uncertainty instead of trying to eliminate it.
- The Rise of Vibe Coding – Stewart and Jared explore vibe coding as a cultural and practical movement. It emphasizes creativity, intuition, and context-awareness over strict syntax. Tools like Claude Code, Codex, and Cursor let engineers and non-engineers alike “feel” their way through building, merging programming with design thinking.
- AI Culture and Human Adaptation – Jared predicts that AI will both empower and endanger human cognition. He warns of overreliance on LLMs for decision-making and the coming wave of “AI psychosis,” yet remains optimistic that humans will adapt, using AI to amplify rather than atrophy critical thinking.
- A Fragmented but Resilient Future – The episode closes with reflections on the social and political consequences of AI. Jared foresees the decline of centralized social media and the rise of fragmented digital cultures mediated by agents. Despite risks of isolation, he remains confident that optimism, adaptability, and pluralism will define the next AI era.
Episode transcript
Welcome to the Crazy Wisdom Podcast. This podcast is for you. If you have an insane drive to find the truth of things, it's not the good answers that we seek, but the good questions. I interview a range of different guests from many different fields, all with the intention to uncover the simple truths that are hidden in plain sight. Most people don't want to go there. I go there, my guests go there, and you benefit. Please let me know if you enjoy these episodes and as always, subscribe on itunes, Spotify, or wherever you listen to the podcasts. Welcome to the Crazy Wisdom Podcast. I've got Jared Zahnerich here and he is the CEO, co founder of Prompt Layer. Welcome to the show. Thanks for having me. So what is your favorite prompt these days?
Ooh, my favorite prompt. Anything. Anything. Claude? Code. Anything. Codex. Trying to. Trying to get it to. Making. Making it research. Think before acting. You know, something that's hard for humans too.
Do you think it's really reasoning? Do you think there's really reasoning going on, or is it a mirage of reasoning?
I. I think with reasoning and intelligence and this whole question of does the AI think or not. I think I like the word mirage that you use. It's like it's reasoning in the way that it could trick humans to thinking it's reasoning. I don't think it's reasoning in the biblical sense of what intelligence is.
Your first full transcript is free. After that, an email opens every transcript in the index — a list of readers we can write to, not a guest book.