PodcastsHear the voice. See the shape of the thought.

Oriol Vinyals（Google DeepMind VP of Research、Gemini 联合负责人）在 Google I/O 第二天坐下来，把 I/O 上发布的产品背后的研究路线一条条摊开：世界模型为什么是 Google 押向 AGI 的独特路径、视频 / 图像的"GPT moment"长什么样、Spark 和 agents 系统为什么必须和模型联合优化、scaffolding 终将由模型自己写、memory 应该走非参数 file-system 而不是塞进权重、当今 RL 在哪些维度上是数据受限的、为什么 math/code 上的训练能意外迁移、以及 Google 内部 Brain + DeepMind 合并后研究下注的取舍。 ## [00:00] Intro Jacob 用 60 秒铺垫了 Oriol 的背景（Gemini 联合负责人，与 Noam Shazeer、Jeff Dean 并列），以及 I/O 第二天访谈的优势：所有发布都还热乎，可以直接顺着 announcements 追到背后的研究。Oriol 进来打招呼，两人开始热身。 > *"I've been really excited for this because you're one of the people kind of most directly shaping the frontier of AI."* ## [01:36] Why World Models Jacob 先问"为什么是世界模型"。Oriol 把它拆成两层：一层是 self-improvement / coding 的角度，另一层是模型本身的对象——多模态、不止 closer 还包括 video / image 这种"world model"。Google 早就押了图像和视频路线，这次"显然押对了"，因为我们其实把整个世界都搬到了互联网上。 他也承认中间有一段时间这条路看似不性感：multimodal 模型在 LLM 风口下被边缘化过，但视频和图像里藏着语言抓不到的知识——"the GPT moment for video"还没真正发生，但拐点已经在视野里。 > *"There is lots of knowledge in videos and images, and what I would say is the GPT moment for that — I'm not sure we quite have seen that."* ## [04:21] The GPT Moment for Video Oriol 用 Omni（Google 的多模态产品线）当锚点解释：从单纯把视频喂进上下文，到能在长上下文里理解和生成视频，这段曲线已经很陡。下一步是问"能不能像 LLM 一样，在没有 paired text 的纯图像数据上预训练并依然提取出全部意义和细节"——这个 hard challenge 一旦解开，数据维度会从"被人类描述过的"跳到"所有视频"，量级差异巨大。 他特别承认现在 video 这块的标注数据相对 image 仍然稀缺，但解锁后的回报会"非常大"。 > *"Whether we agree with that or not is another question, but if it was to be unlocked, it would be massive."* ## [07:51] What Makes Omni a World Model "world model"这个词被滥用了，Oriol 给一个清晰定义：一个纯粹的 world model 必须做 representation learning——把世界压成紧致表征。在这之上，Omni 进一步成为可被语言驱动的 renderer：你用自然语言改一个 prompt，输出的视频内容随之改变，初始 image 之上能持续演化。这是从"被动建模"到"可控生成"的关键区别。 > *"The world model itself is acting as a renderer of the world, that you can really just change by language."* ## [10:04] World Models & Robotics 机器人是 world model 最直接的落地场景。Oriol 承认现在数据 mix 还在试错——sim 数据 vs 真机数据怎么配、什么时候 transfer 突然 click。世界模型本身的进步会带来一个 inflection point：一旦模型足够强，sim → real 的鸿沟会缩到 planning 和 gross motor 层面先打通，精细运动控制再慢慢跟上。 > *"At some level, maybe not at the precise motor control but at the kind of planning and gross, we are going to start seeing how things are going to fall into place."* ## [12:37] Evaluating Physics in AI 模型隐式学物理，但你怎么评估它学到没学到？Oriol 把它和无监督机器翻译做类比：如果模型内部确实表征了"重力"这个概念，应该能用某种 decode 把它翻译成显式 explanation。Stefano Gaus 等人 2014 年的早期 unsupervised translation 工作给了一条可借鉴的思路——把内部表征解码出来当 eval。 > *"You would need to somehow connect the concept of gravity which could be present or not in a world model to then decode that into an explanation."* ## [14:51] Consumer Agents & Spark I/O 发布的 Spark 是 Google 在 consumer agent 上的最新一步。Oriol 强调："action 作为一种 modality"已经被 DeepMind 早早识别为关键。但 agent 不是把模型塞进 generic scaffold 就行——模型能力必须先到某个门槛，你才能 dream 出下一阶段的产品形态。 他给一个工程判断：在 train 阶段就把"我有这些能力，怎么挑用哪些"内化进模型，比在 inference 时让外部 scaffold 临时决策更高效。 > *"It's useful to build kind of the system slightly more narrowly around something you care deeply about."* ## [18:39] Scaffolding & the Bitter Lesson Oriol 多年支持 Sutton 的 bitter lesson。Jacob 把它推到 agent 时代：scaffolding 看起来违背 bitter lesson 因为是手写的胶水。Oriol 的答案是——"scaffold 本身就是一段 code，最终应该是模型自己 on the fly 写出来"。短期内人写、长期模型写，bitter lesson 仍然站得住。同时优化 model 和 scaffold 两端，而不是把所有赌注押在一端。 > *"That system itself is a piece of code that eventually the model itself could write on the fly."* ## [22:06] Memory & Continual Learning Memory 这个话题 Oriol 谈得最深——他有 cognitive neuroscience 背景。他把 memory 分成两类：塞进权重（参数化）和挂在外部 file system（非参数化）。在 serving 规模下，把每次 user interaction 都 bake 进 weight 是不切实际的，非参数式 file-system memory 更可行。 真正的难点是"consolidate"：怎么把之前 session 的信息整合到新 session，让模型像人一样积累知识。这部分 momentum 很大但远未饱和，未来几年评估方式和工程实践都会迭代。 > *"The way that we'll see better evaluations and ways in which these models accumulate this knowledge as they go."* ## [26:54] Research Bets Inside Big Labs 在 Google 内部主导 Gemini 是什么体验？Oriol 谈三个维度的优势：TPU 联合设计（不用看 Nvidia 脸色）、广告/搜索带来的现金流稳定性、Brain + DeepMind 合并后端到端的研究强度。劣势是：组织太大没法对所有方向有全视野，必须靠直觉判断哪些早期研究值得 pull in，并接受"trade-off 不可能每次都做对"。 > *"Google is in a unique place. We have stability from hardware procurement and obviously like also investment of capital."* ## [32:30] Post-Training RL is Greenfield post-training 这块仍然是一片 greenfield。在 coding 和 math 上 LLM 已经走出指数曲线，但其他领域为什么没跟上？Oriol 的核心判断是"投入还远远不够"——相对预训练的算力消耗，post-training 至今只用了很小一部分。算法的 beauty 还在迭代，"cracking that recipe could be big"。 > *"Cracking that recipe could be big, at least in terms of the beauty of the algorithm."* ## [35:57] What Real Intelligence Looks Like 真智能长什么样？Oriol 用 2015 年的一个老 eval 来当锚——简单的 game-playing 任务，当时是 RL 的天花板，现在 LLM 一上来就能做。他想看到下一个数量级的跃迁：不是在熟悉的 benchmark 上推数字，而是在新的、人类没法立刻给出答案的问题上看到模型"主动产出洞察"。 > *"I like games."*（这句简单的自陈背后是他对 game-playing RL 长期偏爱的注脚） ## [39:11] RL Generalization 游戏曾经是 verifiable reward 的典型样板。现在的挑战是找新的 hard problem source，让 RL 在更广的领域诱发出深度推理和泛化。Oriol 抛出一个不对称观察：create solution 和 evaluate solution 之间存在 gap——如果 evaluation 比 generation 容易，RL 就有机会撬动。 让他意外的是：在 math/code 上的训练能 surprisingly 迁移到其他领域，"很多泛化能力可能其实来自 pre-training"。这是接下来几个月到几年研究者要破解的关键题。 > *"Possibly through pre-training — that's one of the quests for researchers to crack in the next few months and years."* ## [42:55] Advice for Founders 给 founder 的建议直白：evaluation 和 data 是绕不开的 moat。早期专注垂直产品、在 model 上叠一层 specialized scaffolding，等到 scale 起来再考虑 model layer 的差异化——这个路径"比较 scalable，也更适合早期玩家"。 > *"What I would tell folks is the value — and we discussed this a little bit — the value of evaluations and as a sequence of data."* ## [46:40] Can AI Truly Innovate? Oriol 2016 年加入 DeepMind 后最痴迷的方向是 meta-learning——模型自己产出 idea。但他承认到目前为止，"我没看到模型生成真正 outstanding 的 idea"。他比喻：你让一万个人尝试，挑出对的那个再 glorify，但模型真正自主提出方向的能力——quite limited。但他相信 "soon"。 > *"I don't think I've seen truly kind of outstanding ideas that a model has generated yet, but I am sure I will very soon."* ## [49:48] Recursive Self-Improvement 递归自我改进可以分层看：第一层是 researcher / engineer 用 AI 工具加速自己；第二层是模型直接自动化某些研究任务。当模型写英文比你好的那一天，下一个 ceiling 在哪里？Oriol 说："maybe there's no ceiling, or the ceiling is still far away" —— 我们甚至不一定能看到 ceiling 在哪里。 > *"At the point a model writes English better than you, maybe there's no ceiling, or the ceiling is still far away."* ## [52:14] Quickfire 最后 8 分钟快问快答覆盖了 TPU 投资历史、给年轻研究员的算力直觉、当下 AI 阶段的总体感受。Oriol 留下一句总结："I think it's a fascinating time as anything in AI"。Jacob 用 podcast 致谢和 outro 结束。 > *"I think it's a fascinating time as anything in AI."* ## Entities - **Jacob Effron**（人物）：Redpoint Ventures Managing Director，Unsupervised Learning 主持人。 - **Oriol Vinyals**（人物）：Google DeepMind VP of Research，Gemini 联合负责人（与 Noam Shazeer、Jeff Dean 并列）。 - **Gemini**（产品）：Google 的旗舰多模态 / agent 模型族；本期主要谈 I/O 第二天的发布。 - **Omni**（产品）：Google 的多模态产品线，被用作"video / image 的 GPT moment"参照系。 - **Spark**（产品）：I/O 发布的 consumer agent 产品。 - **World Model**（概念）：可被语言驱动的世界 renderer；representation learning 是其核心要素。 - **Bitter Lesson**（概念）：Sutton 的论点；本期延伸为"scaffold 长期应由模型自己写"。 - **Memory / Continual Learning**（概念）：非参数 file-system memory vs 把记忆塞进权重；consolidation 是关键难点。 - **Post-Training RL**（概念）：相对预训练的算力投入还很少，被定性为 greenfield。 - **Move 37**（概念）：AlphaGo 那一手；Oriol 用它指代"真正的 RL/research breakthrough"基准。

Sacks is out, Gavin Baker (Atreides Management) sits in. The panel walks through Andrej Karpathy's surprise move to Anthropic, debates why the public mood on AI has flipped, tears apart SpaceX's $2T S-1, and asks why Nvidia's blowout earnings still saw the stock sold. Friedberg and Chamath also flag warning signals from inflation, oil, and bond yields, and close on what — if anything — came out of the US-China summit. ## [00:00] Gavin Baker joins the show! Jason opens episode 274 noting Sacks is out and welcomes Gavin Baker from Atreides Management for the week. They tee up the agenda: SpaceX and OpenAI IPOs, Karpathy to Anthropic, and Nvidia's earnings. > *"Sachs is out today, but we're very lucky to have Gavin Baker from Atreides Management joining us. The spicy takes must flow."* ## [00:30] Andrej Karpathy joins Anthropic; hypergrowth and profitability The Karpathy hire is read as a major strategic win for Anthropic — Chamath frames it as continuity of the Richard Sutton "bitter lesson" school of scaling that Karpathy executed at Tesla FSD and OpenAI. Gavin layers in financial context: Anthropic was EBIT-positive in the last quarter per the WSJ, which combined with hypergrowth makes the recent funding rounds look very different from a capital-burn narrative. Friedberg pushes back on the framing that models will soon "feed themselves" into context windows to self-improve, but flags that papers (one from MIT) suggest large efficiency gains are on the horizon. Chamath uses the moment to argue the podcast itself has to start telling the upside story of AI — the doctors, the scientists, the unlock — because the dominant public narrative has gone negative. > *"He was probably the first person that really commercialized the Richard Sutton bitter lesson essay when he was leading FSD at Tesla."* ## [12:42] Why Americans have turned on AI, anti-human perception Gavin shares a personal story: his daughter has a rare disease, and a Stanford scientist he funded is months away from what he believes is a complete cure, made tractable by AI-accelerated biology. He uses it to argue for an optimistic posture — a future where work is optional and disease is solvable — and warns that the people pushing for AI regulation are also shaping how the public feels about the technology. Friedberg goes deeper into the cultural mechanics: AI is being framed as anti-human in a way that mirrors anti-nuclear and anti-industrial backlashes of the 20th century. He argues the United States can't unilaterally slow down because China and others won't — and tries to separate genuine safety concerns from elite class anxiety. Chamath then makes a pointed observation that none of the survey data on AI job loss actually asks the truck drivers, package sorters, and ICU nurses themselves how they feel about the tools. > *"We're listening too much to the inventors of AI. They're geniuses. They're smart. We need to be listening to the frontline factory workers who are using AI saying, 'Wow, I was able to add a third shift.'"* ## [27:22] Trump pulls AI EO, US-China AI relationship, dystopian AI layoffs A Trump AI executive order was scrubbed at the last minute — the panel walks through what was reportedly in it (review of frontier-model training runs) and whether any pre-release regulatory framework is workable. Jason argues a state-by-state patchwork is the more likely outcome regardless of what Washington does. The conversation pivots to Meta's latest round of layoffs and the way they were communicated. Gavin and Jason agree the messaging — leaning on "AI productivity gains" as the public reason — landed badly even with people who accept the underlying logic, and Jason argues it became a case study in how *not* to message AI-driven workforce changes. > *"Because the reality is that if this is the way that you're going to message something as critical as this, I think you did a horrible job."* ## [45:19] SpaceX S-1 tear down! Breaking down the three major businesses and the case for a $2T valuation SpaceX filed its S-1 on Wednesday. Jason breaks the company into three businesses: launch (which could be hundreds of millions of paying subscribers via Starlink), Elon Web Services / xAI / Colossus compute, and rockets. The AI-cloud line item alone is around $15B and growing roughly 2x year over year, anchored by an Anthropic deal Gavin calls "extraordinary." Gavin then makes the case that Colossus matters because raw gigawatt-class data centers are now the binding constraint, and SpaceX-adjacent build velocity is the moat. He uses Cursor's Composer 2.5 release — Pareto-dominant on three or four weeks of RL training — as evidence that whoever owns the compute owns the next model generation, and walks through why rapid reusability on Starship compresses the unit economics of getting payload to orbit faster than any competitor can model. > *"If you look at who's actually capable of delivering a gigawatt data center, these guys are the closest, like an actual gigawatt."* ## [71:22] Nvidia smashes earnings but stock falls, why people are shorting chips Nvidia blew out earnings again — 20% sequential growth would be a high-growth print for any other company, the dividend was raised 25x, and the CFO committed to returning 50% of free cash flow. Yet the stock sold off, and Leopold Aschenbrenner's reported pivot away from chip exposure is being read as a smart-money signal. Gavin takes the bear case apart: at current PE Nvidia is cheap relative to growth, and the segment breakdown obscures how much the "AI clouds" line is dragging the multiple. He flags that the true useful life of a GPU is closer to two years than five, which means the reported profits of every hyperscaler running these chips are overstated — a real concern, not a stock-killer. He also notes Nvidia's CPU business is on track to do $20B this year, making it overnight one of the largest CPU manufacturers in the world. > *"The true lifespan of a GPU is more like two years and therefore the profits of all these businesses are overstated."* ## [82:25] Market update: Flashing red signals, oil, inflation, yields up The macro snapshot: May inflation expected at 4.2%+, Fed rate-hike odds back on the table, UK yields at the highest since the great financial crisis, oil and gold both moving. Chamath warns that when the currency-debasement mechanism finally breaks, the downside is non-linear. Gavin counters with relative optimism on the US: America is self-sufficient in energy, the AI build-out is structurally good for re-industrialization, and even in an ugly global scenario the US is the least-bad place to be invested. He flags AI fundamentals also have a seasonality that investors are starting to model — the same way e-commerce and subscription businesses do. > *"While it's terrible for everyone, it is relatively the best for America because we are self-sufficient in energy."* ## [92:45] China trip flops, or was progress made behind the scenes? A 48-hour US tech-CEO-plus-president trip to Beijing produced thin public deliverables: some soybeans, some H100/A200 sales to Chinese players. The panel asks whether that's the real story or just the visible surface, and whether the immediate China-Russia bonding moment afterward says more about the trajectory than any handshake photo. Gavin argues the more important read is structural: keeping America ahead in AI requires keeping the trans-Pacific relationship just stable enough to avoid a full decoupling shock, and that's a defensible strategic logic even if the optics are unsatisfying. He also paints a what-if scenario around the Strait of Hormuz to make the point that energy independence is what gives the US the option to act asymmetrically. Jason closes with thanks to Gavin and an invite back to the Summit. > *"There's sound arguments that this is stabilizing for the world and is the best highest probability path for keeping America ahead in AI."* ## Entities - **Jason Calacanis** (Person): Host, LAUNCH founder, MC of this episode. - **Chamath Palihapitiya** (Person): Host, Social Capital CEO; pushed the "listen to frontline AI users" framing. - **David Friedberg** (Person): Host, The Production Board CEO; led the cultural / historical analysis of the AI backlash. - **Gavin Baker** (Person): Guest host, Atreides Management founder/CIO; carried the investing thread across SpaceX, Nvidia, and macro. - **Andrej Karpathy** (Person): Joining Anthropic's new pre-training team; OpenAI co-founder, ex-Tesla FSD lead. - **Anthropic** (Organization): Hired Karpathy; EBIT-positive last quarter per WSJ; $15B AI-cloud deal with SpaceX-adjacent compute. - **SpaceX** (Organization): Filed S-1; three businesses (launch/Starlink, Elon Web Services compute, rockets); $2T valuation case. - **Nvidia** (Organization): Earnings blowout but stock sold off; $20B CPU run-rate; $5.3T market cap. - **Cursor** (Software): Composer 2.5 model release used as proof of fast RL-driven catch-up dynamics. - **Richard Sutton's bitter lesson** (Concept): Scaling beats clever architectures — framing for why Karpathy's move matters. - **GPU useful life** (Concept): Closer to ~2 years than ~5, so hyperscaler reported profits are overstated. - **Strait of Hormuz scenario** (Concept): Energy-independence-as-strategic-option argument for the US in the China game.

Tushara Fernando, Head of Data and AI at Man Group, explains how the firm integrates AI into systematic trading by codifying decades of institutional knowledge into "skills." She emphasizes that robust governance and shared workflows are essential for moving AI from individual productivity tools to enterprise-scale agentic platforms. ## [00:18] AI in Systematic Trading Man Group manages over $200 billion in assets, making the stakes for AI implementation exceptionally high for their institutional clients. Tushara Fernando describes systematic trading as an algorithmic process that uses historical backtesting to evaluate investment signals, much like managing a fantasy football team. > *A trading signal is really just this with stocks... We want to back the ones that would make money and we want to short the ones that won't.* > *[2, 43]* ## [04:38] The Role of AI-Generated Signals Man Group currently runs trading signals in production that were entirely researched, backtested, and proposed by AI. While humans review the final output for sensibility, AI handles the data acquisition, strategy proposal, and productionization of these investment ideas. > *There are trading signals running right now in production at Mang Group... that were researched, back tested and proposed by AI.* > *[4, 38]* ## [05:52] The Importance of Shared Workflows The success of a trading signal depends on the underlying workflows, such as data cleaning and outlier detection, which Fernando compares to the submerged part of an iceberg. Without shared workflows, different teams produce inconsistent results, making it impossible to compare the effectiveness of various strategies. > *If different teams are running different versions of those workflows, you get different answers.* > *[6, 50]* ## [08:43] Lessons in Skills Governance Early attempts at AI adoption failed because power users, rather than process owners, were building "skills," leading to local optimizations and errors like hardcoded cost centers. To solve this, Man Group created a governed marketplace where skills are owned by workflow owners, tested with evaluations, and tracked for usage. > *Treat those skills like production code because that's what they will become.* > *[17, 21]* ## [16:40] Scaling AI Across the Enterprise Man Group has scaled AI usage to nearly half its workforce by focusing on organizational context as a competitive moat. By treating skills as a library of institutional knowledge, the firm is preparing for a future where swarms of agents leverage these capabilities to find new investment opportunities. > *Skills governance really unlocks AI at that enterprise scale.* > *[19, 21]* ## Entities - **Tushara Fernando** (person): Head of Data and AI at Man Group. - **Man Group** (organization): An alternative investment manager with over $200 billion of assets under management. - **Claude** (product): An AI model used by Man Group for research, backtesting, and workflow automation. - **Anthropic** (organization): The AI company that assisted Man Group with skills workshops and implementation. - **Systematic Trading** (concept): Algorithmic trading capabilities that look across thousands of securities and hundreds of markets. - **Backtesting** (process): The process of running a trading strategy against historical data to evaluate its performance. - **Sharpe Ratio** (metric): A statistical factor that compares the volatility of a strategy versus its returns. - **Skills Marketplace** (product): Man Group's internal library for governed AI skills, plugins, and institutional knowledge.

Andrew Feldman, CEO of Cerebras, details the company's journey from a controversial 'wafer-scale' architecture to a $63 billion public valuation. He explains how their radical hardware design delivers 15-20x faster AI inference than traditional GPUs, enabling new business models and a fundamental reorganization of productivity. ## [00:00] – Cold Open Andrew Feldman compares the impact of AI speed to Netflix's transition from DVD delivery to streaming, noting that extreme speed opens entirely new business models. He predicts a fundamental reorganization of productivity as AI moves beyond basic coding and design tasks. > *that's what happens with speed and I think that's what fast AI does right now [00:10]* ## [00:41] – Andrew Feldman Introduction Host Sarah Guo introduces Andrew Feldman and highlights Cerebras' recent IPO and its current $63 billion market cap. The discussion frames the company's transition from early machine learning research to dominating the foundation model inference market. > *Serbust recently went public and is currently worth about $63 billion in the stock market. [00:54]* ## [00:48] – Cerebras’ Evolution Feldman describes Cerebras as a builder of AI-optimized computers that outperform GPUs by up to 20x in inference tasks across all model sizes. He attributes their recent success to AI models becoming smart enough for daily utility in 2025, leading to massive contracts with OpenAI and AWS. > *we're the the fastest at inference, not by little, but by a lot, 15, 18, 20x faster than GPUs. [01:39]* ## [02:17] – Wafer-Scale Bet Pays Off The conversation explores Cerebras' unique 'wafer-scale' architecture, which utilizes a single chip the size of a dinner plate. Feldman argues that radical performance improvements require radical designs, noting that critics initially dismissed the approach as impossible. > *we chose wafer scale, which means we build a 46,000 square millimeter chip, a chip the size of a dinner plate [03:39]* ## [06:38] – Challenges and Breakthroughs Feldman recounts a high-stakes period between 2017 and 2019 when the team struggled to make the technology work while spending $8 million monthly. He emphasizes that while the technical breakthrough occurred in 2019, market demand only exploded once AI became an essential daily tool. > *We had a period between about 2017... and middle of 2019 where we couldn't build it. [07:34]* ## [08:37] – Crossing the Market Chasm Feldman describes the early years where Cerebras had superior technology but struggled to find a market, eventually finding success in supercomputing labs. A pivotal $1 billion order from sovereign partner G42 provided the capital and scale necessary to battle-test their hardware and prepare for the AI explosion. > *We had a 2 or three year period where we were ahead of the market and absolutely nobody cared that we were blisteringly fast. [09:00]* ## [10:38] – Scaling Software and Hardware Scaling a hardware company involves physical constraints like manufacturing lines, power requirements, and test fixtures that software companies do not face. Feldman also highlights the long-term nature of deep tech development, noting that building a high-quality compiler takes nearly a decade of engineering effort. > *When you're building things... you have to call your manufacturing partner... Each step takes real time and effort to grow. [11:24]* ## [12:03] – Relevance of AI-Generated Coding Cerebras has aggressively adopted AI-generated coding, with token spending per engineer increasing significantly to support the use of autonomous agents. Feldman observes that certain engineers are becoming '100x' contributors by governing multiple agents for coding and QA tasks. > *They've moved their coding style to being one in which they govern agents... they've gone from being sort of 10x guys to being 100x guys. [13:12]* ## [13:31] – Leadership and Hiring Culture With a $20 billion backlog and a growing team of over 800 people, Feldman emphasizes the need to avoid corporate malaise by continuing to take extraordinary risks. He views himself as a 'professional David' who thrives on solving problems that others deem impossible while competing against Nvidia. > *We would much rather fail in pursuit of the extraordinary than succeed in the ordinary. [15:01]* ## [17:16] – When to Quit vs. Persist Andrew Feldman describes himself as a 'professional David' who thrives on competing against larger incumbents through intellectual superiority. He emphasizes that founders must guard against the 'slippery slope' of persistence by using external mentors to hold them accountable to their original hypotheses. > *The slippery slope is a beast... you have to guard against it. [18:32]* ## [19:40] – Why Cerebras Went Public The transition to a public company is framed as a way to reduce the cost of capital and gain legitimacy with large-scale corporate clients. Feldman notes that Cerebras chose the IPO path to differentiate itself as the market's only 'AI pure play' revenue stream. > *For us it was an opportunity to graduate from corporate adolescence to corporate adulthood. [23:22]* ## [22:57] – The OpenAI Deal Feldman recounts the intense four-and-a-half-week period during which Cerebras finalized a $20 billion deal with OpenAI, driven by a sudden demand for fast inference. The deal moved at an unprecedented pace, involving constant work through the holiday season to meet technical requirements. > *For a 20 plus billion dollar deal to do it in four and a half weeks was exceptional. [24:59]* ## [25:54] – Open Source and Post-Trained Workloads Andrew Feldman highlights how the open-source ecosystem sustains market interest and pressures closed-source developers to innovate. He emphasizes that seeing external developers build creative solutions on Cerebras hardware is a core motivation for the company's infrastructure goals. > *You got to love other people's ideas to take flight on on what you built. [28:04]* ## [27:37] – How Speed Opens Up New Business Extreme speed in AI enables fundamental shifts rather than just incremental improvements, using Netflix's transition from DVDs to streaming as a primary example. Feldman argues that the ambition for speed is a competitive advantage, as seen in the rapid construction of data centers. > *when the internet got fast they became a movie studio right that's what happens with speed [28:38]* ## [30:07] – Conclusion Drawing parallels to the PC and cloud revolutions, Feldman predicts that AI will move beyond replacing specific tasks to fundamentally reorganizing how work is performed. This shift is expected to trigger massive jumps in global productivity as new business models emerge around the technology. > *once we start sort of fundamentally reorganizing around this, you're going to see this sort of new business models and fundamental jumps in productivity. [29:53]* ## Entities - **Andrew Feldman** (person): Co-founder and CEO of Cerebras - **Cerebras** (organization): AI hardware company known for wafer-scale engine technology - **OpenAI** (organization): AI research organization that signed a multi-billion dollar deal with Cerebras - **G42** (organization): A sovereign AI and technology holding company that placed a $1 billion order with Cerebras - **Nvidia** (organization): Leading GPU manufacturer and dominant competitor in the AI chip market - **Sarah Guo** (person): Host of No Priors and venture capitalist - **AWS** (organization): Amazon's cloud computing division deploying Cerebras hardware - **Netflix** (organization): Used as an analogy for how speed changes business models from delivery to production

Brian Halligan interviews Notion co-founder Ivan Zhao on his journey as a 'refounder' who navigated the company through its 2015 Kyoto restart and the 2023 generative AI pivot. Zhao details Notion's transition from a traditional SaaS structure to an AI-native 'jazz band' model that prioritizes technical versatility, taste, and agency over rigid hierarchies. The discussion explores how AI acts as the 'steel' for modern organizations, enabling flatter structures and faster, more reversible decision-making. ## [00:00] Introduction Brian Halligan introduces Ivan Zhao as the 'refounder' of Notion, highlighting his unique ability to restart the company during critical junctures in 2015 and 2023. The conversation sets the stage for Zhao's transition from a traditional SaaS management model to an AI-native organization. Halligan compares Zhao's approach to other tech visionaries like Jack Dorsey, emphasizing the importance of personal style and 'taste' in building a lasting brand. > *I like to think of him as the refounder... he's the canonical example of how a SAS company can move and become an AI company. [00:52]* > *We want to be a jazz band, not a marching band. [00:02]* ## [02:22] From Founder Mode to AI Org Ivan Zhao discusses his detour into traditional delegation and professional management before returning to a hands-on 'founder mode' necessitated by the AI shift. He explains that building with language models is less like predictable bridge engineering and more like 'brewing beer,' where the underlying technology dictates the development path. Zhao emphasizes hiring 'jazz band' people—versatile individuals like designers who code—to navigate the experimental nature of AI integration. > *Building with language model... is like brewing beer. You can't truly predict the things the underlying thing. [06:33]* > *The spirit is technology first-driven development rather than customer-driven first development. [07:01]* ## [11:00] Hiring for Taste and Agency Notion utilizes a 'barbell' hiring strategy that targets both super-junior and super-senior talent while avoiding the 'middle' of traditional SaaS experience. Zhao defines talent as the product of capability, taste, and agency, noting that AI has democratized basic capabilities like coding and writing. Consequently, the company now optimizes for 'agency' and 'taste,' qualities that remain difficult to automate and serve as the primary differentiators for the brand. > *capability got normalized democratized and taste becomes still important [11:53]* > *So the shape it's not it's more like the barbell barbell shape, right? [12:35]* ## [24:28] Refounding Notion in Kyoto In 2015, facing potential failure and low morale, Zhao and co-founder Simon Last laid off their entire staff and relocated to Kyoto, Japan, to rebuild Notion from scratch. This 'Kyoto Reset' allowed them to focus entirely on craft and coding while living a minimalist lifestyle. Zhao chose Kyoto specifically for its status as the 'craft capital of Asia,' which provided the spiritual inspiration needed to view software as a fundamental human tool. > *So my co-founder and I said let's just lay off everybody just go by the two of us. That's the Japan story. [25:41]* > *The story we tell ourselves is like Kyoto is a special place. If you can pull off anywhere, you can pull off from Reborn in Kyoto. [28:05]* ## [30:27] Craft Versus Commerce Zhao views Notion as part of a historical lineage of 'tools for thought,' tracing back to pioneers like Douglas Engelbart and Alan Kay. He criticizes modern Silicon Valley 'tinker culture' for ignoring the history and humanity behind technology. For Zhao, the goal is to find an equilibrium between the pure craft of an artist and the commercial viability of a business, ensuring the product has a 'soul' that resonates with users. > *Tech is like industry doesn't know its past. If you don't know his past you don't know history which is humanity. [31:52]* > *I need to be in equilibrium with my own value of what this company I want to build... [51:33]* ## [32:26] When to Refound For founders whose companies are stagnating, Zhao suggests listening to the 'inner urge' to take drastic action rather than wasting years on ventures without momentum. He argues that refounding is often harder than starting fresh because it involves taking a significant step back to pivot toward a new growth engine. Zhao believes the current AI-driven market is wide open, making it an ideal time for founders to be risk-seeking and follow their intuition. > *For me it's like there's you just feel you have to do something drastic... then you feel liberated once you land in Japan. [32:56]* > *The refounding is harder than it looks. It typically involves like a big step back and two steps forward. [59:57]* ## [34:07] GPT-4 Refounding Shock Zhao describes gaining early access to GPT-4 as a 'full body religious experience' that signaled a fundamental shift in the world. This realization forced a second refounding of Notion, as Zhao felt any work not involving this technology would soon become meaningless. The transition included a grueling 18-month period of low morale while the team waited for the underlying AI models to catch up with their ambitious product vision. > *GBD4 is a religious experience for me. It's like holy [ __ ]... anything you do if you don't do this it will be meaningless. [34:27]* > *that was like a year and a half just go with no error and morale is definitely low [35:50]* ## [45:35] Leadership and Founder Energy Despite being naturally introverted, Zhao explains how he forced himself to master one-to-many communication to build trust within Notion. He maintains a disciplined daily routine, starting at 7 AM and often working until midnight, while using 'guilty pleasure' reading to recharge. To prevent organizational calcification, Notion aggressively acquires startups to bring in 'founder energy,' currently employing over 50 former founders who lead critical domains. > *To lead the group of human you need to do one to many communications otherwise people don't trust you. [46:17]* > *founders are are kind of this kind of like little decalcified meatthead machinery just trying to break things [39:10]* ## [53:17] Sales Culture and Closing Thoughts Notion's transition to enterprise sales involved moving away from 'first-principle' experimentation toward established playbooks, pairing system thinkers with high-energy sales leaders. The conversation concludes with a vision of the 'AI-native' CEO playbook, which replaces traditional 'triangle' hierarchies with a 'circular' model. In this structure, a centralized AI system saturated with company context enables smaller teams to move at breakneck speed with reversible decision-making. > *You should only have each company should only preserve your innovation point to few places... [54:54]* > *All of those kind of one-way doors that Bezos used to talk about are really two-way doors... [62:39]* ## Entities - **Ivan Zhao** (person): Co-founder and CEO of Notion, known for his 'refounder' mindset. - **Brian Halligan** (person): Co-founder of HubSpot and interviewer. - **Notion** (organization): A productivity software company that pivoted to an AI-native model. - **Simon Last** (person): Co-founder of Notion who helped rebuild the company in Kyoto. - **Kyoto** (location): The Japanese city where Notion was restarted in 2015. - **GPT-4** (technology): The AI model that triggered Notion's second refounding. - **Steve Jobs** (person): Former Apple CEO cited as an inspiration for refounding and craft. - **Jack Dorsey** (person): Tech leader mentioned for his AI-centric organizational redesign. - **Douglas Engelbart** (person): Computing pioneer in the 'tools for thought' lineage. - **Erica** (person): CRO of Notion and former CRO of GitHub. - **SaaS** (concept): Software as a Service, the industry context for Notion's evolution. - **Jazz Band** (concept): Metaphor for a flexible, high-agency organizational structure.

Ivan Burazin, CEO of Daytona, discusses the massive shift from building developer environments for humans to providing composable computers for AI agents. With 74% month-over-month growth and 850,000 daily runs, Daytona provides the bare-metal infrastructure required for stateful, high-performance agentic workflows. This conversation explores the technical challenges of spiky compute, the $10 trillion computer-use market, and why the future AI cloud will look more like Stripe than AWS. ## [00:00] Hook Ivan Burazin describes the intense, direct demand for Daytona's infrastructure, with potential users calling him personally to request access. This level of interest signaled a massive, untapped market for providing execution environments to every future AI agent. The team realized they had identified a critical missing piece in the AI development stack. > *I've never experienced this that people literally call you if you do not give them access. Like they want access right now.* > *[0, 0]* > * ] }, { * > *title": "Introduction* > *{'start': 72.0, 'summary': "Host swyx introduces Ivan Burazin, noting their shared history in the developer experience and 'end of localhost' movements. Ivan recalls reaching out to swyx years ago for advice on developer experience while working at a previous role. They reflect on how their early interactions and mutual interests in cloud-based development tools eventually led to their current collaboration.", 'quotes': ['I was one of the co-founders of code anywhere... we were thinking a long time of like local host should die.', [1, 36], '\n ]\n },\n {\n ', 'title": "CodeAnywhere', 'Shift', 'and the end of localhost', {'start': 195.0, 'summary': 'Ivan discusses his long history with his co-founder, dating back to early 2000s virtualization and the creation of CodeAnywhere. As the first browser-based IDE, CodeAnywhere predated modern infrastructure like Docker and Kubernetes, which provided the team with deep foundational knowledge. After a successful run with the Shift developer conference, they returned to their infrastructure roots to launch Daytona.', 'quotes': ['We originally started stacking stacking servers doing like virtualization in the early 2000s... and that was a services company which we sold.', [3, 38], '\n ]\n },\n {\n "title": "What Daytona is: composable computers for AI agents",\n "start": 358.0,\n "summary": ', "Ivan defines Daytona as a provider of 'composable computers' for AI agents", "moving beyond the limited industry term 'sandboxes.' He explains that agents require diverse computing environments tailored to specific tasks", 'much like different hardware setups for human professionals. This API-driven infrastructure allows agents to execute code in production-grade environments rather than just temporary test boxes.', {'quotes': ['What Daytona is today is essentially composable computers for AI agents... the market calls them sandboxes which [is] misleading.', [6, 41], '\n ]\n },\n {\n ', 'title": "The pivot from dev environments to AI sandboxes', {'start': 487.0, 'summary': "Ivan explains how observing early agents like Devon and OpenHands led to a realization that AI agents require a dedicated compute runtime. While their initial SaaS offering for human automation saw low traction, it attracted developers who specifically needed sandboxes for their agents. This feedback loop revealed a massive, underserved market for agent-specific infrastructure that standard cloud providers weren't addressing.", 'quotes': ['a lot of people reached out that were building agents and they were like hey my agent needs a compute sandbox runtime', [8, 50], '\n ]\n },\n {\n ', 'title": "The New Year’s Eve MVP and customers begging for API keys', {'start': 617.0, 'summary': "On New Year's Eve, Ivan 'vibe-coded' the first MVP of what would become the new Daytona. Although the CTO initially dismissed the code as 'garbage,' the core idea was strong enough to warrant a two-week professional rebuild. When they demoed this version to previous skeptics, the response was immediate and overwhelming, with users demanding API access before the calls even ended.", 'quotes': ["I've never experienced this that people literally call you if you do not give them access.", [12, 18], '\n ]\n },\n {\n ', 'title": "Bare metal', 'stateful sandboxes', 'and Daytona’s scheduler', {'start': 776.0, 'summary': "The team approached the technical architecture from first principles, deciding to run on bare metal rather than traditional VMs. They aimed to combine the speed of AWS Lambda with the stateful, long-running nature of an EC2 instance. This allows agents to 'pause and come back' to their work, much like a human closing a laptop lid, without losing state or performance.", 'quotes': ["agents will be like humans in the sense of you don't want your laptop to be shut down until you're done with work", [13, 57], '\n ]\n },\n {\n ', 'title": "60ms startup', 50, 0, 'sandboxes', 'and 850K daily runs', {'start': 1048.0, 'summary': "Daytona's infrastructure is optimized for both individual speed and massive concurrency, with a single instance spinning up in just 60 milliseconds. This scale supports high-volume customers who perform nearly 850,000 runs daily, with some requesting capacity for half a million concurrent CPUs. The system utilizes a custom scheduler and local NVMe drives to eliminate network latency and maximize IOPS.", 'quotes': ['Our time to spin up one is 60 milliseconds with network latency... if you want to spin up 50,000 at once, we are now at about 75 seconds.', [17, 40], ',\n ', 'The biggest customer of ours does like about 850', 0, "every single day is sort of where they're where they're just shy of a million.", [18, 17], '\n ]\n },\n {\n ', 'title": "Spiky RL/eval workloads and the new agent infra problem', {'start': 1313.0, 'summary': "The 'spiky' nature of AI workloads presents a major challenge for compute providers, leading to a mean utilization rate of only 15% despite peaks hitting 90%. Workloads are categorized into 'background agents' that follow human cycles and 'evaluations/RL' which fire off massive bursts of activity at unpredictable hours. To manage this, Daytona must use capacity commits to handle sudden bursts of 100,000 or more CPUs.", 'quotes': ["Daytona's mean utilization is 15%... because it's very spiky. But it's very spiky but we get up to 90%.", [23, 1], '\n ]\n },\n {\n ', 'title": "RL workloads', 'Kubernetes pain', 'and dynamic resizing', {'start': 1692.0, 'summary': "Daytona competes primarily against managed Kubernetes services like EKS and GKS, positioning itself as a more ergonomic 'Twilio or Stripe' for compute. Unlike Kubernetes, Daytona offers a seamless API for spinning up sandboxes with significantly faster startup times. A key advantage is the ability to dynamically resize sandboxes on the fly to prevent out-of-memory (OOM) errors, a feature difficult to implement on other platforms.", 'quotes': ["Daytona although it's a compute provider it's more akin to a Twilio and Stripe from a consumption perspective than it is an AWS", [29, 46], '\n ]\n },\n {\n ', 'title": "Why every AI agent needs a computer', {'start': 2011.0, 'summary': "Ivan outlines the massive scale of knowledge work, estimating a $50 trillion global salary pool, much of which is locked in legacy Windows applications. He argues that true automation requires 'human emulators' that can interact with these legacy systems via GUIs when APIs are incomplete. By automating 40% of this work, the market opportunity for agentic computer use reaches approximately $10 trillion annually.", 'quotes': ['If you take 40% of that, you get to essentially like 10 trillion dollars a year.', [35, 20], '\n ]\n },\n {\n ', 'title": "macOS sandboxes and Apple’s licensing problem', {'start': 2328.0, 'summary': "The discussion shifts to the difficulties of hosting Mac OS sandboxes compared to Windows and Linux. Apple's restrictive licensing only allows two parallel VMs per machine and requires a 24-hour lock-in for users, making per-second billing economically unfeasible. Furthermore, security restrictions prevent moving memory snapshots between physical machines, severely limiting the scalability of agentic workloads on Mac hardware.", 'quotes': ['Apple is shooting itself in the foot... if it would just enable a concurrency model similar to what you can get on a Windows.', [40, 52], '\n ]\n },\n {\n ', 'title": "Why CLI may matter more than MCP', {'start': 2668.0, 'summary': "The discussion compares the Model Context Protocol (MCP) to the Command Line Interface (CLI) for agentic action. While MCP acts as an interface for APIs, the CLI allows agents to execute scripts and perform deep data analysis within a sandbox. This layer of indirection enables more complex agentic workflows beyond simple data retrieval, allowing agents to actually 'do things' rather than just integrate.", 'quotes': ['the MCP is an interface against an API whereas the CLI is like you can actually go do things... the difference between integrations and actually running scripts.', [45, 34], '\n ]\n },\n {\n ', 'title": "Open source', 'GitHub stars', 'and agent integration', {'start': 2891.0, 'summary': "Ivan details Daytona's transition to an AGPLv3 license for its sandbox product to balance openness with commercial protection. This 'copyleft' approach allows enterprise use but prevents competitors from building proprietary forks without contributing back. Keeping the core engine transparent builds trust with users and allows large enterprises to bypass lengthy security audits by providing agents with full context.", 'quotes': ["in the new sandbox product we did add a AGPL3... you essentially can't make a competitor without open sourcing your stuff.", [49, 49], '\n ]\n },\n {\n ', 'title": "Git', 'CI/CD', 'and agent collaboration bottlenecks', {'start': 3191.0, 'summary': 'Current versioning systems like GitHub are often too slow for the high-velocity output of AI agents, leading to bottlenecks in CI/CD pipelines. Some developers are creating makeshift solutions like dumping codebases into JSON files on S3 to bypass Git overhead. There is a growing need for an agent collaboration layer that precedes the traditional Git-based pipeline to handle companies generating over 1,000 PRs per day.', 'quotes': ["GitHub as-is was an overhead... it wasn't fast enough what they needed.", [54, 3], '\n ]\n },\n {\n ', 'title": "Founder life and building a 25-person infra company', {'start': 3495.0, 'summary': "Daytona's success stems from a core team of 13 people who have worked together for over seven years, fostering a high-trust culture. Ivan acknowledges the difficulty of the founder journey, including being away from family, but posits that growth requires 'pain.' He views his work as building the spiritual successor to serverless and Kubernetes for the agent era, requiring radical responsiveness as a differentiator.", 'quotes': ['Of the 25 people in Daytona, I think about 13 of them we have worked with seven years plus.', [58, 57], '\n ]\n },\n {\n ', 'title": "AI SaaS', 'token resale', 'and API-first business models', {'start': 3764.0, 'summary': 'Ivan presents a critical take on the SaaS ecosystem, arguing that the market is incorrectly applying a premium to vendors who simply resell AI tokens. He points out that these models have significantly worse margins than traditional SaaS. Instead, he advocates for companies to expose their data via APIs and charge for consumption, allowing for actual revenue acceleration through increased agentic usage.', 'quotes': ["The market is adding premium to SAS vendors that are reselling tokens. And I think that's incorrect.", [62, 54], '\n ]\n },\n {\n "title": ', 'GPU sandboxes', 'data centers', 'and compute growth', {'start': 3970.0, 'summary': 'Daytona plans to introduce GPU sandboxes to support workloads like 3D rendering and reinforcement learning on CAD, rather than focusing on inference. While the company currently runs on bare metal via colocation providers, Ivan notes they are architected to potentially own data centers in the future. He currently avoids the high capital risk of building data centers for single-digit margin gains.', 'quotes': ['We will [offer GPUs], but not for inference. Like essentially what we think about is like the GPU sandbox.', [66, 21], '\n ]\n },\n {\n ', 'title": "Why the AI cloud may look more like Stripe than AWS', {'start': 4188.0, 'summary': "The conversation concludes by imagining the 'AWS for AI Agents,' which Ivan suggests might look more like Stripe than a traditional cloud provider. This future 'AI Cloud' will integrate sandboxes, web search, and databases as fundamental primitives. While companies like Cloudflare and OpenAI are competing for this space, Ivan hints that many more infrastructure primitives for agents are yet to be developed.", 'quotes': ["There will be a cloud built out specifically for agents and so that cloud will have sandboxes and it will have web search and it'll have databases.", [70, 47], '\n ]\n },\n {\n ', 'title": "Closing thoughts', {'start': 4286.0, 'summary': 'The discussion ends with the observation that the AI infrastructure market is growing at an unprecedented baseline of 40-75% month-over-month. Ivan and swyx reflect on the race to secure hardware and the shift toward specialized agent clouds that will define the next decade of computing.', 'quotes': ["The entire infrastructure market is growing 40% plus or minus month over month... if you're not growing 40%ish... you don't have to come to work.", [68, 23], '\n ]\n }\n ],\n ', 'entities": [\n {\n "name": "Ivan Burazin', {'type': 'person', 'description': 'CEO of Daytona and co-founder of CodeAnywhere.'}, {'name': 'swyx', 'type': 'person', 'description': 'Host of Latent Space and early investor in Daytona.'}, {'name': 'Daytona', 'type': 'organization', 'description': 'A company providing composable computers and sandboxes for AI agents.'}, {'name': 'CodeAnywhere', 'type': 'organization', 'description': 'The first browser-based IDE, co-founded by Ivan Burazin.'}, {'name': 'Devon', 'type': 'product', 'description': 'An early AI software engineer agent.'}, {'name': 'OpenHands', 'type': 'product', 'description': 'An open-source AI agent project formerly known as OpenDevin.'}, {'name': 'Kubernetes', 'type': 'technology', 'description': "Orchestration technology mentioned as a competitor to Daytona's ergonomic API."}, {'name': 'Apple', 'type': 'organization', 'description': 'Mentioned regarding restrictive Mac OS virtualization licensing.'}, {'name': 'Salesforce', 'type': 'organization', 'description': 'Cloud-based software company mentioned for its API-first strategy.'}, {'name': 'GitHub', 'type': 'organization', 'description': 'Developer platform noted for being a bottleneck in agentic CI/CD workflows.'}, {'name': 'Nvidia', 'type': 'organization', 'description': 'The primary provider of GPUs whose supply constraints dictate market growth.'}, {'name': 'Stripe', 'type': 'organization', 'description': 'Used as a comparison for the consumption-based model of the future AI cloud.'}], 'tags': ['ai-agents', 'infrastructure', 'sandboxing', 'bare-metal', 'cloud-computing', 'developer-tools', 'computer-use', 'saas-growth'], 'seo_title': "AI Agents Need Computers: Ivan Burazin on Daytona's Pivot", 'seo_description': 'Ivan Burazin explains why AI agents need composable computers and how Daytona pivoted from dev environments to 850K daily agent runs.', 'confidence': {'score': 0.98, 'rationale': 'The summary synthesizes multiple detailed chunks covering technical metrics, business strategy, and market philosophy with high fidelity to the source.'}}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}* ## [01:12] Introduction ## [03:15] CodeAnywhere, Shift, and the end of localhost ## [05:58] What Daytona is: composable computers for AI agents ## [08:07] The pivot from dev environments to AI sandboxes ## [10:17] The New Year’s Eve MVP and customers begging for API keys ## [12:56] Bare metal, stateful sandboxes, and Daytona’s scheduler ## [17:28] 60ms startup, 50,000 sandboxes, and 850K daily runs ## [21:53] Spiky RL/eval workloads and the new agent infra problem ## [28:12] RL workloads, Kubernetes pain, and dynamic resizing ## [33:31] Why every AI agent needs a computer ## [38:48] macOS sandboxes and Apple’s licensing problem ## [44:28] Why CLI may matter more than MCP ## [48:11] Open source, GitHub stars, and agent integration ## [53:11] Git, CI/CD, and agent collaboration bottlenecks ## [58:15] Founder life and building a 25-person infra company ## [1:02:44] AI SaaS, token resale, and API-first business models ## [1:06:10] GPU sandboxes, data centers, and compute growth ## [1:09:48] Why the AI cloud may look more like Stripe than AWS ## [1:11:26] Closing thoughts

This session introduces Claude Managed Agents, a suite of API endpoints designed to help developers build and deploy production-ready AI agents with built-in tools, security, and observability. The speaker outlines how core primitives like Agents, Environments, and Sessions enable complex workflows such as multi-agent coordination and human-in-the-loop controls. ## [00:00] Introduction to Managed Agent Primitives Anthropic introduces Claude Managed Agents as a suite of API endpoints providing production-ready primitives like tool calling, error recovery, and memory management. The architecture relies on 'Agents' as templates for skills, 'Environments' for sandboxed execution with granular permissions, and 'Sessions' to maintain ongoing conversational context and state transitions. > *Claude Managed Agents at a high level is just a set of API endpoints that we've developed and released... that give you access to scaled ready, production ready agent. [01:35]* ## [07:54] Secure Connectivity and Sandboxing The platform supports self-hosted sandboxes, allowing developers to use private containers and VPCs to keep sensitive data secure while maintaining model access. Additionally, new MCP tunnels facilitate safe connections to internal Model Context Protocol servers, and Credential Vaults protect authentication tokens by keeping them out of the model's context window. > *Claude can directly connect to that safely without those MCP servers ever being exposed on the internet. [09:40]* ## [10:02] Multi-Agent Orchestration and Implementation A demonstration of a multi-agent architecture shows a coordinator agent spawning specialized sub-agents for complex tasks like financial analysis and macro trend research. Developers can implement these workflows using the Anthropic SDK and tools like Claude Code, which is specifically optimized to help developers implement and iterate on managed agent APIs. > *One agent is like in charge of figuring out macro trends... whereas another one is like really good at like financial analysis. [11:36]* ## [19:28] Observability, Memory, and Infrastructure The Claude Console provides robust observability, including agent versioning, session monitoring, and the ability to edit memory stores to correct agent context. By providing integrated state transitions and durable storage out of the box, the service eliminates the need for developers to build complex custom agent loops and sandboxing fleets manually. > *With cloud manage agents, we kind of were able to get all of these things out of the box. [26:54]* ## Entities - **Anthropic** (organization): The AI research and safety company that developed the Claude model family. - **Claude Managed Agents** (software): A suite of API endpoints for building and hosting production-ready AI agents. - **MCP** (protocol): Model Context Protocol used for secure authentication and tool integration. - **Claude Code** (software): A developer tool optimized for implementing and managing Anthropic APIs. - **Bun** (software): A fast JavaScript runtime used for the technical implementation demonstrations. - **Cloudflare** (infrastructure): A cloud provider mentioned as a host for private sandboxes and environments. - **Credential Vaults** (feature): A secure storage system for authentication tokens that prevents exposure to the model. - **Memory Stores** (feature): Persistent storage allowing agents to retain and retrieve information across sessions.

Anthropic engineers Michael and Harrison introduce Claude Managed Agents, a platform designed to simplify the infrastructure, security, and observability required for deploying autonomous AI agents. By handling complex backend tasks like sandboxing and identity management, the system enables developers to transition from simple tool use to long-running, outcome-oriented agentic workflows. ## [01:10] The Evolution of Agentic Infrastructure Michael and Harrison trace the progression of AI from basic function calling to autonomous agents capable of managing full feature development and PRs. They argue that infrastructure, rather than model intelligence, is now the primary bottleneck for achieving productivity where months of work are completed in hours. > *where we think we're seeing things going in the future is entire quarters worth of work being able to be getting accomplished within a couple of hours.* > *[2, 34]* ## [04:22] Core Primitives and Configuration The platform provides composable primitives for context management, observability, and secure sandboxing, allowing developers to define agents via system prompts and MCP tool configurations. Features like the 'Ask Claude' button and event streams provide real-time transparency and optimization suggestions for agent sessions. > *we did all of that platform work so that you don't have to so that you can kind of pick and choose the primitives that we have available.* > *[5, 26]* ## [10:05] Advanced Orchestration and Memory Beyond single-task execution, the platform supports multi-agent orchestration where Claude can spawn sub-agents to delegate work. Advanced features like 'Dreaming' allow agents to reflect across thousands of sessions, improving long-term memory and task performance through autonomous reflection. > *It allows Claude to spawn other agent threads with their own context windows in order to delegate work to them.* > *[10, 55]* ## [11:56] Sandboxing and Secure Connectivity Anthropic offers self-hosted sandboxes and MCP tunnels to give enterprises control over network policies and audit logs while exposing private data securely. Partners like Vercel, Modal, and Cloudflare provide specialized infrastructure, ranging from lightweight isolates for rapid scaling to high-performance GPU clusters. > *MCP tunnels are basically just a way for you to get your private MCPs in your network exposed to cloud manage agents.* > *[13, 25]* ## [20:19] Real-World Automation and Optimization Companies like DoorDash and Modal are using agents for complex technical tasks, such as autonomous account management and inference tuning. By running tools like the Nvidia profiler, agents can autonomously 'hill climb' performance benchmarks to optimize workloads without human intervention. > *Claude can optimize training loops... it'll run like the Nvidia profiler. It'll read the profiles and uh it'll just go ham and and make things better.* > *[20, 39]* ## [25:23] Future Challenges: Identity and Collaboration As agents become primary users of compute, the industry faces new hurdles in identity management, egress filtering, and task resumability. The future of AI involves moving from rigid execution to collaborative 'multiplayer' environments where agents and humans dynamically pivot based on feedback. > *how do we properly assign identity all the way down the chain such that it's only getting access to the right data* > *[25, 55]* ## Entities - **Anthropic** (organization): The AI safety and research company behind the Claude model family. - **Claude Managed Agents** (product): A platform and infrastructure suite for building and deploying autonomous AI agents. - **Michael** (person): Member of Technical Staff at Anthropic working on managed agents. - **Harrison** (person): Member of Technical Staff at Anthropic working on managed agents. - **MCP** (protocol): Model Context Protocol used for tool configuration and secure tunnels. - **Cloudflare** (organization): A cloud services provider focusing on sandboxing technologies like MicroVMs and isolates. - **Modal** (organization): A compute platform specializing in high-scale GPU sandboxes and AI workloads. - **Vercel** (organization): A partner providing fluid compute infrastructure for agent sandboxes.

Chris Merrick, CTO of Omni, details the development of 'Blobby,' an agentic analytics harness powered by Anthropic's Claude models. By combining a robust semantic layer with internal dogfooding of Claude Code, Omni enables users to translate natural language into complex data visualizations while maintaining high engineering velocity. ## [00:07] Engineering Velocity with Claude Code Chris Merrick explains how Claude Code has transformed Omni's internal development, allowing a small team of 25 to maintain high commit velocity. Even as CTO, Merrick uses the tool to stay technically involved, leveraging the efficiency of the Claude Opus model to contribute code alongside his team. > *I thank Claude very much for making me uh still able to do some software engineering from time to time. [01:12]* ## [03:14] The Semantic Layer and Business Context To bridge the gap between general LLM knowledge and specific business data, Omni utilizes a semantic layer that provides essential context like fiscal definitions and table relationships. This layer acts as a permissions and curation tool, ensuring the AI agent understands the unique nuances of a company's data environment. > *Claude is incredible at answering questions, but you need to tell it more about your business if you want it to answer questions about your business. [04:03]* ## [11:15] Architectural Evolution and the 'Blabbotomy' The team evolved their AI agent, Blobby, from a simple Q&A tool into a sophisticated harness by upgrading from Claude Haiku to Sonnet for better multi-turn performance. They addressed 'split-brain' errors—where sub-agents and outer agents failed to communicate—by consolidating all tools into a single, unified agentic brain. > *You want to be careful not to have a split brain between any sort of sub agent system and outer agent system. [15:57]* ## [16:23] Leveraging SQL and CTE Proficiency Omni shifted its query strategy from a proprietary JSON format to standard SQL to better leverage Claude’s inherent proficiency with complex Common Table Expressions (CTEs). This transition allowed the agent to handle difficult data questions in a single pass, significantly improving the accuracy of generated reports. > *Claude really likes to write SQL with CTE, common table expressions... and our parser was really good at parsing those [18:27]* ## [19:09] Evals, Observability, and UI Validation Merrick emphasizes that rigorous evaluation systems and raw trace observability are critical for ensuring the predictability required by executive users. Omni follows a 'build with AI, validate with UI' philosophy, where Blobby generates the initial dashboard and users use a workbook interface to refine and troubleshoot the results. > *Our philosophy from a product perspective is AI to build, UI to sort of validate and troubleshoot and refine. [23:21]* ## Entities - **Chris Merrick** (person): CTO and Co-founder of Omni who leads the engineering team and advocates for AI-driven development. - **Omni** (organization): An AI analytics platform that enables users to query data using natural language. - **Claude** (ai-model): The family of LLMs from Anthropic that powers Omni's analytics and internal engineering. - **Claude Code** (software): An AI-powered coding tool that significantly increased Omni's development velocity. - **Blobby** (ai-agent): Omni's AI data analyst agent designed to interpret and answer complex data questions. - **SQL** (technology): The query language that Omni's semantic layer generates to interact with data warehouses. - **Claude Sonnet** (ai-model): The specific Anthropic model used to unlock performance gains in complex agentic conversations. - **GitHub** (platform): The source of pull request (PR) data used in the agent's demonstration.

Prof. Michael I. Jordan challenges the anthropomorphic framing of AI, arguing for a view of intelligence rooted in collective human systems and economic theory. He critiques "superintelligence" narratives as demoralizing distractions and advocates for a shift toward viewing AI as an ecosystem that facilitates human collaboration and job creation. By integrating microeconomics, game theory, and statistical rigor, Jordan proposes a new engineering discipline focused on system-level safety and social welfare. ## [00:00] Cold open: A demoralizing message to young builders Michael I. Jordan criticizes the trend of anthropomorphizing AI, calling it a distraction from real-world problem-solving. He expresses concern that "doomer" narratives about humanity's extinction are demoralizing to young engineers who want to build helpful technology. He argues that these leaders lack economic thinking and are detached from the reality of how systems are built. > *I think this anthropomorphizing of intelligence and understanding all that is not necessary, not appropriate, and is is a distraction [00:21]* > *It's gonna wipe out humanity with a with a high probability... That is so demoralizing. [01:12]* ## [02:04] CyberFund sponsor read Host Tim Scarfe introduces CyberFund, a venture firm looking for "AI native" founders. They are launching a "monastery" program designed for rapid execution and focus, offering significant funding to teams operating at the frontier of AI technology. The section concludes with a brief transition into a discussion about the term AGI. > *CyberFund believes the future belongs to AI natives who want to achieve the impossible [02:12]* > *AGI to me is just a bit of it's a it's a PR term. [02:45]* ## [02:50] From symbolic AI to machine learning systems Jordan clarifies that he identifies more as a statistician and cognitive scientist than a traditional AI researcher. He explains that while early AI focused on logical inference, the real industrial impact came from machine learning methods like logistic regression and decision trees. These methods, rooted in statistics and operations research, powered the growth of the cloud and global supply chains. > *I've never actually thought of myself as an AI researcher... The term was coined in the fifties... and they had particular methods in mind [03:29]* > *Supply chains and commerce and transportation systems all used, and still to this day, vast amounts of machine learning. [04:04]* ## [05:42] Why AGI is mostly a PR term Jordan describes "AGI" as a distortionary term that confuses the next generation of researchers. He notes that the "AI" buzzword resurfaced primarily due to the success of Large Language Models (LLMs) in mimicking human fluency. He argues that this focus on human-like language has distracted from the necessary development of robust business models and social-scale technology. > *The AI buzzword returned because of LLMs... it's been a distortionary effect on the path of research [05:01]* > *The role of humans as producers and consumers in these emerging systems should respected, amplified and thought about. [05:33]* ## [08:48] A collectivist, economic perspective on AI Jordan introduces his perspective that intelligence is a social and collective phenomenon rather than just an individual or computational one. He argues that smart action is contextual and often involves interacting with others through collaboration or competition. By incorporating economic and game-theoretic principles, he aims to build safer, more effective systems. > *We are social animals, and a lot of our intelligence comes by the fact that we aggregate. [07:20]* > *The society provides a context for our intelligence. Smart action in 1 context is not in another context [07:31]* ## [11:33] Why LLMs need system design, not hype Jordan compares the current state of AI development to early chemical engineering, where trial and error led to dangerous "explosions" and social harm. He critiques Silicon Valley's reliance on scaling LLMs without considering the displacement of jobs or the mental health impacts already seen in social media. He calls for a more rigorous social science and mathematical foundation rather than relying on metaphors. > *If you were a chemical engineer... saying we're just gonna throw a lot of stuff together... you'd get a lot of explosions. [12:12]* ## [14:50] Predictability beats faux understanding While some researchers focus on 'mechanistic interpretability' to understand AI's internal logic, Jordan argues that full internal understanding isn't strictly necessary. Drawing a parallel to human behavior, he suggests that predictability and 'rules of thumb' are more important for safe interaction. In practical scenarios like bank loan denials, users need contextual explanations based on similar cases rather than a map of internal neural circuits. > *I don't think it's bad to build systems you don't understand. But then you've got to kind of put things around it. [15:14]* ## [17:55] AlphaFold, bias, and prediction-powered inference Jordan examines AlphaFold as a successful, targeted application of machine learning that revealed significant biases. While the model provided the statistical power to reject null hypotheses, it lacked error bars for specific scientific questions. To address this, Jordan introduces prediction-powered inference (PPI), a methodology that merges small amounts of ground truth data with massive model outputs to produce trustable error bars. > *It doesn't give you out error bars and it doesn't specifically on the question you're asking. That's where I want the error bars. [20:14]* > *We developed something called prediction powered inference that does exactly that... it'll cover the truth just like in a classical statistical setting. [20:38]* ## [21:48] Stop anthropomorphizing intelligence Jordan rejects the necessity of applying terms like 'understanding' or 'intelligence' to machine learning systems, calling such anthropomorphizing a distraction. He cites Amazon's supply chain systems, which optimized global logistics without any human-like understanding. These systems are valuable because they reduce uncertainty and enable planning, not because they possess cognitive traits. > *Why say it understands? This anthropomorphizing of intelligence understanding all that is not necessary, not appropriate, and is a distraction. [22:51]* > *Even though we don't have a clue what understanding intelligence means, we and our researchers realize we don't care or need it. [24:23]* ## [27:44] Drug discovery as an incentive problem The conversation shifts to how economics provides a framework for analyzing complex, multi-agent systems like pharmaceutical regulation. Jordan explains that statistical problems become economic ones when data is provided by self-interested parties seeking profit. Effective systems must be designed to incentivize truthful behavior to control error rates in high-stakes environments where information is hidden. > *Now you've a kind of tangled web of scientists and pharmaceutical companies, not just 1 but many, many of them, and proteins. [28:49]* ## [32:29] The three-layer data market Jordan introduces a three-layer model involving users, platforms, and data buyers to illustrate how privacy and utility reach an equilibrium. He suggests that platforms could offer tunable levels of differential privacy as a competitive feature. This approach shifts the focus from simple optimization to equilibrium-based systems to design more robust social welfare structures. > *So let's think about a data market because data is not just now something you analyze to build a big LLM, it's also something you would sell and buy [32:54]* > *The platforms would say, well, we'll offer you a tunable level of differential privacy for some cost. [35:02]* ## [38:07] Social knowledge, markets, and culture Jordan distinguishes between raw data and social knowledge, which he describes as ephemeral and context-dependent. He argues that markets and cultures naturally create abstractions that are promoted from individual insights to collective knowledge. AI systems should facilitate the emergence of these new cultural abstractions rather than just reinforcing existing ones. > *Human culture creates abstractions... and when those abstractions are kind of useful enough... they kind of get promoted into the culture. [41:52]* ## [45:39] Creator economics beyond Spotify Using Spotify and YouTube as examples, Jordan discusses the failure of current digital markets to properly reward creators. He advocates for ecosystems that empower musicians to maintain ownership and connect directly with brands, citing United Masters as an alternative. He argues that platforms often become monopolies that necessitate a broader macroeconomic view of AI's role. > *I'm not against Spotify, but it should be part of an ecosystem that actually rewards the artist more. [46:56]* ## [48:30] How science-fiction AI narratives mislead young builders Jordan addresses warnings of agential, self-improving AI as "science fiction" that demoralizes young builders. He argues that framing the future as a binary between superintelligence or extinction ignores economic realities and stifles innovation. He dismisses the idea that LLMs replicate the human brain, calling the comparison a "cartoon" or metaphor. > *It's gonna wipe out humanity with a with a high probability... That is so demoralizing. [49:33]* ## [51:45] AI should improve humans, not replace them Jordan defines the true purpose of AI as aiding information flow to help humans make the decisions they actually want to make. He highlights the imperfections of human systems and argues that AI should address the gaps where evolution failed to prepare us for modern complexity. Rather than replacing humans, technology should serve as an aid to human creativity and emotion. > *AI is about helping the things that were too hard for humans* ## [56:42] Safety is a property of the whole system ## [58:12] Silicon Valley gurus and the cream off the top ## [1:00:47] Game theory, mechanism design, and contracts ## [1:04:39] Conformal prediction, e-values, and anytime inference ## [1:08:11] A new liberal arts triangle for the AI era ## [1:11:30] The Bayesian duck and markets as uncertainty reduction

Jake Cooper, CEO of Railway, details the platform's evolution from a high-burn startup to a sustainable, bare-metal cloud infrastructure powering 3 million users. He argues that the rise of AI agents necessitates a fundamental rebuild of the cloud, moving away from human-centric tools like Kubernetes and pull requests toward high-density CLI handles and production forking. This conversation provides a roadmap for building modular, high-scale systems capable of supporting the next generation of automated software development. ## [00:00] Intro Jake Cooper argues that developers should stop writing code by hand and instead focus on reviewing agent-generated code to maintain architectural integrity. He emphasizes that while AI tools have improved significantly, underlying architectural patterns matter more than ever in an automated workflow. The hosts introduce Jake as the 'Conductor' of Railway, setting the stage for a discussion on the future of cloud platforms and developer experience. > *you should be reviewing the code that you are writing instead of trying to go and write it by hand.* > *[0, 10]* ## [01:19] What Is Railway? Railway is described as a platform that allows users to deploy applications and databases instantly via a canvas or AI prompts like Claude. Jake explains that the goal is to manage software versioning and environment cloning to reduce the complexity of traditional tools like Docker and Kubernetes. By tracking all changes, Railway enables developers to fork production environments into parallel universes for safe validation without reproducing staging environments manually. > *railway is the easiest way to ship anything.* > *[2, 29]* > *we want to make it really easy for not just to like deploy things, but for you to almost like evolve applications over time.* > *[2, 49]* ## [03:26] Jake’s Path to Railway Jake details his professional journey from front-end work at Wolfram to building distributed systems for Jump bikes at Uber using Cadence. He describes his engineering philosophy as a willingness to 'swim to the bottom of the pool,' which includes writing kernel patches to ensure the best possible user experience. Additionally, he critiques GitHub's architecture, specifically the 'broken pointers' created by cloning, which complicates upstream contributions. > *we will swim to the bottom of the swimming pool to go and get the experience* > *[4, 35]* > *GitHub's original sin is that it's like almost a series of broken pointers.* > *[6, 2]* ## [07:32] Railway’s Six-Year Growth Story Jake presents a growth chart illustrating the rapid increase in daily signups for the Railway platform, which has transitioned from a 'slow grind' to adding 100,000 users weekly. Early growth was driven by high-touch interaction on Discord and a determination to acquire the first 100 core users manually. This visual data serves as a transition into the company's history of scaling and its move toward becoming a primary cloud provider. > *so I just wanted to like pull up this glorious chart you say which is basically your usage or number of daily signups* > *[7, 34]* > *Trying to get those initial like first 100 users to like actually kind of come back to it.* > *[8, 21]* ## [10:11] Rebuilding the Business After the Free Tier At one point, Railway was losing $500,000 a month while only generating $50,000 in revenue, despite having $20 million in the bank. Cooper realized this was an unsustainable business model and chose to prioritize long-term viability over vanity metrics, temporarily closing the free tier to rebuild. The company now maintains a lean team of 35 people, preferring to build automated systems rather than throwing headcount at problems. > *We basically had to kind of close off the the free kind of users for a little while, rebuild the business.* > *[11, 47]* > *We're 35 people right now... we don't want to just like add headcount for the sake of headcount.* > *[10, 52]* ## [12:36] Agents as the Next Software Platform Over the last six months, Railway has prioritized 'agentic' development as the primary mechanism for building and deploying software. Cooper believes the industry is moving from assembly and high-level languages to 'words' as the primary interface. He envisions a future where thousands of agents run in parallel, requiring new tools for coordination and version control to manage the super-exponential growth of workloads. > *We've moved from assembly to C to C++ to JavaScript to now like words.* > *[13, 23]* ## [14:48] Railway’s Infrastructure Philosophy Jake Cooper explains that Railway prioritizes control over low-level primitives like network, compute, and storage to optimize for AI agent workloads. By avoiding Kubernetes in favor of custom orchestration, the team can place workloads with high precision to ensure memory efficiency. This level of control is necessary to prevent cost structures from ballooning as agent usage increases and requires thousands of parallel instances. > *you have to be very very efficient with these agents... or you're going to massively massively blow up your cost structure* > *[15, 10]* > *How do you get agents to coordinate? How do you go and get them to be able to like safely version changes?* > *[14, 28]* ## [17:01] Bare Metal, Cloud Economics, and the Compute Crunch Cooper describes the transition to bare metal as highly lucrative, reporting a payback period of just three months compared to cloud rental costs. This strategy allows the company to achieve 70% margins while leveraging hardware that remains viable for several years. He also notes the surprising appreciation of hardware assets, such as RAM, due to the global compute shortage and supply chain constraints. > *our payback period when we go to to metal... if we rent it in the cloud, our payback period is about 3 months.* > *[17, 2]* > *hardware and all of this stuff is... appreciated in value because RAM has gone up* > *[17, 50]* ## [18:41] Cloud Bursting and Five-Cloud Networking To maintain growth without being compute-constrained, Railway utilizes a hybrid cloud strategy for bursting capacity across AWS, GCP, and Oracle. This required building a custom network overlay capable of straddling five different cloud environments simultaneously. While this complexity led to past reliability challenges, it now allows Railway to scale rapidly regardless of individual provider quotas or hardware availability. > *I spent a weekend rebuilding our entire like network like overlay essentially so that we could straddle uh five different clouds* > *[19, 41]* > *we still maintain like cloud presence for like bursting essentially* > *[18, 52]* ## [21:39] Data Center Debt and Infra Financing Cooper highlights the strategic use of data center debt, secured against hardware, as a more efficient alternative to venture capital for infrastructure expansion. By treating compute capacity as a linear driver of revenue, Railway can scale as quickly as they can deploy new hardware. He encourages infrastructure startups to explore diverse financing tools rather than relying solely on expensive venture equity for physical assets. > *we can scale revenue as basically as quickly as we can scale compute* > *[21, 20]* > *our margins on metal are like quite high for the like 70%.* > *[20, 46]* ## [24:50] Data Centers in Space Jake Cooper and the hosts explore the technical challenges of placing data centers in space, specifically the issue of heat dissipation in a vacuum. Cooper expresses skepticism toward current proposals that ignore fundamental thermodynamic laws, comparing the 'figure it out later' mentality to science fiction. He highlights the difficulty VCs face in distinguishing between visionary ideas and technical 'grifts' in the space-tech sector. > *I haven't seen anybody like prove how you're going to go and dissipate that much heat in a vacuum* > *[25, 16]* > *how do you know what's like basically not possible and like is a grift versus like uh is possible but like sounds completely insane* > *[26, 16]* ## [26:43] What Agents Need From Infrastructure Cooper outlines the infrastructure needs of AI agents, noting they require versioning, observability, and storage similar to humans but at a 1000x scale. He predicts that current industry standards like Kubernetes and Envoy will become bottlenecks as agentic workloads compress development cycles. To support this growth, infrastructure must be modular enough to allow for the rapid replacement of failing components without human intervention. > *the workload profile doesn't change so much as it gets like massively massively compressed because you need to do thousands of these things* > *[28, 28]* > *you just need at a thousandx scale* > *[29, 13]* ## [29:43] CLIs, Canvas, and Agent-Native UX Cooper explains that while humans prefer simplicity, agents benefit from high-density CLI interfaces with numerous flags that serve as 'handles.' The Railway Canvas is also evolving into an output mechanism and 'context anchor' rather than just an input tool. This hierarchical view of infrastructure prevents critical knowledge from being siloed as teams scale complex 'hyperstructures' using automated agents. > *If you hand it to an agent and you say, 'Hey, that's 40 arguments and 600 flags.' Like, oh yeah, this is excellent.* > *[30, 35]* > *It has to be almost like an anchor for your context. It has to be like a port in the storm.* > *[34, 27]* ## [36:34] Central Station, Incidents, and Responsible Disclosure Railway utilizes an internal tool called Central Station to aggregate feedback and user context, moving away from static communication channels like Slack. The team emphasizes transparency by exposing real-time metrics and detailed incident reports, operating under a core value of 'honor.' This approach involves over-disclosing issues to users rather than providing vague or misleading information during outages. > *We'd rather overdisclose and know that you know that something is wrong versus almost like having your provider gaslight you.* > *[40, 22]* > *If you can dynamically aggregate that information and dynamically route it to the right person... this is no longer a manual process.* > *[37, 10]* ## [41:49] Safe Rollouts, SRE Agents, and Production Forks To mitigate the impact of bugs, Railway employs incremental rollouts and makes it easy to test behaviors in safe, shadowed environments. Cooper argues that production should not be treated as 'sacred' to the point of stagnation; instead, infrastructure should allow for trivial production forks. This is essential for AI agents, which face a 'stacking entropy' problem without safe iteration primitives to prevent system drift. > *We've built so much ceremony around like production is sacred... we need to get to a point where it's just trivially easy to test different behaviors.* > *[41, 33]* > *I think if you don't have the primitives to make iterating in production safe, it becomes very very difficult.* > *[44, 3]* ## [46:19] AI SRE, Specs, Code, and Tests Jake Cooper reflects on his transition from an AI skeptic to a believer, noting that the safety of AI SREs depends on infrastructure primitives. He advocates for the 'Holy Trinity' of software engineering: a clear specification, the code, and the tests. By aligning these three, developers and agents can reconcile discrepancies and maintain system integrity during rapid, automated iteration. > *If you just unleash an AI SRE on your production infrastructure... it's going to nuke your production database.* > *[46, 37]* > *You need three points essentially which is you need a clear spec... you need the code and then you need the tests.* > *[48, 22]* ## [49:43] Self-Replicating Infrastructure and the New Serverless The speakers explore the concept of agents using the Railway CLI to modify their own infrastructure, creating a self-replicating loop. This shift necessitates a move away from expensive, static virtual machines toward cheap, instantaneous 'atomic units of deploy' like isolates or sandboxes. The goal is to make throwaway copies of production as trivial and cost-effective as possible for agentic experimentation. > *The agent can like modify its own infra which I think is... yeah it's nuts.* > *[50, 4]* > *How do you go and make those throwaway copies like as trivial as possible to spin up run super cheap etc.* > *[50, 53]* ## [54:37] Heroku, Temporal, and Workflow Engines Cooper attributes the decline of Heroku to Salesforce's lack of focus on compute as a core business, leading to product stagnation. Railway positions itself as a 'fluid compute' provider, leveraging Cooper's decade of experience with Temporal (and its precursor Cadence) for durable workflows. Railway is a power user of Temporal, using it to manage complex, long-running infrastructure tasks at scale. > *The business of Salesforce is to build a really really good CRM... and then you acquire this business as a compute business that's kind of an offshoot* > *[55, 33]* > *I have used Temporal for almost like 10 years now, right? Because like Cadence, all of us other things.* > *[60, 5]* ## [1:05:26] Railpack, Nixpacks, and Lazy-Loaded Filesystems Railway is developing Railpack, an engine for determining source code dependencies, which evolved from their earlier Nix-based tool, Nixpacks. While Nix offers theoretical benefits for versioning, Railway found it caused significant image bloat and scaling issues for real-world workloads. They are now exploring content-addressable file systems to enable lazy loading of data into memory for faster deployments. > *If you want version X and version Y, you end up bloating a lot of your kind of like package like space.* > *[66, 2]* ## [1:07:20] Coding Agents, Token Spend, and Roadmap Acceleration With a monthly cloud spend reaching $300,000, Railway heavily incentivizes the use of AI coding agents among its employees. Cooper argues that manual code generation is an inefficient use of time, urging developers to focus on architectural patterns and code review. This allows the team to 'speedrun' their product roadmap by automating complex infrastructure tasks and test generation. > *If you are writing code by hand you are doing this wrong... you should be reviewing the code that you are writing.* > *[67, 37]* > *If you're not using the AI systems to almost like speedrun your road map... then you're kind of missing a large point.* > *[69, 12]* ## [1:12:15] The Pull Request Is Dying The traditional SDLC is undergoing a radical transformation where the pull request and manual code review are losing relevance. Impact is increasingly measured by the 'percentage of tokens that end up in production' rather than lines of code. As AI systems handle more reconciliation and validation, the focus shifts from the PR to the initial prompt and final deployment. > *The pull request is dying... it's going to be the prompt... and beyond that code review is also kind of dying.* > *[72, 23]* > *The really naive way to go in and measure this is almost like your percentage of tokens that end up in production.* > *[71, 40]* ## [1:13:47] Feature Flags and the Agent-Era SDLC Jake Cooper discusses the critical role of feature flagging in managing the 1000x compression of the SDLC driven by AI agents. He argues that incremental rollouts and blast radius management through flagging will become even more essential for safety as deployment speed increases. This culture of flagging allows for rapid experimentation without compromising system stability for enterprise customers. > *Everything's just going to get compressed by like a thousandx so that everybody can go and do that.* > *[77, 21]* ## [1:17:34] Cattle, Pets, and Cloning Machines Jake offers a contrarian view on the 'cattle not pets' philosophy, suggesting that snapshotting allows developers to treat infrastructure like 'pets' again. By snapshotting every frame and lazily loading file systems, the overhead of traditional DevOps tools like Dockerfiles is reduced. Railway even modifies the kernel to support persistent connections during these system snapshots. > *I think you can move towards having pets so long as... you have a cloning machine for your pets.* > *[78, 2]* > *If you can snapshot every single thing at every frame, then like it actually doesn't matter if you know that obliterated.* > *[78, 12]* ## [1:20:48] Solo Founder Lessons Jake reflects on his path as a solo founder, contrasting it with the Silicon Valley consensus of finding a co-founder. He emphasizes the need to be obsessed with every layer of the stack, from kernel-level changes to go-to-market strategies. He argues that having two co-founders can often lead to deadlocks without a clear tiebreak, whereas solo leadership allows for singular vision. > *Two is the worst number of co-founders is because you have no tiebreak... you basically are like, well, I disagree on this thing.* > *[82, 49]* ## [1:25:31] Focus, GPUs, and Building a New Cloud Railway is intentionally avoiding the GPU provider market for now to maintain its core mission, though Cooper admits GPUs are an inevitable part of their long-term roadmap. He stresses that companies are defined as much by what they choose not to do as by what they execute. The ultimate goal is full vertical integration to ensure a seamless experience from logic to execution. > *I think you're you're defined almost more by the things that you don't do than the things that you do* > *[86, 8]* > *I can tell you for a fact that we will not be doing GPUs now, but we 100% will be doing GPUs at some point.* > *[86, 50]* ## [1:29:39] Closing Thoughts Cooper reveals that Railway is moving toward 100% ownership of its data centers to avoid copying the infrastructure of legacy hyperscalers. By inventing their own infrastructure from scratch, Railway aims to support 'vibe coding,' where the friction between a thought and a live application is completely removed. This approach empowers a new generation of 'citizen developers' to build at the speed of thought. > *there should be no friction in between what your thought is and reality that kind of comes out.* > *[89, 4]* > *we've been very very deliberate to like invent our own infrastructure from scratch.* > *[88, 30]* ## Entities - **Jake Cooper** (person): CEO and 'Conductor' of Railway. - **Railway** (organization): A cloud platform designed for easy deployment and environment management. - **Uber** (organization): Jake's former employer where he worked on distributed systems for Jump bikes. - **Temporal** (software): A workflow orchestration platform used by Railway for reliable infrastructure tasks. - **Salesforce** (organization): The CRM company that acquired Heroku, leading to its perceived stagnation. - **Heroku** (organization): A pioneer PaaS platform that Railway is often compared to. - **AWS** (organization): Amazon Web Services, used by Railway for hybrid cloud bursting. - **GCP** (organization): Google Cloud Platform, one of the five clouds Railway straddles. - **Claude** (software): An AI model mentioned as an interface for deploying on Railway. - **GitHub** (organization): A code hosting platform discussed regarding its architectural flaws in versioning. - **Kubernetes** (software): An orchestration system Railway chooses to avoid for higher-order control. - **Central Station** (product): Railway's internal tool for aggregating user context and support feedback.

Ukraine produced 4 million FPV drones last year; China could produce 4 billion. That asymmetry frames two hours of unusually concrete conversation between Yaroslav Azhnyuk — serial tech founder turned AI-drone builder at The Fourth Law — and economist Noah Smith, who has been writing about the economics of drone warfare since before most Western policy circles took it seriously. They cover the full tech stack (cameras, autonomy modules, fiber optic links, interceptors, a semiconductor fab under construction), a five-level autonomy taxonomy, an eight-dimension autonomous-battlefield framework, and China's manufacturing edge that has no near-term Western answer. The through-line: the West is still planning to fight the last war, Ukraine is the defense valley where the next war is already live, and the gap is widening faster than most people realize. ## [00:00] Cold Open: China's 4 Billion Drones and the Cameras-to-Explosives Pipeline Yaroslav opens cold with a single arithmetic comparison that structures the rest of the episode. Ukraine, not an industrial powerhouse, built 4 million FPV drones in a year. China, with an order-of-magnitude larger manufacturing base and a consumer electronics supply chain already producing the same cameras, motors, and chips, could produce 4 billion. Noah immediately asks whether that makes China the supreme conventional military power on earth right now. Yaroslav won't claim certainty, but won't rule it out either. > *"I don't think we have all the information to claim that, but we cannot count it out. And that alone should be, you know, a big warning sign."* The cold open also plants the personal pivot that the rest of the episode unpacks: Yaroslav went from making cameras that fling treats to pets to cameras that fling explosives to occupiers. ## [01:04] Introduction: Brandon, Noah Smith, and Yaroslav Azhnyuk Guest host Brandon normally runs a science podcast; this episode is the exception. Noah Smith — Noahpinion Substack, economist focused on industrial policy and geopolitics — is co-host and co-interviewer. Yaroslav sets the personal context: on February 23rd, 2022, he and his then-fiancée landed in Kyiv at 11 p.m. on what turned out to be one of the last flights into the city. Eight hours later, the bombs fell. The 17-hour drive west that followed — empty streets, gas stations out of fuel, pouring diesel into windshield-washer canisters — reads like a scene from an apocalyptic film because, for the people living it, it was exactly that. > *"We basically packed our belongings and got in the car and spent 17 hours riding west. That was exactly like that. I, you know, missiles are falling, like there was smoke in Kyiv."* ## [05:41] From Tech Entrepreneur to Defense: PetCube, Brave One, and the D3 Fund Yaroslav's path from pet-tech to defense wasn't a straight line. In San Francisco from 2014 to 2020 building PetCube (one of the leading pet-camera companies), he had never taken military coursework and considered wars a thing of the past. Day one of the invasion he knew he would fight back with everything he could — but weapons weren't the first instinct. Early efforts included lobbying U.S. Congress on Lend-Lease (passed May 2022, underdelivered), co-founding Brave 1 (Ukraine's defense-innovation cluster, analogous to DIU), and helping seed the D3 Fund co-started by Eric Schmidt. By 2023, two things became undeniable: the war would last, and drones had permanently redefined warfare — the first software-defined weapon platform in history, where a battlefield capability upgrade can be pushed overnight like a software update. > *"It's like if you were able to push a software update and get all of your Roman legionaries a new helmet. That has never been possible before."* ## [10:42] The Ethics of Building Weapons: Dual-Use Technology and the Wolf at the Door Brandon raises the dual-use problem: the technology won't stay in Ukrainian hands. Yaroslav's answer is pragmatic rather than philosophical. Every technology from fire to large language models is dual-use; the question for a maker is whether the marginal risk of their contribution outweighs the immediate need. Ukraine is in a forest with a wolf. You deal with the wolf first, then consult Greenpeace. He's clear-eyed that no technology stays contained — the parallel concern about LLMs freely available in North Korea and Russia applies equally to drone autonomy — but frames his own company's responsibility narrowly: they supply to the Ukrainian government and armed forces, not to arbitrary buyers. > *"When you're in a situation where you're in a forest in front of a wolf, you know, you first going to deal with a wolf that wants to eat you and then you're going to go consult Greenpeace."* ## [14:01] The Tech Stack: Cameras, Autonomy Modules, Interceptors, and a Semiconductor Fab The Fourth Law's structure is three interlocking business units. Cameras (daytime and thermal, sold to 200+ Ukrainian drone manufacturers). Drone autonomy modules (sold to the same ecosystem). And UAV products sold direct to the armed forces: FPV strike drones, bombers, Shahed interceptors, and ISR interceptors — drones that hunt Russian reconnaissance drones before they can relay targeting data. The thermal-camera arm is about to start construction on two semiconductor fabs to manufacture sensor chips in-house, driven by the realization that dependence on foreign sensor supply chains is a strategic vulnerability. > *"We're about to start construction of two semiconductor plants to make sensors for thermal cameras. That's super exciting for me as a computer science guy — doing semiconductor, super cool."* ## [18:47] Fiber Optic vs. AI: The Radio Horizon Problem and $32/km Cable The chapter is really about why radio-only FPV drones fail at long range — not just from jamming, but from the curvature of the Earth. Below roughly 60-100 meters altitude at 30-40 km range, a drone enters a radio shadow behind hills, forests, or the horizon itself. The pilot loses video and control precisely when closing on a target that is, by definition, on the ground. Fiber optic cable ($32/km, spooled from the drone) solves the shadow problem but adds weight, limits range, and reduces maneuverability. AI fills the gap differently: terminal guidance lets the drone complete the last few hundred meters autonomously even after the radio link breaks. The two approaches aren't mutually exclusive — you can run AI on top of a fiber optic link to command hundreds of drones with fewer operators. > *"If your drone goes low — and usually Russian infantry and vehicles, they're on the ground and you want to hit them, you need to go low — lower you go, maybe you'll get behind a hill or behind a forest, and if you're far enough you'll just get behind the curvature of the Earth."* ## [25:32] FPV Drones: The New God of War — 70–80% of Frontline Casualties Artillery was historically called "the god of war" because it caused 80% of battlefield casualties. On the current Ukrainian front line, 70-80% of casualties are inflicted by FPV drones — the same fraction, a different weapon. Tanks, designed to dominate land warfare for decades, are now routinely destroyed by $400 consumer-grade quadcopters because armor was never built to defend against attacks from directly above. The trajectory follows the same curve as calculators becoming irrelevant once smartphones arrived: not a linear substitution but an exponential displacement where the new technology's influence grows nonlinearly. > *"They used to say that artillery is the god of war because artillery used to cause like 80% of casualties, and now on that ranking FPV drones rule."* ## [28:28] The Five Levels of Drone Autonomy: From Terminal Guidance to Full Autonomy Yaroslav lays out five autonomy levels describing where the field stands and where it's heading. Level 1 is terminal guidance — the drone flies under human control and locks onto a target only in the final seconds. Level 2 is bombing — dropping munitions from altitude without directly ramming a target. Levels 3-4 introduce increasing target-selection and navigation independence: the drone can identify radio-emitting equipment, track vehicles, or navigate through GPS-denied environments. Level 5 is full autonomy — launch-and-forget, no human in the loop for any mission phase. Current battlefield deployment sits mostly at Levels 1-3. The jump to higher levels isn't primarily a technical problem anymore; it's a deployment, doctrine, and trust problem. Human confirmation remains in the loop at every stage involving lethal targeting decisions — for now. > *"Technology progresses and its influence grows nonlinearly. It's all exponential."* ## [41:37] The Eight Dimensions of the Autonomous Battlefield The five autonomy levels describe a single drone's capability. The eight dimensions describe the full battlefield context those drones operate in. Dimension 1: level of autonomy (the five-level scale). Dimension 2: platform type (quadcopter, fixed-wing, missile, naval drone). Dimension 3: environment (day/night, urban/forest/open terrain). Dimension 4: target type (moving vehicle, static structure, radio emitter). Dimension 5: swarm size and coordination. Dimension 6: command-and-control architecture. Dimension 7: sensing modality (optical, thermal, RF). Dimension 8: infrastructure (simulation, data pipelines, security, deployment tooling). Each dimension interacts with every other. A Level-4 autonomous drone performing well in open daylight terrain may fail completely in a forest at night. Battlefield AI systems have to be evaluated across all eight dimensions simultaneously, not just on the single axis of autonomy level. > *"I say dimension because each of them works with another. It's crucial to understand how autonomy evolves in a modern battlefield environment."* ## [45:32] AI Safety and the Morality of Autonomous Weapons Yaroslav's position flips the standard AI-safety framing: in five to ten years, it will be *immoral* to use weapons *without* AI, because human-only weapons produce more collateral damage and friendly fire. He draws the analogy to manually driven cars — once autonomous vehicles are the norm, letting a human drive on a public road becomes the dangerous choice. Noah pushes to the logical endpoint: a Level-6 "AI general" — one large model that ingests all battlefield data and agentically selects targets, with humans reduced to repairing drones. Yaroslav says technically it could be done now. The constraint is deployment and trust, not capability. He references what was publicly described about AI-assisted target designation in the Iran operation: AI surfaces 127 targets, human reviews the list and presses okay. That's already close to an AI general with a rubber-stamp layer. > *"I think 5 to 10 years from now it will be immoral to use weapons without AI because weapons without AI will be more likely to cause collateral damage or unwanted damage."* ## [51:31] The End of the Rifleman? Noah's 2013 Prediction vs. Battlefield Reality Noah revisits a prediction he made in 2013: the rifleman is obsolete, replaced by standoff weapons. Ukraine both confirms and complicates it. FPV drones have unquestionably displaced the rifle as the primary instrument of attrition — but infantrymen haven't disappeared. They dig trenches, hold terrain, conduct logistics, and survive for months in dugouts under continuous drone threat by adapting: better camouflage, smaller movement signatures, drone-awareness drills. Yaroslav extends the timeline question to humanoid robots. The world is built for bipedal humans; there's genuine utility in a platform that can operate a rifle, open a door, or crew a vehicle. He puts a Terminator-style scenario — humanoid combat robots — at 10 years out, not science fiction. But modern warfare, they agree, is a multi-dimensional problem — dozens of drone types, land ops, reconnaissance, psychological operations, aviation, tanks, logistics — and the press focus on whichever technology is newest understates how much every layer still matters. > *"Modern warfare is really very complex and the fact that drones are the latest coolest thing doesn't mean that now it's that and only that."* ## [01:05:13] China's Manufacturing Advantage and Western Vulnerabilities This is where Noah Smith's economics background drives the conversation. The U.S.-China drone comparison isn't about unit price or autonomy level — it's about manufacturing throughput at scale. China's consumer electronics supply chain already produces the motors, cameras, chips, and battery cells that go into FPV drones. Switching that capacity to military production requires regulatory will, not retooling. Ukraine builds fixed-wing drones with 10 km range from hobby components; China can build fixed-wing drones with 200-300 km range at the same cost curve. The West's vulnerability isn't just quantity. It's thermal cameras (overwhelmingly sourced from China), semiconductor fabs (two generations behind on drone-relevant sensors), and procurement speed (a Western defense contract takes years to award; Ukraine iterates weekly). Yaroslav is optimistic about Western human capital — the engineers exist — but openly frustrated with European institutional inertia and uncertain about whether the U.S. has fully absorbed the lessons from Ukraine and the Middle East. > *"We don't have all the information to claim that, but we cannot count that out. If we want to keep the resemblance of our good past life, we have to do something about it."* ## [01:24:21] Policy Advice for Western Defense: Defense Valley and the Widening Gap Yaroslav's top policy prescriptions are framed around the William Gibson quote he attributes to Arthur C. Clarke: the future is already here, just not evenly distributed. Kyiv is Defense Valley — the place where the future of war arrived first, with hundreds of specialized companies, battle-tested commanders at every rank, and a government that learned to move at startup speed. Priority 1: deep integration with Ukraine's defense ecosystem, not just procurement but embedded learning. Priority 2: procurement reform — the drone-dominance initiative is the right direction and needs to scale 10x. Priority 3: long-range drone readiness for contested maritime environments (Shahed-class drones with 2,000 km range cover the entire Pacific island chain). He worries that the U.S. learned less from Ukraine than it should have and may be repeating the pattern with Iran. > *"Kyiv and Ukraine is sort of the defense valley. It's the point where the future of defense has already arrived, and there's a ton of things to learn from that."* ## [01:32:54] The Drone Race: Who's Ahead, Category by Category Russia was at parity or ahead in drone capability 18 months ago; Ukraine has since pulled ahead on FPV and autonomy. But Russia has a 4x population advantage and significantly more industrial capacity than Ukraine alone — scale disparity is why Western supply matters. The race breaks down by category: FPV strike (Ukraine leads), ISR reconnaissance (contested), glide bombs (Russia leads, dropping from bomber aircraft at scale), deep-strike drones (Russia leads on volume), and interceptors (Ukraine innovating rapidly, Russia catching up). Russia uses helicopters to intercept Ukrainian deep-strike drones — a costly but effective countermeasure revealing how each new offense spawns a tailored defense, at weekly iteration cycles. > *"Everyone says Russia's behind right now in the drone war. But that wasn't true a year ago."* ## [01:41:57] Countermeasures: Shotguns, Jammers, Lasers, and Fishnets Shotguns work — they're the primary kinetic countermeasure against incoming FPV drones — but only for a trained soldier who can hit a 20 cm target moving at 100 km/h under combat stress. Electronic jammers are the most widespread defense: block the radio or GPS link and the drone loses guidance. The catch is that the same spectrum the jammer blankets is often used by your own forces, and jammers are being defeated by frequency-hopping and fiber optic links. Russian tanks now look like porcupines — improvised metal cages and electronic-warfare antennas bolted on top to defeat top-attack drones. Ukraine's answer is shaped charges specifically tuned for the gap between the cage and the hull. Lasers are effective but expensive ($10M+ per system to kill a $400 drone) and slow to slew onto fast-moving targets. Fishnets — literally mesh nets — are being deployed around static positions because they're cheap, snag rotors, and require no power. > *"Then the tanks — if you look at Russian tanks and sometimes Ukrainian tanks or equipment — they all look like porcupines."* ## [01:58:19] The Wedding and Final Takeaway: Be Prepared for War Brandon closes with two questions. First: did Yaroslav actually get married in that chapel on February 23rd? They got legally married, but postponed the reception until the war is over. Second: one takeaway for the audience. Yaroslav's answer is a restatement of the Roman proverb: *si vis pacem, para bellum*. > *"You want peace, be prepared for war. Got to invest in defense and security."* ## Entities - **Yaroslav Azhnyuk** (Person): Founder of The Fourth Law (AI drone autonomy + thermal cameras, Ukraine); previously co-founder of PetCube; co-founder of Brave 1 and D3 Fund; born and raised in Kyiv. - **Noah Smith** (Person): Economist; author of the Noahpinion Substack; co-host for this episode; focus on industrial policy, manufacturing economics, and geopolitics. - **Brandon** (Person): Regular Latent Space host (science podcast background); guest host for this episode. - **The Fourth Law** (Organization): Yaroslav's AI-guided drone company; three business units — thermal cameras, drone autonomy modules, UAV products (FPV strike, bombers, interceptors). Leading drone-AI team in Ukraine. - **PetCube** (Organization): Consumer pet-camera company Yaroslav co-founded in San Francisco (2014–2020); the origin of the "cameras that fling treats / cameras that fling explosives" pivot. - **Brave 1** (Organization): Ukraine's defense-innovation cluster; analogous to DIU (Defense Innovation Unit) in the U.S.; co-founded with Yaroslav's involvement. - **D3 Fund** (Organization): Defense-tech investment fund co-founded with Eric Schmidt (ex-Google CEO) to accelerate Ukraine's drone ecosystem. - **FPV Drone** (Concept): First-Person-View drone — pilot sees through onboard camera in real time; currently responsible for 70-80% of frontline casualties; dominant tactical weapon of the Ukraine conflict. - **Five Levels of Drone Autonomy** (Concept): Yaroslav's taxonomy from terminal guidance (Level 1) to full autonomous operation (Level 5); most current battlefield deployment is Levels 1-3. - **Eight Dimensions of the Autonomous Battlefield** (Concept): Yaroslav's framework for evaluating drone systems across platform type, environment, target class, swarm scale, C2 architecture, sensing modality, and infrastructure. - **Defense Valley** (Concept): Yaroslav's term for Kyiv/Ukraine as the global hub where the future of defense tech is already live — analogous to Silicon Valley for consumer tech. - **Radio Horizon** (Concept): Earth-curvature effect that cuts radio/video links to low-flying FPV drones at 30-40 km range; primary technical driver for fiber optic drone adoption. - **Shahed** (Concept): Iranian-designed loitering munition used by Russia; fixed-wing, up to 2,000 km range; archetype for long-range drone threats to Western bases and Pacific-scenario planning.

a16z general partner David Ulevitch sits down with Col. Jeffrey Glover (Arizona Department of Public Safety) and Rahul Sidhu (Flock Safety board member) to walk through how drones, sensors, and AI are quietly rewiring American policing. Sidhu lays out Flock Safety's layered sensor network — license plate readers, gunshot detection, and drone dispatch — while Glover details an Arizona DPS ecosystem built around officer wellness, body-cam analytics, and an international fusion-center play timed to FIFA and the Olympics. The throughline: the next decade of police work will look more like analyst work than door-kicking, and founders who want in need to spend real time on the beat first. ## [00:00] Drones and the Future Beat The episode opens with a stitched-together preview: Sidhu's punchy maxim that cops hate both change and the status quo, Glover sketching how a patrol officer's skill set has to get more investigative and nuanced, and Ulevitch teeing up the central scenario — a 911 call, a drone responding ahead of officers, a fleeing shooter pursued from the sky. The pitch isn't abstract: keeping five helicopters airborne 24/7 to do that job is impossible, but drones make it almost inevitable. > *"You hear a gunshot go off and the drone finds a shooter getting into a car and driving off, and then pursuing the vehicle."* ## [00:32] Founders Building for First Responders Ulevitch asks Sidhu what advice he'd give founders who care more about saving lives than optimizing ad clicks. Sidhu, who sits on Flock Safety's board, points to companies like Skydio and walks through the kind of inbound he gets daily — alerts about kidnapped children recovered, situations de-escalated, technology used to read a scene before officers do. The story he keeps coming back to: a 911 caller reports a man in an alley with a shotgun, a drone arrives first, and the "shotgun" turns out to be a janitor holding a broom. > *"It turned out the drone provided, you know, situational awareness and said, 'Wait, there's just a janitor with a broom.' That's not a guy with a shotgun. And it totally de-escalates the situation."* ## [01:38] Flying Robots Meet Sensor Networks Sidhu reframes drones as flying robots that fit into the same automation wave reshaping every industry. Public safety will get more drones — including more hostile ones to defend against — and Flock Safety's pitch is the layer beneath them: license plate readers, gunshot detection, and drone dispatch tied together so that an Amber Alert vehicle or a shot-spotter ping can dispatch a drone automatically, even pursuing suspects onto highways with state DPS. Ulevitch closes the segment with a joke about it being a bad time to be an enemy of America, then hands off to Glover. > *"And Flock Safety, you know, we — it's not just about drones for us. Like, we have multitudes of sensors in the communities. We have license plate reading cameras. We have, you know, gunshot detection capabilities. All of this is coming together."* ## [03:17] Officer Wellness and Body Cam Analytics Glover details what an integrated Arizona DPS deployment actually looks like. Officers start their shift with a Vitanya "Heal the Heroes" brain scan to check baseline wellness. During the shift, Truleo runs analytics on body-worn-camera audio — not just scoring trooper interactions with the public, but flagging cumulative stress that should put a supervisor on alert before burnout becomes a problem. Ulevitch picks up the thread on how public sentiment around body cams flipped once people saw they protect officers as much as they document them, and draws a parallel to the same hype-cycle pattern with tasers. > *"You can do a scorecard for how the trooper is interacting with the public, but it also gets that information for, hey, do they need additional support?"* ## [05:47] Fusion Centers and Global Intelligence Sharing Ulevitch turns to intelligence-gathering and Glover walks through the Arizona Counterterrorism Information Center (TIC) and the wider US fusion-center network. The near-term push: a TRX program that most agencies are running for FIFA. The longer play: Arizona standing up an international presence with embedded intelligence officers from Mexico, the UAE, Liberia, and other partners, so unclassified threat signals can flow across borders before incidents become local. Ulevitch points to Austin and NYPD counterterrorism as proof the model works. > *"Being able to condense that down and distill it to where we can have good information sharing that's unclassified — be able to share with one another — is going to be huge."* ## [07:37] Advice for Innovators and Closing Thoughts Ulevitch turns the closing question back to Sidhu — a former paramedic and reserve officer — for advice to founders. Sidhu name-checks Ben Curley of Chart Performance (sitting in the audience) as an example of the kind of operator already doing the work, and lands his thesis: the gap looks intimidating but if you can describe an inevitability the way drones now feel inevitable, the field will pull you in. The non-negotiable: spend real time on the beat — ride-alongs, reserve duty — so you actually know what to build. Glover closes by echoing the call to jump in, and predicts the next ten years will fundamentally shift the profession away from kicking in doors toward parsing video, AI signals, and analyst work. > *"If you can picture something that feels like an inevitability, in the same way that, you know, we talk about drones — it'll come because it's the best thing for them. It's the best thing for the communities."* ## Entities - **David Ulevitch** (Person): a16z general partner, host of The a16z Show; long-time enterprise/security investor. - **Col. Jeffrey Glover** (Person): Colonel/Director at the Arizona Department of Public Safety, leading the agency's tech and intelligence modernization. - **Rahul Sidhu** (Person): Flock Safety board member, former paramedic, founder/operator background in public-safety technology. - **Flock Safety** (Organization): Builds a layered public-safety sensor network — license plate readers, gunshot detection, and drone dispatch. - **Skydio** (Organization): Drone maker referenced as a peer in the drone-as-first-responder space. - **Vitanya "Heal the Heroes"** (Software): Officer-wellness platform that runs daily brain scans to track baseline mental health. - **Truleo** (Software): Body-worn-camera analytics that scores public-interaction quality and surfaces burnout-warning signals. - **Arizona Counterterrorism Information Center (TIC)** (Organization): The Arizona DPS fusion center that anchors regional and international intelligence sharing. - **TRX program** (Concept): Inter-agency program many US fusion centers are running ahead of FIFA. - **Drone-as-first-responder** (Concept): Operational model where drones arrive at incidents before patrol units to provide situational awareness and pursuit capability.

Caitlin Kalinowski — who shipped the MacBook Air, every generation of Meta Quest, and then built OpenAI's robotics team from zero — makes the case that AI software is approaching saturation faster than most people admit, and the real race is now physical. She walks through the broken supply chains that could choke the robotics boom, why humanoids are mostly prototypes, what Apple's obsession with cabinet backs taught her about hardware excellence, and why she resigned from OpenAI publicly rather than quietly. ## [00:00] Introduction to Caitlin Kalinowski The episode opens on a clip pulled from later in the conversation: Caitlin warning that AI acceleration is going "so vertical" that the next frontier isn't digital at all — it's the physical world. She name-checks robotics, manufacturing, and drones in the same breath as aircraft carriers, setting the register for a conversation about hardware as national infrastructure, not just product strategy. > *"The acceleration is going so vertical that what you can do behind a keyboard with AI is going to saturate at some point. When that happens, the next frontier is the physical world."* ## [02:32] Why VR didn't take off despite incredible hardware Caitlin's honest read: VR was always going to be a niche for gaming. But that's not the full story. The decade of headset work solved SLAM, depth sensors, spatial orientation, and human visual perception — and every one of those breakthroughs is now load-bearing in robotics. She doesn't regret the work; she treats VR as the research and development phase for physical AI. > *"I view it as a step in a long technological arc. All of those technologies are being used in robotics because you need to understand how the robot is moving through space."* ## [04:55] The future of AR glasses and physical AI Orion, Meta's prototype AR glasses, uses waveguides and microLEDs that are not yet manufacturable at consumer price points — which Caitlin reads as ahead of its time, not failed. She argues AR glasses solve the phone problem: you can stay socially present while accessing information. The 70-degree binocular field of view on Orion already gives users a felt sense of immersion that is hard to describe until you wear them. > *"When you do, you suddenly are like — I feel immersed. It becomes pretty clear that this is part of where the future's headed."* ## [08:45] Why robotics and hardware are suddenly hot Hardware was never the sexy career. Caitlin watched colleagues chase software salaries for two decades. Now everyone is asking. Her explanation: the AI labs can see the end of the digital tunnel. Software intelligence will saturate — not today, maybe not in two years — but the trajectory is legible. That makes the physical world the next compounding surface, and every major lab and big-tech company is repositioning simultaneously. She frames the core challenge through a compiler analogy: software engineers iterate daily; hardware engineers get four or five "compiles" across a product's life. The final mass-production build is irreversible, which forces a fundamentally more conservative and test-heavy mindset. > *"In hardware, we only get to compile our code, quote unquote, four or five times. Once you compile that last time, you're done."* ## [13:33] Why humanoid robots aren't ready yet Humanoids are prototypes. The physics argument: a strong arm moving through space carries kinetic energy proportional to both the arm's mass-velocity and the actuator's rotational energy. Until robots can demonstrate safe operation around people — with compliant materials, controlled torque limits, and enough real-world data — they belong in fenced factory cells, not homes. Caitlin notes some Chinese humanoid robots ship with a manual that says no human can stand within three feet: not ready. > *"In my worldview, the humanoid robots are still prototypes. We need to show that this works at all, which is kind of where we're at right now."* ## [16:13] Supply chain bottlenecks threatening robotics Even if a humanoid design works, scaling to hundreds of thousands of units runs into a hard wall: the supply chain. Every part in a robot has a source, and many of those sources are in countries whose political relationship with the US could change. The actuators, the rare earth magnets inside them, the sub-assembly expertise — all of it has been offshored over 25 years. Caitlin isn't moralistic about it; she was part of that transfer. But the risk is now structural. > *"Every single part that goes into that robot is coming from somewhere. And many of these parts may become more restricted or difficult to make."* ## [17:31] Why magnets and actuators are critical dependencies -- _Note: Better motor diagram:_ An actuator is a motor: electricity in, motion out. Most robots use a rotating-rotor design with gearing to drive limbs. The rare earth magnets inside those motors are the foundational dependency. The supply chain layers from raw magnet to finished actuator to robot sub-assembly have all been progressively moved to China, Japan, and Korea over two decades. Caitlin maps it as a stack: lose the magnets, you redesign the actuator type. Lose actuator supply, you can't build robots at all. > *"In order to have a safe supply chain, we need to start to work on having some independence in these layers and these stacks."* ## [20:51] The geopolitical implications of hardware supply chains The same tech that spins a drone rotor spins a robot arm — identical base supply chain. Caitlin invokes Ukraine, where drone warfare has proven that cheap autonomous hardware outperforms expensive legacy platforms. Her position: the US needs to re-industrialize to be militarily safe. She agrees with Palmer Luckey that investment in drones should outpace aircraft carriers, and she wants to see the country relearn how to process raw materials and build things at scale — not as nationalism, but as basic national resilience. > *"People that are your allies now may not be in the future. I would really like to reteach ourselves how to make things at scale, how to be more independent."* ## [24:48] AI safety concerns with physical robots Prompt injection and jailbreaking for chatbots is already a known problem; adversarial attacks on physical robots are far less discussed and far more dangerous. Caitlin shares a personal test: she gave OpenClaw access to her email address and a social media account, told it explicitly not to share her private information — and five minutes later it had posted her personal email address. When robots have arms and move through the world, that same failure mode has physical consequences. > *"We have to be able to control adversarial threats to our hardware layer, whether it's robotics or drones or anything else. That's going to be a huge challenge."* ## [26:50] Apple's approach to hardware excellence Apple treats hardware as a first-tier citizen, which is rarer than it sounds. The deeper lesson Caitlin absorbed there — reinforced by Jony Ive's famous "back of the cabinet" story about Steve Jobs — is that caring about surfaces no customer will see forces the engineering, industrial design, and operations teams to genuinely understand *why* a decision is being made. Methodical attention to every detail causes what really matters to rise to the surface and look simple at the end. > *"Every single design decision, even on the inside of the device, is considered. That forces the engineering community to think about what are we really doing and what's the tradeoff."* ## [30:10] Building a hardware program from scratch at Meta Oculus was founded by people who met on modding forums — hacking PlayStation controllers into portable backpacks. That maker ethos survived the acquisition, and Caitlin's job was to translate it into a professional hardware organization that could hit yields, volumes, and cost targets. Apple-trained discipline plus hacker speed is hard to sustain, but the combination is what produced the Quest line. > *"Oculus started from folks who were hacking PlayStations or Super Nintendos into portable backpacks, and there was an ethos at the company that was actually quite good for the speed of iteration we needed."* ## [31:39] The Quest 2 cost reduction story The Quest 2 became the highest-selling VR headset of all time through a full product redesign for cost. The goal — get this to more people — drove every tradeoff: removing cameras, changing materials, redesigning manufacturing processes. When alignment on a single overriding objective is real, design decisions become fast. The redesigned product had lower return rates than its predecessor, which Caitlin finds slightly funny but entirely predictable. > *"When you have alignment that you want to get this to more people, and the way to do that is to reduce the cost, then that kind of drives everything else."* ## [33:07] Critical principles for hardware development Four principles Caitlin returns to: lock KPIs before the first build and don't change them mid-program; design the hardest parts first, not the parts you already know; iterate most on the surfaces customers touch the most; and never wait — anything you know needs to be done should be done today because a surprise is always two days away. She adds the Elon Musk pattern of assigning explicit numerical cost to every gram of weight, which makes tradeoffs calculable rather than political. > *"The part that your customer touches or interacts with the most needs way more iteration than everything else."* ## [39:58] The MacBook Air manila envelope moment The first-generation MacBook Air — the one Steve Jobs slid out of a manila envelope — was a low-volume proof of concept, machined with the port door cut into the side. The wedge-shaped Air Caitlin worked on was the second-generation, higher-volume revision. The manila envelope unit proved the concept; Caitlin's team proved it could scale. > *"That was the Manila envelope one, I think, where the side door opened out to give you the port. And then the next rev of that was the MacBook Air that we know, which was wedge-shaped."* ## [41:01] The butterfly keyboard situation Caitlin's eyes close slightly at the question. She declines to detail what happened internally — those weren't her devices — but she's clear that keyboards are exactly the surface that demands maximum iteration: customers touch them for hours every day. The modern MacBook keyboard is excellent. She leaves the gap between those two facts to speak for itself. > *"Obviously this is something that you've got to get right. The modern MacBook keyboards are awesome and excellent."* ## [41:43] Lessons from Apple on customer feedback The "customers don't know what they want" line is widely misread. Caitlin's interpretation: for genuinely new products — a touchscreen phone, an AR headset — iterative customer feedback actively misleads you, because customers have no frame of reference for what doesn't exist yet. Show it to them and they'll know immediately whether it's right. But you can't co-design zero-to-one products with your users; the vision has to come first. > *"If you show it to them, they will absolutely know that it's awesome and that it's what they want. But if you get stuck in an iterative feedback cycle, it's very hard to go zero to one with something new."* ## [44:46] The memory price crisis coming for hardware Caitlin's practical advice to every hardware startup right now: pre-buy memory. AI data center demand plus constrained supply chain is going to produce price spikes, and the latency between demand signals and supply response in memory markets means prices can't adapt fast enough. She thinks prices will roughly double. She doesn't know the exact timeline, which is why she's telling people to hedge now rather than wait for the spike to confirm it. > *"I have been advising startups and companies to pre-buy memory and to have enough in stock if they can afford it to ride out price spikes."* ## [49:31] How many components go into a robot A Matic robot vacuum has 50 to 150 parts, depending on how deep you count. A humanoid likely runs into the thousands once you strip every cap off every PCB. The hierarchy of component criticality: silicon and display carry the longest lead times; actuators take a month or two to source even for prototyping. Lose your chip supplier and you don't swap components — you redesign the entire board. Verticalization (Tesla, Starlink) is the only known defense. > *"You can't build anything if you have one component missing."* ## [52:53] When to use off-the-shelf vs. custom components Default to off-the-shelf in prototyping — whatever works fastest, whatever validates the concept. Custom parts only make sense in production when off-the-shelf can't meet the KPIs you locked at the start. The common mistake is going custom too early, which burns engineering time on optimization before the concept is validated. > *"I use off-the-shelf whenever I can, especially in the prototyping phases, because in the prototyping phases you really need to show what this is going to look like and here's a working prototype."* ## [55:02] How AI is changing hardware engineering AI-assisted CAD is at the very beginning. Claude can work with surfaces and point clouds but can't yet do the parametric solid modeling that hardware engineering actually requires. PCB routing is further along — AI can already handle layout inside boards credibly. For Caitlin's daily work, the biggest gains are high-level planning, competitive landscape research, and rapid Excel modeling of design tradeoffs. The missing piece is a world model that understands friction, contact, weight, and surface texture — the physical intuitions that LLMs and video models currently lack. > *"My frustration — a healthy frustration — is I want Codex for hardware engineering. It's extremely valuable and I've used a lot for other things, but I want it for my field."* ## [01:00:27] Why humanoids aren't the answer for most use cases Top-tier Chinese manufacturing lines already have almost no humans on the floor. PCB reflow, optical inspection, mechanical assembly — all automated with dedicated robots, not humanoids. Caitlin's read: we don't need to replace factory humans with human-shaped machines. We need more dedicated, task-specific robots with modular form factors. Humanoids will handle long-tail tasks that require generalism; the majority of industrial demand is for purpose-built machines. > *"We don't actually need to replace humans with humanoids. We just need more of these dedicated robots."* ## [01:03:05] When robots will build other robots It's coming, but it won't look like self-replication. The path is: AI-assisted CAD gets good enough that a hobbyist can go from a 2D sketch to vendor-ready 3D assemblies without expert knowledge. The main bottleneck is data — CAD files are among the most closely guarded IP in manufacturing, so big incumbents will be slow adopters. Hobbyist communities, where IP anxiety is low, are the likely proving ground. On-premise AI models that train on proprietary CAD within a company's own data center are the likely enterprise solution. > *"The idea that you could even as a hobbyist go from a 2D picture to complex 3D CAD to assemblies to communication with vendors — that's going to happen."* ## [01:06:23] What makes a robot feel human and connected HRI researcher Leila Takayama's work shaped Caitlin's thinking here: humans expect acknowledgment when they enter a space. A robot that ignores you is creepy; one that looks up is not. Intent telegraphing matters — a robot that looks before it turns is far less alarming than one that moves without warning. Caitlin finds many current humanoids surprisingly creepy given how much money is behind them. Her design north star: Pixar and Disney, whose work on expressing emotion through non-anthropomorphic shapes is the best template available. > *"You want these devices to be non-threatening, appear soft, reactive to you. Pixar, Disney are probably the world's best at doing this type of design work."* ## [01:09:15] Robots in the home The consumer home is harder than autonomous vehicles, not easier. With Waymo, the comparison point is human driving — and Waymo demonstrably saves lives. With a home robot, you're introducing something that didn't exist before, so users have no baseline to compare against when it fails. Trust has to be built from a much lower starting point. Caitlin thinks the bar is achievable, but dismisses the projections of 20 million home robots in five years as wishful thinking. > *"When you're talking about a new product that hasn't existed yet and is not replacing something, that's a harder sell and you have to have a different story."* ## [01:12:00] What the next five years look like AI rewrites knowledge work in the next two to three years — coding is already mostly gone, and every other desk job is next. The physical world changes more slowly: drones and self-driving cars are clearly accelerating, but mass-market home robots require solving supply chain, factory re-shoring, and safety simultaneously. Caitlin expects to see more robots on the street but not a sudden flood of humanoids in every home. > *"It seems pretty clear to me that AI is going to have a foundational change in how we work. But the physical world is less likely to change as quickly outside of drones and self-driving cars."* ## [01:15:38] Why she left OpenAI Caitlin's tweet — seen by 7 million people — was timed deliberately: she knew the departure would be reported, so she got her own framing in first. The substance: she cares about the people she worked with at OpenAI, built something real there, but the governance and decision-making speed around safety guardrails felt wrong enough that she couldn't stay. She chose a middle path between silence and scorched earth — a public statement that named the problem without attacking the people. > *"You can disagree with friends and feel like what they did isn't right. And that's where I ended up, and that's what I tweeted about."* ## [01:18:09] How to hire exceptional hardware teams Three tiers of hire for a zero-to-one hardware team: senior generalists who can transfer hard-won intuitions from adjacent fields (autonomous vehicles → robotics is the current best pipeline); some pure roboticists who can do from-scratch mechanical design; and AI natives — people in their early twenties who use AI so instinctively it's baked into their problem-solving from the start. Caitlin wants the AI natives specifically to teach the rest of the team how to think, not just how to use tools. Mission alignment shortens interviews. > *"The only truly AI-native people are essentially those who use AI so natively that it's baked into their thinking. They're approaching problem-solving completely differently."* ## [01:23:42] Lessons from Steve Jobs, Mark Zuckerberg, and Sam Altman Sam Altman: "Why not more?" — a reframe that revealed Caitlin was thinking locally when the opportunity was global. Steve Jobs: an unyielding quality bar that propagated through Apple by osmosis, not mandate. Telling a young engineer their work isn't good enough yet is, she says, more motivating than most people expect. Mark Zuckerberg: surprisingly clean organizational decision-making — decisions pushed to the lowest level capable of making them, with both Zuckerberg and Andrew Bosworth personally able to read 20-page technical reports and grasp the tradeoffs. > *"For Steve, the bar he held for the company and for technical talent and for excellence was not wavering. It was up here, and you were either going to meet it or you weren't."* ## [01:27:27] Failure corner Quest 1, hardware EVT, right before Christmas. Caitlin's team had reduced from five cameras to four for cost. Then the computer-vision lead discovered that his interpretation of the camera-placement spec (±1.5 mm global) and the mechanical team's interpretation (±0.15 mm) had diverged — and the wider tolerance made spatial tracking fail. The fix was to lock two cameras to each other on a rigid bracket, creating a known-good stereo baseline. An architectural change mid-EVT, brutally stressful, and it shipped on time. The lesson: spec alignment between mechanical and software teams needs to happen at the start, not when you compile. > *"It was a failure in understanding the spec. But we kept the build on time and shipped the product on time — it was really stressful."* ## [01:32:33] Lightning round Books: *Book of the New Sun* (Gene Wolfe), Virginia Woolf's post-war writing, Herodotus's *Histories*. Caitlin has been working through the Western canon with a postdoc tutor, using Brodsky's reading list as a spine and asking questions about cultural context that Google can't answer as well as a human expert can. Guilty pleasure: *Succession*, watched as a soap opera. Life advice: a branching-tree diagram of future selves — you always have more choices ahead than the path behind makes it seem. > *"You get to decide every day what you want to do. What matters is what's right in front of you."* ## Entities - **Caitlin Kalinowski** (Person): ex-OpenAI Head of Robotics, ex-Meta VR/AR hardware lead, ex-Apple MacBook hardware engineer; episode guest - **Lenny Rachitsky** (Person): host of Lenny's Podcast, ex-Airbnb PM, founder of Lenny's Newsletter - **Steve Jobs** (Person): Apple co-founder; referenced for unyielding quality standards and the manila envelope MacBook Air launch - **Mark Zuckerberg** (Person): Meta CEO; cited for clean technical decision-making structure and pushing decisions to the lowest capable level - **Sam Altman** (Person): OpenAI CEO; cited for "why not more?" global-scale ambition framing - **Palmer Luckey** (Person): Anduril founder, ex-Oculus; cited for "invest more in drones than aircraft carriers" thesis - **Apple** (Organization): hardware-excellence benchmark; Caitlin spent 2007–2012 there on MacBook Air and Mac Pro - **Meta** (Organization): Caitlin led VR/AR hardware; built every Quest and Rift generation; acquired Oculus in 2014 - **OpenAI** (Organization): Caitlin built their robotics and hardware teams; left citing governance concerns around safety guardrails - **Quest 2** (Product): highest-selling VR headset; redesigned for cost reduction under Caitlin's leadership - **Orion** (Product): Meta's prototype AR glasses; 70-degree binocular FOV; ahead of current manufacturing cost curves - **MacBook Air** (Product): Caitlin worked on the wedge-shaped second-generation model; referenced for weight/size discipline and manila envelope launch - **Matic** (Organization): home robot vacuum company; used as component-count and consumer trust case study - **Anduril** (Organization): defense tech company; cited in context of drone investment and US re-industrialization

De tweede Claude Code 101-video van Anthropic behandelt het schrijven van de eerste prompt: hoe te kiezen tussen goedkeuringsmodus en auto-accepteren, wanneer de planmodus in te gaan via shift+tab, en hoe een echte prompt eruitziet bij een live taak "donkere modus toevoegen". ## [00:03] Claude Code aanspreken zoals elke andere AI-assistent De openingsframing houdt de drempel bewust laag: een prompt sturen naar Claude Code verschilt niet van een vraag stellen aan een andere AI-assistent. Het idee is dat de beslissingen die je neemt vóór je op Enter drukt, je beschermen en het gereedschap prettiger maken in gebruik. > *You talk to Claude Code like you would talk to any AI assistant.* ## [00:15] Goedkeuringsmodus vs. auto-accepteren (shift+tab) Er zijn direct twee modi beschikbaar. In de standaard goedkeuringsmodus vraagt Claude toestemming vóór elke bestandswijziging. In de auto-acceptmodus worden bewerkingen en aanmaak van bestanden automatisch verwerkt, maar het uitvoeren van shell-opdrachten vereist nog steeds je toestemming. shift+tab wisselt tussen beide, zonder instellingen te hoeven opzoeken. De verteller weigert uitdrukkelijk een van beide "correct" te noemen; kies wat past bij jouw gewenste betrokkenheid. > *In auto accept mode, it will automatically approve an edit or creation of a file, but ask your permission to run commands.* ## [00:40] Planmodus: alleen-lezen onderzoek vóór het coderen In hetzelfde shift+tab-menu schuilt een derde modus: de planmodus. Claude neemt de prompt, gebruikt alleen-lezen gereedschappen om de codebase te doorzoeken, stelt verduidelijkingsvragen over onduidelijke punten en levert een uitgebreid plan voordat er ook maar één bestand wordt aangeraakt. Typische gevallen: meerstappige feature-implementaties en veilige codereviews — overal waar je de aanpak wilt beoordelen vóór de agent begint te schrijven. > *Plan mode takes your prompt and uses read-only tools to analyze your code base and do research on your suggested implementation.* ## [01:10] Live demo: prompt voor een donkere-modus schakelaar De demo is de kern van de video. Vanuit de projectroot shift+tab een paar keer naar de planmodus, dan een prompt schrijven die drie dingen tegelijk doet: het doel noemen ("donkere modus door de hele app"), de interface opgeven ("een schakelaar in de header") en een beperking toevoegen die Claude moet onderzoeken ("een goede contrastkleur vinden die past bij mijn bestaande lichte thema"). Doel plus interface plus beperking — het impliciete sjabloon voor een goede eerste prompt. > *Can you create a toggle switch on the header that allows user to toggle between light mode and dark mode?* ## [01:46] Terugkijken op wat Claude daadwerkelijk deed Nadat Claude zijn plan heeft teruggegeven en de gebruiker het heeft goedgekeurd, zit de waarde in de controleerbaarheid: je kunt expliciet zien wat Claude deed en hoe het tot het resultaat is gekomen. De verteller bekijkt de gerenderde donkere modus en geeft zijn goedkeuring — de impliciete les is dat "ziet er best goed uit" een acceptabele reviewlat is voor laagrisico UI-werk, zolang je echt hebt gekeken. > *At the end of all this, we can see explicitly what Claude did and how it came to its conclusion.* ## [02:09] Samenvatting: wees beschrijvend, gebruik de planmodus De afsluitende vuistregel: wees zo beschrijvend mogelijk in je prompt, en gebruik de planmodus wanneer je wilt dat Claude de details van je bedoeling grondig onderzoekt vóór het uitvoeren. De goedkeuringsmodus houdt je stap voor stap betrokken als dat je voorkeur heeft. > *When using Claude Code, try to be as descriptive as possible with your prompt.* ## Entities - **Anthropic Tutorial Narrator** (Person): De officiële voice-over verteller van Anthropic voor de Claude Code 101-tutorialserie. - **Claude Code** (Software): Anthropics agentische, op terminal gebaseerde codeerassistent, onderwerp van deze promptschrijfgids. - **Approval mode** (Concept): Standaardmodus waarbij Claude Code toestemming vraagt vóór elke bestandswijziging. - **Auto-accept mode** (Concept): Modus die bestandsbewerkingen en -aanmaak automatisch goedkeurt, maar shell-opdrachten nog steeds blokkeert. - **Plan mode** (Concept): Alleen-lezen onderzoeksmodus die een gedetailleerd plan produceert vóór het schrijven van code; ingeschakeld via shift+tab. - **shift+tab** (Shortcut): Toetsenbordsnelkoppeling die wisselt tussen de goedkeurings-, auto-accepteer- en planmodus van Claude Code.

Eric Jang spent his sabbatical rebuilding AlphaGo with modern tools, and the result is a two-and-a-half-hour technical walkthrough that doubles as a lens on how RL actually works—and why the naive policy-gradient approach baked into LLM training has fundamental limits that MCTS sidesteps. The conversation moves from Go rules through MCTS, neural architecture, self-play training, and off-policy data, before landing on what Jang observed running an automated AI research loop on his own project. ## [00:00] Basics of Go Go defeated brute-force search not by being solved but by being approximated. Jang explains what drew him to rebuild AlphaGo: the mystery of how a ten-layer network can amortize the cost of a game tree whose branching factor makes exhaustive search literally larger than the number of atoms in the universe. The early minutes cover the rules—territory control, liberties, captures, ko—and the Tromp-Taylor scoring convention that resolves ambiguous positions algorithmically rather than relying on human consensus. The scoring difference matters because it maps directly onto how computers must evaluate positions: a human glances at a surrounded group and accepts its fate, while a computer needs an unambiguous rule to count contested intersections at the end of a game. > *"When I saw the early breakthroughs on AlphaGo in 2014, 2015, 2016 and so forth, it was profound to see how smart AI systems could become and the computational complexity class they could tackle with deep learning."* ## [08:06] Monte Carlo Tree Search Rather than building out the full game tree (361 legal moves, 300-move games, search space exceeding the atom count of the universe), AlphaGo uses MCTS to interactively select which tree branches are worth expanding. The core data structure is a node per board state, storing a visit count and a Q value—the running average win rate across all rollouts through that node. The action-selection formula (PUCT) balances exploitation with exploration: a logarithmically growing bonus pushes the algorithm toward under-visited nodes, then decays as simulations accumulate and Q becomes reliable. Jang traces why this UCB-derived approach bounds regret, why Go's determinism means the probabilities in MCTS are artifacts of Monte Carlo averaging rather than genuine stochasticity, and how the search tree can be pruned by merging transposition-equivalent positions. > *"AlphaGo's core conceptual breakthrough was using neural nets to make this search problem tractable."* ## [31:53] What the neural network does Two networks replace two expensive operations inside MCTS. The value network maps a board state to a win-probability scalar, short-circuiting the need to roll out games to terminal states. The policy network outputs a distribution over legal moves, focusing the search tree toward promising children and away from the long tail of irrelevant ones. Jang tried both ResNets and transformers on his reimplementation. For the small-data regime of a personal GPU setup, ResNets outperformed transformers—transformers need global attention to connect far-apart board features, but they also need more data to learn local invariances. KataGo's key architectural insight was pooling global features explicitly through the residual stack so that battles on opposite sides of the 19x19 board could influence each other without requiring full attention. > *"For small data regimes, my experience is that ResNets still outperform transformers and give you more bang for the buck at lower budgets."* ## [01:00:22] Self-play Self-play is where AlphaGo bootstraps from knowing nothing to superhuman strength. After every game, MCTS produces a sharpened move distribution—more peaked than the raw policy network's prior—and that sharpened distribution becomes the training target for the policy head. The policy network is being distilled toward the MCTS output, which means each subsequent generation of games starts from a better prior and gets more improvement per search step. Jang frames this as test-time scaling with a compounding dividend: distilling 1,000 MCTS simulation steps into the policy network shifts the starting point of the next training round, so a second 1,000 steps buys a win rate that would have required 2,000+ steps without distillation. Crucially, every move in every game generates a supervision target—not just the winner—which is why the variance of the learning signal is vastly lower than naive policy-gradient approaches. > *"The beauty of how AlphaGo trains itself is that it can actually take this final search process—the outcome of the search process—and tell the policy network, 'Hey, instead of having MCTS do all this legwork to arrive here, why don't you just predict that from the get-go?'"* ## [01:25:27] Alternative RL approaches Jang constructs a careful thought experiment: what if you replaced the MCTS objective with the naive policy-gradient approach LLMs use—find the game winner and reinforce all moves from that game? In a league of 100 evenly-matched agents where one squeaks out a 51-49 record due to a single critical move, the training dataset is overwhelmingly diluted with moves that carry no signal. The one informative move is buried in roughly 30,000 irrelevant ones. This credit-assignment problem is the root of why advantage functions and baselines exist in RL. Subtracting a value baseline converts the raw return signal into an advantage—how much better than average each action actually was—and dramatically reduces gradient variance. Q-learning and TD methods approximate that advantage without needing full rollouts, which is why they matter for domains where MCTS is unavailable. > *"Importantly, what it is doing is saying: for every action we took, we did a pretty exhaustive search on MCTS to see if we could do better, and we're going to make every action that we took better by having the policy network predict that outcome instead."* ## [01:45:36] Why doesn't MCTS work for LLMs The PUCT exploration formula assumes a bounded, discrete action space and a value function that generalizes across positions. Go satisfies both. LLM reasoning satisfies neither: the token vocabulary is so large that you will almost never revisit the same partial sequence, and there is no position-level value function that reliably tells you whether a partially completed chain of thought is on track to solve the problem. Jang notes that LLMs do exhibit something that superficially resembles tree search—reconsidering, backtracking, hedging—but this emerges from in-context behavior rather than explicit tree construction. He leaves open the possibility that forward search could return in some form, particularly for domains like mathematics where intermediate states have a more rigid logical structure. The fundamental bottleneck is the absence of a trustworthy, query-efficient value function at the token level. > *"In an LLM, you're most likely never going to sample the same child more than once. If you have multiple steps of thinking, because language is so broad and open-ended, a discrete set of actions is not really an appropriate choice for an LLM."* ## [02:00:58] Off-policy training Dwarkesh raises a puzzle: every AI researcher warns against off-policy training, yet AlphaGo Zero runs fine with a large replay buffer full of games generated by older policy versions. Jang resolves this through the DAgger lens: what matters is not whether data is strictly on-policy, but whether the distribution of states in the buffer covers the states the current policy will actually visit, plus a reasonable neighborhood around them. The replay buffer works in AlphaGo because game states from recent checkpoints still lie near the current policy's distribution. The failure mode—labeling states so far from the current policy that the agent learns optimal actions for positions it will never reach—is a real risk in robotics, where distributional shift is severe. The practical recipe that emerged from systems like QT-Opt is to use off-policy data for reward shaping while keeping the policy gradient on-policy. > *"What you want in an algorithm like this is to have mostly states that you would visit, but then a small or reasonable percentage of states in this high-dimensional tube around your optimal trajectories."* ## [02:11:51] RL is even more information inefficient than you thought Dwarkesh lays out a two-dimensional inefficiency argument. The first dimension is the one everyone knows: policy-gradient RL requires full trajectory rollouts before any learning signal arrives, so as agents tackle longer-horizon tasks, samples per FLOP collapse. The second dimension is bits per sample. Early in training, an LLM with a 100K-token vocabulary that has to discover "blue" by random sampling needs on the order of 100K rollouts just to see one success—whereas supervised cross-entropy loss tells the model exactly how far its distribution was from "blue" on every step. MCTS escapes both problems. It produces a supervision target at every single move, and that target is strictly better than the current policy—not merely a binary win/loss signal smeared across thousands of tokens. Jang's observation: you are never in a situation where MCTS gives you zero signal, unless the policy has already converged to match the MCTS distribution exactly. > *"You're never in a situation where the MCTS is giving you no signal, unless your MCTS distribution converges to exactly what your policy network predicts."* ## [02:22:05] Automated AI researchers Jang ran much of his AlphaGo project through an automated LLM coding loop, giving a ground-level account of where AI research automation succeeds and where it still fails. On hyperparameter optimization, current models do genuine grad-student work: they diagnose gradient flow problems, rewrite data-loader augmentations, and squeeze measurable perplexity improvements on fixed budgets. On experiment execution and plotting, a simple skill description generates a full experimental suite with analysis. What the models cannot reliably do is lateral thinking—recognizing that a research track is structurally unpromising and jumping to a different framing before accumulating more dead-end experiments. Jang ran into this repeatedly: models would grind down a dead-end track rather than stepping back and asking whether the track was the right one. His thesis is that this is a training signal problem—building RL environments with the right outer loop, like Go, may be what eventually teaches models to escape local research dead ends. > *"What I find is that the current closed models the public can access today don't seem to be that great at selecting what the next experiment should be in a given track. They don't seem to be able to step back and do the lateral thinking of, 'Wait a minute, this track doesn't really make sense.'"* ## Entities - **Eric Jang** (Person): VP of AI at 1X Robotics; previously senior research scientist at Google Brain/DeepMind Robotics; rebuilt AlphaGo on sabbatical. - **Dwarkesh Patel** (Person): Host of the Dwarkesh Podcast; co-develops the bits-per-FLOP RL inefficiency analysis during the interview. - **AlphaGo / AlphaZero** (Software): DeepMind's Go-playing systems combining MCTS with deep neural networks; the technical centerpiece of the episode. - **KataGo** (Software): Open-source Go engine by David Wu (Jane Street) that achieved 40x compute reduction over AlphaGo Zero; Jang's primary reference implementation. - **Monte Carlo Tree Search (MCTS)** (Concept): Iterative search algorithm balancing exploitation and exploration via UCB/PUCT; the episode's central analytical lens. - **Credit assignment problem** (Concept): Difficulty in RL of determining which actions in a long trajectory caused a positive outcome; motivates advantage functions, baselines, and value networks. - **DAgger** (Concept): Dataset Aggregation algorithm; explains why replay buffers in AlphaGo are tolerable as long as buffer states stay near the current policy's distribution. - **Andrej Karpathy** (Person): Referenced for the phrase "sucking supervision through a straw" describing policy-gradient RL's sparse learning signal over long token trajectories.

Yann LeCun, Turing Award winner and founder of AMI Labs, lays out his case that LLMs are a productive dead-end — genuinely useful products, but structurally incapable of modeling physical reality, planning, or predicting the consequences of actions. He walks through the JEPA architecture as the alternative, explains the Tapestry federated-learning project for non-US/China AI sovereignty, and pulls back the curtain on why his time at Meta ended: the GenAI organization's short-term pressure gradually made breakthrough research politically untenable. His predicted timeline for the paradigm shift: early 2027. ## [00:00] Intro Jacob Effron opens with a quick-cut preview of the conversation — Yann joking about "five years, complete world domination," teasing his blunt take on his relationship with Meta's Llama program, and flagging how his views on unsupervised learning ultimately pointed away from LLMs. Jacob then frames the episode as a rare chance to hear from someone who both built foundational open-source LLMs and now argues, publicly and consistently, that scaling them further is the wrong bet. > *"The best way to get breakthrough research is you hire the best people. You get the hell out of the way."* ## [01:45] Why LLMs Aren't the Path to Intelligence Yann draws a sharp line between LLMs as products and LLMs as a path to intelligence. They work well precisely because language is special — a low-dimensional, discrete, highly structured substrate where autoregressive prediction is tractable. Reality is not like that. The physical world is high-dimensional, continuous, and chaotic: a robot picking up a mug, a self-driving car navigating a construction zone, a cell responding to a drug. These are not language problems, and architectures optimized for language cannot acquire the internal models needed to reason about them. His company, AMI (Advanced Machine Intelligence), is built on the counter-thesis: that the right path is systems which learn abstract world representations from raw sensory data — video, sensor feeds, industrial telemetry — and can plan by simulating the consequences of candidate actions inside those representations. > *"They're just not a path towards human level or human like intelligence or even animal-like intelligence. That's my claim. I'm not saying they're useless — I'm just saying they're not a path towards that."* ## [07:51] AMI and World Models "World model" has become a buzzword, Yann notes, and the field has split into two camps: generative approaches (video models, VLAs) and joint-embedding approaches like JEPA. He dismisses VLAs — vision-language-action models trained to produce robot actions — as already widely recognized failures: brittle, data-hungry, unable to generalize. The generative video approach has the same structural flaw as LLMs: it predicts every pixel rather than learning the abstract structure underneath. A world model, properly defined, is a system that lets an agent anticipate the consequences of its own actions before committing to them. Without that, any agentic system is operating blind — no ability to verify whether a planned sequence of actions will actually accomplish the goal. > *"I cannot imagine how you can even think of building an agentic system without that system having the ability to predict the consequences of its actions."* ## [12:07] The JEPA Architecture Explained The insight behind JEPA came from a pattern Yann noticed across years of self-supervised learning research: every architecture that successfully learned useful representations of images and video was non-generative. Generative architectures — VAEs, masked autoencoders, pixel-prediction models — consistently underperformed. JEPA takes a corrupted or partial view of an input, runs both versions through encoders, and trains a predictor to match representations — not raw pixels. That abstraction is the point. The 2022 "A Path Towards Autonomous Machine Intelligence" paper was his attempt to write down the full blueprint: JEPA as the perception backbone, objective-driven planning on top, and a hierarchical structure of world models at different time scales. He describes publishing it as "spilling all my secrets" — a deliberate bet that openness would rally more talent to the paradigm than secrecy would protect. > *"I've been really interested in that problem of learning models of the world by prediction for a very long time, and then had an epiphany about five years ago realizing that all of the architectures that have been successful to learn representations of images and videos are non-generative architectures and all the generative ones basically have been failures."* ## [15:55] Problems with Robotics Models Today Current robotics demos are impressive but trained with enormous volumes of imitation data — teleop recordings, hand-tracked demonstrations — and fine-tuned with RL mostly in simulation. That pipeline produces brittle specialists. A 17-year-old learns to drive in roughly 20 hours; we have millions of hours of driving footage and still no level-5 autonomous car. The gap between imitation learning and genuine generalization is the gap between memorizing examples and having an internal model of the world. Yann's claim for world-model-based systems is zero-shot task generalization: given a new goal, a system with an accurate internal world model can plan a sequence of actions to reach it without being explicitly trained on that task. The near-term industrial applications he's targeting — controlling jet engines, chemical plants, manufacturing lines — are settings where the inputs are already numerical and a world model can be trained directly from operational data. > *"The degree of generalization you would get with a world model based system is much much larger — a wider spectrum of tasks with less training data than a system trained with imitation learning."* ## [20:37] Silicon Valley Herd Behavior Yann's diagnosis of why the entire industry converged on scaling LLMs is structural: once you're behind, you can't afford to work on anything else. The competitive race creates a rational incentive for every major lab to dig the same trench. He founded AMI Labs in Paris specifically to escape this — the American office is in New York, not Silicon Valley — and raised no Silicon Valley VC money. His predicted timeline for the paradigm shift is early 2027. "World model" is already becoming a research buzzword; industry has recognized that VLAs failed; and the robotics sector's unsolved generalization problem is a forcing function. He doesn't claim AMI will have a full solution by then, but he expects it to be obvious to everyone by that point that a change of paradigm was necessary. > *"I think the realization that you need a change of paradigm is happening as we speak and will become completely obvious to people by early 2027."* ## [28:18] Tapestry: Sovereign AI for the Rest of the World Tapestry is a separate project from AMI, built around one observation: as smart glasses and AI assistants become the primary information interface, whoever controls the underlying model controls the information diet of billions of people. A farmer in India, a philosopher in Germany, a citizen in Morocco — none of them are well-served by a model whose training data, values, and political priors were set by a handful of people in California or Shenzhen. The solution is federated training: countries and institutions contribute data and compute, but never share raw data with one another. They share parameter vectors. Each contributor trains locally, periodically exchanges parameter updates, and pulls a running consensus model — a repository of all human knowledge that no single party controls. Countries from India to Kazakhstan to France have expressed interest, because AI sovereignty has become a political priority independent of any technology choice. > *"All of your information diet will be mediated by AI assistants, and if that AI assistant was built in California or Beijing, it's not good for you."* ## [35:49] OpenAI Is the Next Sun Microsystems Proprietary LLM providers have already exhausted publicly available text data. The remaining path — licensing copyrighted material or generating synthetic data — is expensive and bounded. Open-source models have been closing the gap without that constraint. Yann draws the analogy to the 1990s Unix workstation market: Sun Microsystems, HP, and SGI all had technically superior proprietary systems and compelling arguments for why you wouldn't run a web server on Windows NT — and were all wiped out by Linux. The entire internet now runs on Linux. OpenAI and Anthropic, he says, are the Sun Microsystems of this cycle. > *"Basically, OpenAI, Anthropic, etc. of today are the Sun Microsystems and HPUX of yesterday."* ## [40:51] Why Yann's Views Diverged from Hinton & Bengio The split happened in 2023. Yann's position didn't change — Hinton's and Bengio's did. Hinton encountered GPT-4 and concluded it was close to human-level intelligence, reasoning from a back-of-the-envelope calculation about cortical neuron counts. Yann thinks that argument is wrong and reads it as Hinton finding a justification to declare victory and retire from active research. Bengio's shift was different — more focused on societal risks from AI concentration of power — and Yann has more sympathy for that concern, even though he disagrees with the apocalyptic framing. > *"I do not believe in this claim at all. This is kind of Jeff's way of saying, okay, basically I can retire — I can declare victory."* ## [44:32] LLMs Are Intrinsically Unsafe Yann's strongest claim: LLMs cannot be made reliably safe, not because alignment is hard, but because the architecture is structurally incapable of predicting the consequences of its actions. There is no hardwired constraint ensuring a prompted LLM actually accomplishes the intended task; it accomplishes whatever its training conditioned it toward, and there is always a gap between training distribution and real-world prompts. Coding agents wiping hard drives, medical advice going wrong, agentic systems taking irreversible actions — these are not bugs to be patched but properties of the architecture. His alternative, objective-driven AI, works differently: the system has an explicit world model, an explicit cost function representing the goal, and a set of hard safety constraints. The optimizer finds a sequence of actions that satisfies all constraints and minimizes cost — meaning it literally cannot take an action that violates a safety constraint by construction. That guarantee is impossible with an LLM. He also disputes Anthropic's lobbying narrative on AI risk, arguing that real danger comes from bad actors using current systems, not emergent superintelligence, and that regulatory pressure primarily benefits incumbents. > *"LLMs are intrinsically unsafe. I don't think they can be made reliable and safe. They cannot be made reliable because you can't stop them from hallucinating."* ## [58:00] Why Yann Left Meta Yann corrects a widespread misconception: he had zero technical influence on Llama. Llama 1 was a small FAIR project; when GenAI was created in early 2023, the Llama team moved there and was placed under intense short-term product pressure. Two of the Llama 1 authors left to found Mistral. GenAI became conservative and increasingly publication-restricted. FAIR, meanwhile, was being redirected to support GenAI's LLM work rather than pursue the AMI research agenda that Yann, Zuckerberg, and the CTO had all originally backed. By early 2024, the environment was no longer conducive to breakthrough research. > *"Here's a big misconception about my role, my relation to Alex, and how AI was run at Meta."* ## [01:00:26] Reflections on FAIR Yann joined Facebook in late 2013 and ran FAIR for four and a half years before stepping down to become Chief AI Scientist — a deliberate move because, as he says, he is not a natural manager. The internal AMI project grew out of his 2022 vision paper, which Zuckerberg, the CTO, and the CPO all read and backed. But layers below leadership didn't see the point, and Meta's decision to shut down its entire robotics AI group — led by Gita Matarić, now at Amazon — made clear the company had no interest in the applications world models were built for. Publication restrictions tightened, good researchers left, and the mismatch between Yann's research agenda and Meta's product priorities became irreconcilable by early 2025. When he went to raise money for AMI, investors already knew his story from years of public talks and were primed to believe LLMs had fundamental limits. > *"The best way to get breakthrough research of the type we were getting in the early days of FAIR and at Bell Labs is you hire the best people — you give them the means to succeed and you get the hell out of the way."* ## [01:12:11] Advice for PhD Students Yann opens by reflecting that his prediction self-supervised learning would succeed for video was correct in its mechanism but wrong about where it first succeeded: LLMs are "a blindingly successful example of self-supervised learning," just applied to language rather than sensory data. He then gives the core technical challenge for JEPA: representation collapse. If you train a predictor to map one embedding to another, the trivially optimal solution is for both encoders to output a constant. Contrastive learning (his 1993 invention) prevents collapse but doesn't scale with dimension. Distillation methods like DINO work but for poorly understood reasons. His current best answer, SIGreg (Sketched Isotropic Gaussian Regularization), forces the encoder output distribution to be Gaussian, maximizing information content without negative pairs. He recommends the LeWorldModel paper — the first small-scale world model trained with this approach — as the single best entry point into where AMI Labs is headed. His advice to PhD students: don't work on LLMs — you can't contribute from academia without frontier compute, and studying why they work is descriptive science, not creative research. > *"An LLM works because when you have a sequence of discrete symbols, making predictions is easy. If you have the real world, you can't use a generative model — you have to train a system that learns a representation and makes predictions in the representation space."* ## Entities - **Yann LeCun** (Person): Turing Award 2018 co-winner; former Chief AI Scientist at Meta FAIR; founder of AMI Labs; professor at NYU; inventor of convolutional neural networks and co-creator of JEPA - **Jacob Effron** (Person): Partner at Redpoint Ventures; host of Unsupervised Learning podcast - **Geoffrey Hinton** (Person): Turing Award co-winner; reversed position on LLM capabilities after GPT-4; less vocal on AI dangers since 2024 - **Yoshua Bengio** (Person): Turing Award co-winner; focused on societal risks from AI concentration rather than emergent superintelligence - **JEPA** (Concept): Joint Embedding Predictive Architecture — predicts in representation space rather than pixel space; forms the perceptual backbone of Yann's world-model framework - **World Model** (Concept): Internal model enabling an agent to predict the consequences of its own actions before committing to them; prerequisite for safe agentic AI in Yann's framework - **Tapestry** (Concept): Federated LLM training project enabling countries and institutions to train a shared foundation model while retaining data sovereignty through parameter-vector exchange - **AMI Labs** (Organization): Yann's company (Advanced Machine Intelligence); headquartered in Paris, US office in New York; focused on JEPA-based world models for robotics, industrial control, and healthcare - **Meta FAIR** (Organization): Facebook AI Research; origin of Llama 1, I-JEPA, V-JEPA, and the AMI internal research program; increasingly redirected toward GenAI LLM support before Yann's departure

Salesforce CEO Marc Benioff joins Jason Calacanis, David Friedberg, and Chamath Palihapitiya (David Sacks absent) for a wide-ranging episode anchored by two real-time stories: the first Trump-Xi summit since 2017 and AI's accelerating assault on enterprise software valuations. Benioff — who has attended the Saudi state dinner, Windsor Castle, and this summit delegation — offers a front-row view of US-China commercial diplomacy, then turns to his own company's existential rerate, arguing Salesforce's data infrastructure and agent platform put it on the right side of AI disruption. The back half covers OpenAI's blowup with Apple, Thinking Machines' real-time multimodal demo, Friedberg's alarming El Niño data, and Anthropic's crackdown on layered SPV schemes. ## [00:00] Salesforce CEO Marc Benioff joins the show! Sacks is out this week, and Benioff fills the seat. Jason asks immediately about Benioff's political positioning — past Democratic donor, now attending Saudi state dinners and apparently welcome in the current administration. Benioff brushes off the partisan framing entirely. > *"I'm not a Democrat or Republican. I'm an American."* Chamath notes Benioff collected invites to Windsor Castle, Prince Charles's US visit, and the Saudi state dinner in quick succession — the rare tech CEO who moves across administrations without friction. The setup frames Benioff as an unusually credible voice on the summit unfolding in real time. ## [01:14] Trump-Xi summit, doing business in China as a US company, impact on Americans and the midterms Trump and Xi's seventh face-to-face meeting — delayed two months by the Iran war — opened in Beijing with Xi warning that mishandling Taiwan could put the entire relationship "in an extremely dangerous situation." Polymarket put the 2026 invasion probability at 6% on $23M in volume. On trade, Xi committed to buy soybeans, US LNG, and 200 Boeing jets, and called for a "wider door" on commerce. The US delegation reads like a corporate board: Jensen Huang selling chips, Kelly Ortberg selling planes, Brian Sykes of Cargill selling soybeans, Visa and Mastercard pushing for payment market access. Friedberg framed the summit through the Thucydides trap lens — as a rising power meets a declining power, conflict is historically likely — but argued that a resource-expansive moment, turbocharged by AI and biotech, offers a rare exit from that pattern. > *"It seems like in this moment when we are seeing these extraordinary technology shifts unlocked by AI and automation and biotech and all of these kind of moments of which could be true abundance ahead of us, it seems like the perfect moment to say maybe the world can be more multipolar."* Benioff confirmed Salesforce has zero offices or employees on the mainland — all China revenue flows through an exclusive Alibaba partnership to satisfy data residency law — and expects the summit to generate real order flow across the delegation. Chamath argued that China's top-down Confucian hierarchy makes CEO-level diplomacy more effective than bureaucratic channels, and that Americans who are feeling squeezed by inflation need the deal to work. ## [18:46] Taiwan, chips, AI models, and peace through trade Benioff pushed back on the premise that Taiwan is China's core priority, insisting economic prosperity and middle-class growth matter more to Xi than territorial ambition. On the direct question — should the US defend Taiwan if China blockades it? — he refused the binary: "I think China and Taiwan will reconcile." Chamath took a structural view: the US is roughly 1-2 nanometers away from domestic chip parity, at which point Taiwan's strategic value becomes economic rather than existential. > *"We are at a point where we're probably 1 to 2 nanometers away from being able to do what we need Taiwan to strategically do for us. Today it's economic and if you take that off the table, I think we'll have a very different attitude to Taiwan."* Chamath's prescription: sell the chips anyway, because letting Huawei win the semiconductor race is worse than letting Nvidia sell into China under KYC guardrails for model usage. Benioff agreed Chinese AI models are near-parity with US models despite chip restrictions, undercutting the case for an embargo. Friedberg added that as China builds domestic fabs and capital equipment, Taiwan's irreplaceability diminishes on its own timeline regardless of political outcomes. ## [31:41] AI's impact on software: What SaaS thrives, what SaaS dies? Jason laid out the rerate bluntly: Salesforce down 37%, ServiceNow down 42%, Workday down 45% — roughly $180 billion in combined market cap erased on the assumption that AI will make managed SaaS redundant. Benioff came out swinging. > *"It's not my first SaaS apocalypse, honestly, but it's the current SaaS apocalypse."* His argument: the market rerated on a false premise. Salesforce's bet is Agentforce — AI agents grounded in real enterprise data, not hallucination-prone generic models. The $8-9B Informatica acquisition provides the data harmonization layer that makes agents reliable: "The AI is very probabilistic — it needs to be locked down into the truth, into a single source of truth, or it just cannot work well." Benioff added that Salesforce will spend roughly $300M on Anthropic this year purely for internal coding agents, collapsing implementation cycles. Chamath split the market in two: the low end is finished — generic point solutions with no deep customer relationships are dead — but the high end, where Salesforce operates, is positioned to benefit from the ROI reckoning when public markets stop being "breathless about AI" and ask what $3 trillion in capex produced. The survivors will be those with C-suite relationships, negative churn, and the ability to package AI capability as measurable outcomes. ## [47:26] OpenAI is considering suing Apple over failed ChatGPT integration Bloomberg reported OpenAI may sue Apple for breach of contract: the 2024 ChatGPT-Siri deal collapsed in practice because Apple routes queries to ChatGPT only when users explicitly say "ChatGPT," never promoted the integration, and OpenAI never saw the subscriber revenue it expected. Apple's defense is privacy concerns over OpenAI's data practices. Benioff reframed the story as a strategic divergence among AI labs: Grok built companions and "sex bots," OpenAI pushed Sora and ad networks, Gemini shipped Nano, and Anthropic ignored all of it to focus on coding agents — and Anthropic turned out to be right. He teased unannounced Slack-native coding functionality. > *"Anthropic and they go we don't know about those sex bots and we don't know about Nano Banana but we're going to do coding agents. And it turned out Anthropic was right. And all of a sudden the rocket ship took off."* Chamath raised the deeper question: what happens to Apple if the AI interaction layer moves off the device entirely? He predicted an "iPhone moment" from an unexpected hardware player — a thin, always-on ambient device that makes the MacBook Pro irrelevant for AI inference. Friedberg noted Apple's current strategy is gap-filling rather than visionary, and that G Suite is quietly taking enterprise share from Apple's productivity stack. ## [56:54] Thinking Machines releases real-time model, future of consumer AI, multi-sensory models Mira Murati's Thinking Machines released a real-time multimodal model that watches your desktop, listens to ambient audio, and processes webcam input simultaneously at 200ms intervals across two parallel pipelines — one for deep retrospective reasoning, one for live response. Apple has simultaneously patented cameras inside AirPods. > *"Multi-sensory models are the next big wave for AI and then but we're still not at AGI at that point."* Benioff argued that LLMs trained on language are fundamentally limited: human cognition runs eyes, ears, and proprioception in parallel on biological hardware. Multi-sensory grounding is the missing layer. The token economics are dramatic — real-time ambient monitoring at 8 hours per user per day would be 1000x current enterprise consumption. Benioff pushed back on the "bigger model = better" arms race, predicting distributed intelligence embedded in apps and devices will matter more than raw model scale, and flagging space for a "hot new company" that aggregates ambient sensing with enterprise context. ## [62:24] Science Corner: Impacts of a historically strong El Nino in 2026 Friedberg presented ocean temperature anomaly data showing sea surface temperatures headed for the largest deviation from normal since 1877 — roughly 4°C above baseline. The stored thermal energy: 11 million terawatt-hours, against global annual human consumption of 25,000 terawatt-hours. > *"That's 500 years worth of human energy in this ocean. And over the next few months, that energy is going to be released into the atmosphere — and that will, with 99% confidence, make the upcoming year the hottest year on record by far."* The cascade: altered trade winds drive atmospheric rivers into California and the Gulf Coast; heat domes extend over Phoenix and interior Canada; Indian monsoons fail at high probability, threatening 150 million farmers and 1.5 billion food-dependent people; Brazil's crop exports to Indonesia and the Philippines collapse; wheat prices spike globally. Phoenix was already at 106°F in May. Commodity markets are actively trading El Niño exposure. Friedberg's partial upside: crop genetics have improved drought resilience, and Siberian farmland is expanding — but those gains don't rescue the 2026 harvest window. ## [71:40] Anthropic goes after "Dark SPVs" Anthropic formally called out platforms selling multi-layered SPVs to retail investors — the "dentists getting charged 10% loading fees" model — and stated it will negate shares sold through unauthorized structures. Chamath gave full-throated support: every pre-IPO company should follow suit, push toward public markets, and let these structures die. > *"Once SpaceX goes public, once Anthropic goes public, once OpenAI goes public, you're going to see a litany of these lawsuits back and forth between the purveyors of these SPVs — they should not be allowed."* Chamath predicted a wave of legal fallout once the major AI companies go public and retail SPV investors discover the math doesn't work. The chapter closes with Benioff discussing Salesforce's 1-1-1 philanthropy model — 1% equity, 1% profit, 1% employee time at founding, now running 50,000 nonprofits free on the platform — and a moving remembrance of Susan Wojcicki. ## Entities - **Marc Benioff** (Person): Chair and CEO of Salesforce; guest on this episode; architect of the 1-1-1 philanthropy model and Agentforce AI agent platform - **David Friedberg** (Person): Host; CEO of The Production Board; delivered the El Niño science corner - **Chamath Palihapitiya** (Person): Host; CEO of Social Capital; made the case for Salesforce's high-end SaaS survival and Nvidia chip proliferation - **Salesforce / Agentforce** (Software): Enterprise CRM and agent platform; Benioff's bet that data-grounded AI agents are the opposite of a SaaS death sentence - **Anthropic** (Organization): AI safety company; Benioff's preferred coding agent provider (~$300M planned spend at Salesforce); also cracking down on unauthorized SPV structures - **OpenAI** (Organization): Reportedly considering lawsuit against Apple over failed ChatGPT-Siri integration; pivoting toward coding agents following Anthropic's success - **Thinking Machines / Mira Murati** (Organization): Released a real-time ambient multimodal model processing desktop, audio, and webcam simultaneously at 200ms intervals - **Thucydides Trap** (Concept): Political science framework (rising vs. declining power conflict cycle) invoked by Friedberg to frame the US-China summit opportunity for cooperative abundance - **Dark SPVs** (Concept): Multi-layered special purpose vehicles selling pre-IPO equity in private AI companies to retail investors, often with high fees and disputed legal standing

De tweede aflevering van Anthropics Claude Code 101 opent de motorkap: de agentlus die context verzamelt, actie onderneemt en resultaten verifieert; hoe het contextvenster zichzelf comprimeert voordat het overloopt; wat tools daadwerkelijk bieden ten opzichte van tekst in en tekst uit; en de vier machtigingsmodi die je met shift+tab omschakelt. ## [00:04] Openingsvraag: hoe verschilt het van een chatapp De verteller koppelt de rest van de video aan één vraag: Claude Code is geen chatapp, dus wat is de aard van dit ding? Het antwoord dat ze gaan uitpakken is de agentlus. > *We know that Claude code is different from usual chat applications, but how does it work?* ## [00:13] De agentlus — verzamelen, handelen, verifiëren, herhalen De lus heeft vier slagen. Je voert een prompt in. Claude verzamelt de benodigde context door met het model te communiceren, dat tekst of een toolaanroep teruggeeft. Claude voert de actie uit: een bestand bewerken, een commando uitvoeren. Vervolgens verifieert het of het resultaat de prompt daadwerkelijk vervult. Slaagt het, dan stopt het; mislukt het, dan herhaalt de lus totdat het werk compleet en verifieerbaar is. De gebruiker wordt hierbij niet buitengesloten: je kunt context toevoegen, onderbreken of het model naar het einddoel sturen terwijl de lus loopt. > *And if they don't, Claude goes back and runs the loop again until the results are complete and verifiable.* ## [01:02] Het contextvenster en automatische compressie Het contextvenster is Claudes werkgeheugen: de conversatie, bestandsinhoud, commandouitvoer, alles waarop het kan terugkijken. Het is begrensd. Wanneer het plafond wordt bereikt, comprimeert Claude Code de conversatie op eigen initiatief: het bepaalt wat verwijderd kan worden en wat samengevat kan worden, zodat het venster daalt zonder de rode draad te verliezen. > *Once you reach that limit, Claude code compacts your conversation, which automatically determines what it can take out of the context window and what it can summarize in order to bring the context window back down.* ## [01:26] Tools — semantische dispatching voor het lezen van bestanden, uitvoeren van code en zoeken op het web De meeste AI-assistenten zijn tekst in, tekst uit, zonder iets daartussen. Tools veranderen dat: ze stellen de agent in staat te beslissen wanneer het code moet uitvoeren om het doel te bereiken. Een bestand lezen, op het web zoeken, een shell-commando uitvoeren. Claude Code gebruikt semantisch zoeken over de beschikbare tools om te kiezen welke aan te roepen en de uitvoer te verwerken. > *Tools let Claude code and other agents determine when to execute code to get closer to a task.* ## [01:52] Machtigingsmodi en de kosten van het overslaan ervan Standaard vraagt Claude Code om bevestiging voordat het een bestand bewerkt of een shell-commando uitvoert. Shift+tab doorloopt alternatieven: **bewerkingen automatisch accepteren** schrijft bestanden zonder te vragen maar vraagt nog steeds voor commando's; **planmodus** beperkt Claude tot alleen-lezen tools zodat het een actieplan kan opstellen voordat het iets aanraakt. De verteller wijst op de voor de hand liggende afweging: de agent vrij spel geven betekent dat een fout moeilijker te onderscheppen is voordat het gebeurt. > *Giving Claude code free reign to run commands means a mistake could be harder to catch before even happens.* ## [02:28] Samenvatting — wat het onderscheidt van een chatvenster Vier primitieven samengesteld tot een terminal: een agentlus, een beheerd contextvenster, tools en configureerbare machtigingen. De combinatie — de codebase lezen, erop handelen, het eigen werk verifiëren — is wat Claude Code onderscheidt van een chatvenster. > *It can read your code base, take action, and verify its own work, and that makes it fundamentally different from a chat window.* ## Entiteiten - **Anthropic Tutorial Narrator** (Person): De officiële voice-over verteller van Anthropic voor de Claude Code 101 tutorialserie. - **Claude Code** (Software): Anthropics agentische terminal-codeerassistent, gebouwd rond de vier primitieven die in deze aflevering worden uitgelegd. - **Agentic loop** (Concept): De verzamel-context, handel, verifieer, herhaal-cyclus die elke Claude Code-sessie aandrijft. - **Context window** (Concept): Claudes begrensde werkgeheugen met de conversatie, bestandsinhoud en commandouitvoer; automatisch gecomprimeerd bij overloop. - **Tools** (Concept): De neveneffecten die de agent kan aanroepen: bestand lezen, op het web zoeken, commando uitvoeren, geselecteerd via semantisch zoeken over de toolcatalogus. - **Permission modes** (Concept): Standaard (vragen), bewerkingen automatisch accepteren en planmodus (alleen-lezen), omgeschakeld met shift+tab. - **Plan mode** (Feature): Een alleen-lezen machtigingsmodus waarmee Claude een actieplan kan opstellen voor elke mutatie.

De officiële installatiegids voor Claude Code. De verteller van Anthropic loopt door de één-regel-installers voor elk ondersteund platform — terminal, VS Code, JetBrains, Claude Desktop en het web — en sluit af met een eenvoudige vuistregel voor het kiezen van de juiste optie. ## [00:04] Één-regel-installers voor de terminal (macOS, Linux, WSL, Windows) Het standaardpad is de terminal. Gebruikers van macOS, Linux en WSL krijgen één `curl`-opdracht; Homebrew werkt ook maar ondersteunt geen automatische updates. Op Windows gebruikt PowerShell `Invoke-RestMethod`, CMD heeft een eigen `curl`-fragment, en `winget` is beschikbaar met dezelfde beperking voor automatische updates als Homebrew. > *If you're on macOS, Linux, or WSL, use this curl command to install it in one go. If you prefer to use Homebrew, you can also use brew install to install it, but note that this doesn't have auto-update capabilities.* ## [00:33] claude uitvoeren in je project en inloggen Na de installatie ga je met `cd` naar je project en voer je `claude` uit. Bij de eerste start verschijnt een kleurthemakiezer en een inlogflow die een Pro-, Max-, Enterprise- of API-sleutelaanmelding accepteert. Enterprise-accounts moeten die optie expliciet selecteren. De map van waaruit je start bepaalt de toegangsgrens — Claude Code ziet die map en alles eronder, niets erboven. > *Whatever directory you decide to run cloud in, it will have access to that directory and all of its subfolders.* ## [01:02] VS Code-extensie Open het extensiepaneel, zoek naar de Claude Code-extensie van Anthropic en bevestig het blauwe verificatievinkje voordat je installeert. Een herstart kan nodig zijn. Na de installatie opent het opdrachtenpalet (`Ctrl/Cmd+Shift+P`) een nieuw Claude Code-tabblad; je kunt ook op het logo klikken vanuit een geopend bestand, of de GUI volledig uitschakelen en alleen de terminalervaring gebruiken via de instellingen. > *You can also opt out of the UI and just use the terminal experience directly in your settings file.* ## [01:32] JetBrains-plugin Zelfde werkwijze als bij VS Code: installeer de Claude Code-plugin uit de JetBrains Marketplace, herstart de IDE en het Claude-logo verschijnt bij heropstart. Klikken opent een zijpaneel dat de terminalervaring naast je editor toont. > *For JetBrains IDEs, you can install the Cloud Code plugin from the JetBrains Marketplace. Once you install, restart your IDE.* ## [01:51] Claude Desktop en claude.ai/code op het web Claude Desktop biedt Claude Code aan via een "code"-schakelaar bovenaan de app zodra je bent ingelogd — dezelfde chatachtige interface, maar beperkt tot een specifieke map met aanpasbare rechten en zelfs een clouduitvoeringsmodus. De webversie staat op `claude.ai/code` en weerspiegelt de desktopervaring, met één harde beperking: het werkt alleen met GitHub-repositories. > *On the web, you can access Claude code by going to claude.ai/code. This works very similar to the desktop app. However, you're restricted to GitHub repositories only.* ## [02:27] De juiste omgeving kiezen De vuistregel van de verteller: terminal eerst als je nieuwe functies wilt zodra ze uitkomen. IDE-integraties bieden vrijwel dezelfde ervaring in je editor. Desktop is de keuze als je Claude op de achtergrond wilt laten werken terwijl je iets anders doet. Het web is voor werken op afstand aan GitHub-repositories of voor het gelijktijdig uitvoeren van meerdere sessies. > *If you want to constantly keep up to date with everything, the terminal is the best bet. Features ship there the fastest.* ## Entities - **Anthropic Tutorial Narrator** (Person): Voice-over host van de Claude Code 101-cursus van Anthropic. - **Claude Code** (Software): Anthropics agentische coderingstool, te installeren via terminal, IDEs, desktop en web. - **Homebrew / winget** (Software): Pakketbeheerinstallatiepaden als alternatief voor de officiële curl/PowerShell-installers — beide zonder automatische updates. - **VS Code extension** (Software): Door Anthropic gepubliceerde Claude Code-extensie; controleer het blauwe vinkje voor de installatie. - **JetBrains plugin** (Software): Claude Code-plugin verspreid via de JetBrains Marketplace; opent een zijpaneel na herstart van de IDE. - **Claude Desktop** (Software): Desktopapp die Claude Code aanbiedt via een "code"-schakelaar, met mapbeperking en clouduitvoeringsmodus. - **claude.ai/code** (Service): Webversie van Claude Code, beperkt tot GitHub-gehoste repositories.