LaiDub

ポッドキャスト

GitHub's Agent Era: 14x Commits, 200M Developers, Copilot's Next Act — Kyle Daigle
1:24:44
EN/ZH
2 ヶ国語で視聴
Latent Space1日前

GitHub's Agent Era: 14x Commits, 200M Developers, Copilot's Next Act — Kyle Daigle

GitHub COO Kyle Daigle joins swyx to map what the agent era looks like from inside the platform hosting 200 million developers and now processing commits at 14x last year's pace. Across 84 minutes they cover how Kyle runs GitHub with AI-driven micro-skills and WorkIQ MCP, why former developers in leadership have an unusual edge right now, the full arc of GitHub's platform history from webhooks to Actions to Copilot, and where trust in agent-generated code ultimately has to come from. The conversation is grounded throughout in Kyle's own weekend and executive workflows: building AI-generated revenue presentations, running 15 simultaneous agents on a Saturday, and describing what "ambient AI" would actually need to do before it becomes genuinely useful. ## [00:00] Hook Kyle opens mid-sentence, already deep in his argument: people who detoured into other careers before coding, and came back armed with cross-domain knowledge, are uniquely positioned in the AI era. Running 15 agents on a Saturday while his kids are at lacrosse is not just a productivity flex — it recreates the feeling of creation that got him into software in the first place. > *"I can crank up 15 agents on Saturday, you know, while my kids are doing lacrosse. That's like really powerful and I think it gets me back to that feeling of like creation."* ## [01:21] Introduction Kyle's title is COO of GitHub, but he recently took on CMO of Developer for Microsoft as well — meaning every developer-facing product and communication across the broader Microsoft ecosystem now runs through him. He's been at GitHub for 13 years, joined as a developer, personally built webhooks and the platform/API layer, ran engineering until 2018, then moved into the operational and business side. The dual COO/CMO role is unusual; Kyle frames it as the same job with a larger surface area: tell the truth, be authentic, let the products speak. > *"I built webhooks and worked with teams building the API, built the platform layer, anything that integrated with GitHub, up until really 2018 I built or ran the engineering teams."* ## [04:57] Why AI Got Kyle Coding Again Swyx points out that Kyle's commit graph shows a clear dip through his leadership years and a sharp uptick recently — entirely driven by AI. Kyle is not writing features for GitHub's product; he's building internal agents and workflow tools that stitch together disparate data sources. His primary use case is retrospective: using WorkIQ, MCP servers, Slack, Teams transcripts, and Obsidian notes to ask "what actually happened last week, what worked, and what should I tweak for the next few days." He finds LLMs are exceptionally good at pattern-finding across a week of context, far more so than generating forward-looking plans from scratch. > *"I find AI in like what most of this launch here is actually like less building forward. It's actually like a recursive loop backwards. I'm always looking at what had happened first."* ## [08:25] Running GitHub with AI: WorkIQ, MCP, Slack, Teams, and Skills GitHub rolled out AI internally by meeting people where they already work — Slack, Teams, email — rather than forcing them onto a new tool. Every employee, technical or not, gets the Copilot CLI plus a shared set of atomic micro-skills deposited into repos. The era of the "mega-skill" that handles an entire workflow end-to-end is over; what works are tiny, single-purpose skills that do one thing well and compose cleanly. Kyle uses Postel's Law as a design principle: liberal in what each skill accepts, strict in what it outputs. WorkIQ, the M365 MCP server, lets anyone ask backward-facing questions across every meeting, email, and chat — critical for a fully remote, globally distributed team. > *"We're ending the era of these like massive beautiful perfect skills. What we found is these incredibly micro skills that are just doing one thing for us very very well versus a skill that's going to do that full report that doesn't really exist on our side anymore."* ## [17:00] The Golden Age for Former Developers in Leadership Swyx asks whether people like Kyle — technical backgrounds, now in exec roles — have a structural advantage in the AI era. Kyle's answer: pattern-finding and problem-solving are the durable skills from his developer years, and AI has given him back the ability to apply them directly in code. The more interesting case isn't developers going back to update old side projects; it's people who spent ten-plus years accumulating business knowledge now using that context as leverage when wielding AI tools. The cross-domain background, once a liability in pure engineering orgs, is now a multiplier. > *"I just find that the folks that came from a different career, went to school for something else, went off and did this random thing and then became a software dev — now having the power of an AI where I can crank up 15 agents on Saturday."* ## [18:52] 15 Agents on Saturday and AI-Generated Executive Work Kyle built GitHub's annual revenue planning presentation entirely with AI — a SQLite app to view the data, skills pulling from Obsidian notes and work context, and a deliberate skill that made the output look "humanly bad" so it wouldn't read as AI-generated. He presented it to the CRO and CFO teams without disclosing the process; nobody asked. His point isn't to hide AI from colleagues but to demonstrate that value is in crafting and judgment, not slide assembly. The ability to build a small data-manipulation app and control the final output is, specifically, the advantage that developers carry into leadership. > *"I ultimately built this entire presentation without touching any of it. And I was like, okay, I'm just going to present this to our CRO, the CFO, their teams without mentioning I built it with AI. Never came up once."* ## [21:41] How AI Changes the Chief of Staff Role Kyle still has a chief of staff — but the job has shifted. Slide prep and presentation assembly have moved to AI; what remains irreplaceable is the human connective tissue: knowing which people in which cities should meet, surfacing relationship opportunities across a distributed org, brokering conversations that don't appear in any MCP server. The analogy is email replacing letter-opening: nobody expects the chief of staff to open physical mail anymore, and soon nobody will expect them to build decks either. The judgment about *who* should talk to *whom* is what stays. > *"I still have a chief of staff because the difference is the human connection aspects — I should be meeting with this group and this team and they have an opportunity and I'm going to be in San Francisco today."* ## [23:06] GitHub's History: Actions, npm, Webhooks, and Open Source Kyle walked the platform's architectural history: GitHub Services (pre-2014 arbitrary Ruby execution with no real containerization), webhooks, Pages, and then Actions — launched by Kyle personally at GitHub Universe in October 2018. Actions went from "we should not be running arbitrary Ruby on people's behalf" to a fully containerized compute layer now using Azure Dev Compute for fast, small-VM agent spin-ups. The npm acquisition came from a simple premise: npm was powering the internet and having scaling problems; GitHub's job was to keep it running and raise its security posture. Every security improvement — 2FA enforcement, token invalidation on exposure — breaks something downstream, and that balance between hardening a 15-year-old ecosystem and not causing developer snow days remains the central tension. > *"We have changed the 2FA policies, we've changed the way the tokens work. When we find tokens that have been exposed or potentially exposed, we invalidate them. That creates issues. But we're trying to push the community forward."* ## [30:06] Slop Forks, Vendoring, and AI Dependency Management Swyx raises the "slop fork" pattern — AI-assisted vendoring where you pull in only the source you need rather than importing a whole package — and asks whether it sidesteps npm's vulnerability surface. Kyle: vendoring was how everyone worked in 2013, and there's something true about pulling in only what you need, but it doesn't fix the fundamental problem. An agent evaluating code can be convinced it's secure just as easily as a human can. Static analysis and runtime testing still need investment regardless of package scope. GitHub's historical stance — wait for community RFC and social consensus before cementing a practice — means they won't push a single vendoring standard, but will build tools for maintainers to enforce their own trust rules. > *"The vulnerabilities — in an agent looking at them there's time and time again a million different ways in which we can convince an agent that this thing is like secure or not."* ## [35:18] Pull Requests, Prompt Requests, and Trust in Agent-Generated Code GitHub invented the pull request as a social trust mechanism, and now agents are generating the majority of PRs on many projects. Kyle assessed various alternatives — Peter Coppola's "prompt request" model, Thomas Dohmke's contribution-asset approach — but argues that none fully solve the underlying problem: trust is social, not technical. Even if a PR is 100% verified by static analysis, humans still reach for human signals (does Mitchell approve it?) before merging. GitHub's current direction centers on giving maintainers malleable tools to define their own trust heuristics rather than imposing a universal standard, because any single standard immediately becomes a gamification target. The endgame is something closer to human digital identity. > *"The reason why there's not a single answer is ultimately we're trying to codify trust. Right now when an agent writes code and another agent reviews code and then Kyle goes and looks at it, the trust is kind of diffuse."* ## [42:42] GitHub Stars, 200M+ Developers, and the New AI Builder Wave GitHub crossed 200 million accounts — up from 80 million not long ago. The rapid star accumulation on new AI projects is mostly genuine: an entire new cohort who built their first app in the AI era is swarming the zeitgeist. Kyle refuses to split hairs about who "counts" as a developer, drawing on his own experience being called a fraud for having a GitHub account before he knew what git was. The gamification problem is real (whack-a-mole anti-abuse, now AI-powered), but the majority of the star velocity is new builders who want to participate in the moment the way Kyle wanted to participate in the Ruby era. > *"It's not just developers. It's folks that have maybe started coding or only joined in since the AI era. And those projects are going up because you want to be a part of this moment."* ## [46:36] GitHub Spark, Low-Code, and Why GitHub Still Shows the Code GitHub experimented with Spark as an easy app-build-and-run experience. The lesson: for developers, the value was always simple runtime, not a UI veneer hiding the code. GitHub's architectural principle is non-negotiable — they will always show you the code. The broader goal Kyle articulates is lowering the barrier to that first "I had an idea and I built it" moment: anyone should be able to swap a light switch without needing to open the breaker box. > *"Anytime we try to put a veneer on top of something, we still always show you the code. That's kind of like a tenant. We're never gonna hide the code from you ever."* ## [48:59] GitHub's Hardest Era: 14x Growth, Reliability, and Scale GitHub went from 1 billion commits in all of 2025 to 275 million per week in April 2026 — a 14x year-on-year rate still accelerating. This broke things in new ways: not the old webhooks reliability problems (those were fixed and rewrote), but novel permission-layer failures only visible at cross-object scale. The core pain point is MySQL 1, a monolithic permissions database GitHub has been decomposing for years; permissioning is where most cross-cutting outages originate. Simultaneously, the industry is shifting back toward monorepos, which carry unique git infrastructure performance characteristics. Kyle frames the scaling problem as "diagonal" — vertical and horizontal both stop working, so you crack open services running unchanged for 10-15 years and rewrite them. > *"We're doing more in a month than we did in a year last year. By roughly every measure, there's growth that is much much bigger. And that is breaking our system in new ways, not old ways."* ## [60:42] Actions as the Compute Layer for CI/CD and Automation Actions has evolved well beyond CI/CD into a general-purpose automation compute layer — the root of significant availability pressure because every agent task and agentic workflow translates into more builds and more CPU. GitHub is expanding compute through both its own data centers and Azure cloud, and is using Azure Dev Compute (fast small-VM spin-up) under the hood for containerized agent execution. The path to fewer outages is a step-change model: large foundational infrastructure fixes that take time, then visible plateau improvements in availability rather than incremental noise reduction. > *"Actions is the core compute layer for either CI or side project. More tools, more agents, more PRs mean more builds. More builds need more CPUs and we simply need more CPUs."* ## [63:25] The State and Future of GitHub Copilot Copilot's history: launched as code completion, then shifted energy toward fine-tuning as the industry demanded better accuracy, and then next-gen models arrived and made fine-tuning less critical — creating confusion about where Copilot was going. The current architecture unifies a single SDK and agent harness across code completion, the new CLI, the new desktop app, and cloud agents. The future Kyle describes covers the full SDLC: security remediation, issue triage, documentation drift detection — not just writing code. The remaining hard problem is context and memory: getting GitHub to "act like Kyle wants it to act" across all his dependencies, preferences, and team context. > *"What we think is that it's not solely about the code generation. It's really about having the ability to use these coding agent brained harnesses across not just the coding experience but also security remediation, every GitHub issue that comes in."* ## [69:45] Ambient AI, Background Agents, and the Future of the SDLC Kyle argues the industry is still stuck in a "hyper-myopic" frame where coding agents only know about code. What he actually wants is ambient AI that carries every spec doc, every email thread, every conversation, every Obsidian note into its decision-making as a developer — not as a recall tool you query, but as persistent background context that shapes implementation choices in real time. OpenClaw interests him precisely because it connects personal context to agent action; but the missing piece is making that context available *during* software development. The extreme version — AI that proactively directs you rather than waiting to be asked — is the inversion of control that both excites and slightly alarms him. > *"The most interesting thing to me in AI is actual ambient AI. I'm looking to be implementing a new feature and for it to know every spec doc, every email, the conversations that I've had online, everything about how this could be implemented and be able to use that as part of its decision-making."* ## [74:30] OpenClaw, Enterprise Security, and the New OS for Agents Microsoft has a CVP dedicated to OpenClaw — unusual given Microsoft doesn't own Anthropic. Kyle explains: OpenClaw demonstrated what a valuable personal agent actually looks like (full personal context, computer use, not just chat), and Microsoft's job is to make that work in enterprise — OS-level sandboxing on Windows so you can run an agent on a work device without it becoming a security incident. The framing Kyle reaches for: Microsoft is the original operating systems company, and agents need a new OS layer. Workloads have changed so fundamentally that the right question is no longer "do we need more inference?" but "what type of compute do we need to run these agentic flows?" — all the way down to silicon. > *"Microsoft is the original operating systems company and here's the new operating system for AI. Operating systems need to look different than they looked five years ago because it's not just you using them anymore."* ## [79:24] Build Announcements, WorkIQ, FoundryIQ, and Microsoft Context Kyle previews what GitHub and Microsoft are announcing at Build: WorkIQ (M365 context engine via MCP, powerful for retrospective questioning across all work assets) and FoundryIQ (same intelligence layer that connects to existing data stores without requiring migration). The pitch for enterprise developers: "how I build on the weekend should be how I build at work" — but Fortune 500 companies can't just vibe-code and ship; security and compliance gates have to move as fast as development does. WorkIQ and FoundryIQ are the attempt to bring weekend-level agility into the enterprise context layer, with the governance that lets it survive in large organizations. > *"Work IQ, Foundry IQ — these context engines are wild good and we've given them to our developers at GitHub. You can ask questions around everything in your work context and it's surprisingly powerful."* ## [83:02] What Should swyx Ask Satya? swyx is about to interview Satya Nadella at Build and asks Kyle what to ask. Kyle's recommendation: challenge Satya on what he believes is demonstrably true about the AI and inference landscape in two to three years — not as a throwaway futurist question, but as a direct test of the internal bets Microsoft is making right now. Significant external skepticism exists about Microsoft's AI approach, and a straight answer from Satya would be both a genuine stress test and a reassuring signal for the developer community. > *"The best question to ask is what he thinks is true in like two or three years from now. The way that he is looking at this AI problem, the inference problem, the token problem — why is this approach in two years going to pay off?"* ## Entities - **Kyle Daigle** (Person): COO of GitHub and CMO of Developer for Microsoft; 13-year GitHub veteran who built the original webhooks and platform API layer. - **swyx** (Person): Host of Latent Space podcast; developer-advocate-turned-podcaster who conducted this interview at Microsoft Build 2026. - **GitHub Copilot** (Software): GitHub's AI coding assistant, now spanning code completion, CLI, desktop app, and cloud agents under a unified SDK. - **WorkIQ** (Software): Microsoft 365 MCP server that gives employees a context engine over all work assets (Teams, email, calendar, etc.). - **FoundryIQ** (Software): M365 intelligence layer that connects to existing enterprise data stores without requiring migration. - **GitHub Actions** (Software): GitHub's general-purpose compute and CI/CD automation layer; primary source of CPU demand growth from agent workloads. - **OpenClaw** (Software): Anthropic's Claude Code agentic tool; referenced as a model for what a personal AI agent with full context and computer use looks like. - **npm** (Software): JavaScript package registry acquired by GitHub; central to supply-chain security discussions about vendoring, slop forks, and dependency trust. - **Mitch Hashimoto** (Person): Co-founder of HashiCorp, active open-source maintainer; discussed in context of vendoring approaches and GitHub's maintainer relationship model. - **Thomas Dohmke** (Person): CEO of GitHub; referenced in context of PR workflow evolution. - **Microsoft Build** (Organization): Annual Microsoft developer conference; context for this episode's release and Kyle's expanded-role announcements.

#github#copilot#ai-agents
Inside xAI: Building Grok Imagine in 3 Months, Videogen vs World Models, and Video Agents— Ethan He
1:44:42
EN/ZH
2 ヶ国語で視聴
Latent Space3日前

Inside xAI: Building Grok Imagine in 3 Months, Videogen vs World Models, and Video Agents— Ethan He

Ethan He built NVIDIA's Cosmos world model, then joined xAI mid-2025 to build Grok Imagine from scratch — no infra, no data, no model — and shipped the first audio-video generation model in three months. He walks swyx and Vibhu through the full technical stack: synthetic captioning pipelines, VAE design tradeoffs, step distillation, audio-video alignment, and the hard economics of storing petabytes of video training data. His central argument runs through the entire conversation: since diffusion model technology has largely matured, most quality gains in video now come from language models, not from the video model itself — a view with direct implications for where the field goes next, including video agents, generative UI, and embodied world models. ## [00:00] Hook This exchange — Ethan's "pretty big claim" that visual intelligence now mostly comes from language — is pulled from later in the interview, where he argues that improvements to video models are increasingly driven by better language models acting as prompt rewriters and orchestrators, not by advances in diffusion or flow-matching architectures themselves. > *"Every time you see there's some improvement on these models, I would say mostly the gain comes from language model, not coming from the video model itself."* ## [01:16] Introduction swyx and Vibhu welcome Ethan to the Latent Space studio, noting he has been a recurring presence through the podcast's paper club — first presenting the Cosmos world model paper, then mixture-of-experts work. The conversation opens with a brief aside about the Poolside paper released the same day, a fully open Gemma-level model trained on 40 trillion tokens, before pivoting to Ethan's own trajectory. ## [02:41] From NVIDIA Cosmos to xAI Ethan built Cosmos — NVIDIA's giant video foundation model aimed at giving roboticists a simulatable world to build on — and shipped it by end of 2024. Once he realized video models obeyed the same scaling laws as language models, he went looking for more compute. xAI offered it. He joined in mid-2025 at the moment xAI decided to build its own image and video stack, with no existing infra, data pipeline, or model. He stayed through pre-training, post-training (reference-to-video, video extension), and a final stretch leading a small team on real-time long-horizon video generation. > *"By the time I joined, xAI was about to build video models and multimodal models. There were no infra, no data, and no model. Just a few engineers — we built it in three months and released the first model, Grok Imagine 0.9."* ## [04:40] Building Grok Imagine from Zero to One The three-month timeline surprised even Ethan. He attributes it to three factors: talent density (strong engineers who could align on a goal with minimal meetings — typically just one sync a day), xAI's existing data and inference infrastructure, and his own prior experience running the same build at NVIDIA. The bottleneck was iteration speed: how many training runs can you complete per day. With strong infra and abundant compute, bugs surface faster and each failed run costs less, so you burn through the inevitable data and pipeline errors in weeks rather than months. > *"The most important thing is talent. Everyone was very strong and clever, very close to each other toward a common goal. So that speeds up things a lot — you reduce the communication bandwidth among people."* Ethan describes a pattern where small data or pipeline bugs produce outsized quality regressions, and only fast iteration exposes them. A bug invisible at one scale becomes catastrophic at the next. The engineers who find and fix these quickly — not the ones who design the most sophisticated architecture — determine how fast a team ships. ## [11:23] How Image and Video Models Are Trained Video models require synthetic text-video pairs because internet video titles and descriptions almost never describe visual content accurately. The first step is human labeling: at NVIDIA, annotators were instructed to describe every object, character, interaction, and dialogue in a clip as exhaustively as possible. Those labels train an early VLM, which then generates captions at scale. The resulting pipeline — video to VLM to synthetic caption to (video, caption) training pair — is the foundation of both Cosmos and Grok Imagine. Image models must come first: they train faster, require less storage, and the learned representations transfer directly to video. Ethan describes building image models as building the foundation that video sits on top of. The architecture — diffusion transformer operating over VAE latents — is now standard, but the data quality and caption detail remain the primary lever for model quality. > *"Building a video model, you actually need to build an image model first. The data you need is 100% synthetic pairs of language and image, or language to video — because on the internet, videos don't naturally associate with text."* ## [20:09] Video Compression, VAEs, and Real-Time Tradeoffs Raw MP4 compression produces tokens whose latent space is incomprehensible to transformers, so the field moved to learned VAEs that create a smoother, more continuous latent space models can train on. The key design choice is how aggressively to compress the temporal dimension. Temporal compression is efficient — adjacent frames are mostly redundant — but it trades away real-time capability. Wan 2.1 uses 8x8 spatial and 4x temporal compression; generating a single token requires reconstructing four frames, making sub-200ms latency impractical. Ethan frames this as a fundamental tradeoff: high compression rates make training cheap and inference efficient for pre-rendered video, but lock out any use case that needs to respond to live user input. World models require the opposite choice. ## [23:26] Generative UI, Flipbook, and Neural OS Ethan argues that if inference were free, the logical endpoint of video generation is a complete replacement of conventional UI: instead of loading web pages from a server, a model generates them in real time in response to user intent. Flipbook, a demo that went viral, shows this literally — every element of the "browser" is generated by an image model, and clicking a link generates a new page rather than fetching one. The deeper claim is that this is not a novelty but the final form of world models applied to human-computer interaction. A traditional app is a fixed function mapping input to output; a generative UI is a model that can produce any interface the user needs without a developer having to build it first. Ethan calls this a "Neural OS," where the gap between user intent and rendered pixels closes entirely. > *"Imagine the internet doesn't exist and you type in google.com — what should a model show you? The model can imagine something. These web pages completely do not exist, so I can explore anything."* The near-term constraint is inference cost. Current video models cannot generate at interactive frame rates without significant distillation. But Ethan treats this as an engineering problem with a known solution trajectory, not a fundamental barrier. ## [33:26] The Cost of Training Large Video Models Training large video models costs roughly as much as training a medium-scale language model, but the breakdown differs. Compute is comparable, but storage and data movement dominate in ways LLM practitioners do not expect. One billion videos at 5 MB each requires five petabytes of raw storage. The VAE features that must also be stored are roughly the same size again — tens of petabytes total. On AWS S3, five petabytes runs approximately $100K per month before egress. Egress — downloading that data into the training cluster — can exceed storage costs, and each training run pulls the full dataset once. > *"Just storing the videos alone costs a lot. Five petabytes on S3 Standard is $100K per month. And egress — just to download those videos — I believe it's more expensive than storing them, and each training run you probably need to pull them once."* The implication is that video model development is gated on data infrastructure as much as on GPU hours. Teams without efficient data pipelines pay a multiplier on every experiment. ## [38:20] Distillation, GANs, and Fast Video Inference Training-time costs are largely fixed; the inference-time story is more tractable. Step distillation — training a small model to replicate the outputs of a large teacher in far fewer denoising steps — cuts inference cost by 10-25x. Flow-matching models trained to convergence need around 100 steps; production models typically run in 4-8. At the extreme, simple image-to-image tasks can run in a single step. The intuition Ethan offers: the teacher model must learn the full distribution of internet video, which is arbitrarily complex. The distilled student only needs to match the teacher, which is a fixed and much simpler target. Consistency models and LCM-style approaches follow the same logic. In Cosmos, production serving used 4-step and 8-step variants depending on quality requirements. GANs remain relevant as discriminators: a GAN discriminator can enforce photorealism constraints during distillation that pure score-matching loss misses, and Ethan notes that consistency models and GANs are converging on similar practical deployments even if their theoretical motivations differ. ## [42:37] Audio-Video Generation and Grok Imagine 0.9 Grok Imagine 0.9 was the first audio-video joint generation model deployed at scale. The core difficulty is modality alignment: text-video pairs are relatively abundant; text-audio pairs are rare; audio-video pairs aligned at the semantic level are almost nonexistent at scale. Speech tokens are quasi-discrete and can be modeled with language-like approaches, but music is continuous and requires a completely different representation. Training the joint model required building synthetic audio caption pipelines from scratch, with human annotation where VLMs failed — which was often, especially for music. Aligning all three modalities — text, video, and audio — without either degrading video quality or audio realism is what Ethan calls the hardest part of the project. > *"Audio has two components: a discrete component — language — and a continuous component — music. The music is completely different; you cannot model it with discrete tokens. That's the hard part, not to mention we have to align text, video, and audio together."* ## [49:50] What Makes a World Model? Ethan's definition has three components: real-time, interactive, and long-horizon video generation. He treats these as independent requirements, each of which most current models fail. Real-time means generating at display frame rates — 60fps for casual use, 300fps for gaming, 200ms response latency for digital humans. Current video models cannot do this; the VAE's temporal compression alone introduces latency that makes sub-200ms responses nearly impossible without architectural changes. Interactive means the model can accept any input modality the user can provide — keyboard, mouse, voice — and respond coherently. Long-horizon means maintaining consistent physical laws, character identity, and causal logic across minutes, not seconds. > *"World model is real-time, interactive, long-horizon video. Current video models can do none of these three things fully. That's why they're not world models yet."* ## [57:07] Reference Videos, Long Context, and Video Memory The parallel to language model context scaling is direct: video models are in the 2,000-8,000 token era, and will need to scale to million-token-equivalent contexts to generate coherent long videos. Ethan describes the reference-to-video feature he built at xAI (analogous to Cameo) as a mechanism for injecting selected history into the model's context rather than carrying the full video forward. FramePack's heuristic — storing the last second of video at full resolution while compressing earlier frames progressively — points toward the right direction: the model selects relevant context from its history rather than brute-forcing the full sequence. Ethan expects this context management to become part of the model itself rather than remaining a harness-level heuristic, the same way KV cache management is disappearing into model internals. ## [61:27] xAI Culture, Research, and First-Principles Building swyx notes that xAI communicates its research poorly relative to what the work actually demonstrates — the blog post accompanying Grok Imagine describes high-level capabilities without the technical depth Ethan has just spent an hour covering. Ethan is diplomatic but agrees that different labs have different communication styles. The xAI working culture he describes is minimalist: few meetings, no bureaucratic overhead, direct access to leadership judgment on technical decisions, and extreme iteration speed enabled by a strong infra team. The tradeoff is that company priorities shift fast, which is part of what eventually pushed him toward independent research. First-principles thinking — starting from the physics of the problem rather than from what competitors have shipped — runs through the team's approach to both model architecture and product. > *"Everything you just described is state-of-the-art. Like no one else has done it. And then you just put this blog post with the cookies. I'm like, this is not enough."* ## [71:01] AI Safety, Watermarking, and Prompt Rewriting Grok Imagine deployed watermarks in all jurisdictions requiring them and built takedown pipelines integrated with xAI's social platform infrastructure. On watermarking technology, Ethan is skeptical of SynthID's long-term robustness: the technique is documented publicly, and users on Reddit have already reverse-engineered the exact frequency pattern Google applies and can strip it from any generated image. He expects watermark detection to become an arms race. On prompt rewriting: video diffusion models take instructions literally. If a user types "a cat," the model generates a stationary cat on a white background with no motion, because the training data pairs were maximally detailed descriptions of physical scenes. Production systems layer a large language model as a prompt upsampler — converting sparse user instructions into the detailed physical descriptions the video model was trained on. This is one of the reasons Ethan argues language models are increasingly central to video quality. ## [74:26] Video Agents and AI-Assisted Creation Ethan's central claim from the hook: visual intelligence now mostly comes from language. The diffusion model architecture has largely converged; the gains come from larger, smarter LLMs that rewrite prompts, plan video sequences, call editing tools, and stitch clips together. In Cosmos, the prompt rewriter was larger than the video model itself. Video agents extend this: instead of generating a complete video in one shot, an agent plans the production, calls video generation models as tools alongside deterministic editing operations (text overlays, color grading, cuts), and iterates until the output meets a specification. Ethan predicts that by end of 2025, video agent output will reach production-grade quality — presentable video generated without a human editor in the loop. > *"The visual intelligence are actually mostly coming from language. Every time you see improvement on these models, I would say mostly the gain comes from language model, not coming from the video model itself."* ## [88:48] Why Language Models Unlock Better Video LLMs prompt video models better than humans do, because AI models understand AI models' training distributions. A language model knows that a diffusion model needs explicit physical descriptions, not poetic shorthand — and can generate the right prompt format automatically. Beyond prompting, agents can use deterministic video editing tools for precision operations (exact text overlays, frame-accurate cuts) that probabilistic diffusion models handle poorly, keeping the stochastic model focused on generation and delegating precision to tools. Ethan's timeline: video agent output at production quality by end of 2025, with the inflection point visible in work already shipping. ## [92:31] Robotics, Physical AI, and Embodied World Models Ethan's robotics prediction inverts the usual framing: physical AI may be solved not by deploying robots in the real world but by video world models becoming so capable at simulating physical environments that they effectively provide embodied experience. Once a model can control computer interfaces in real time with full causal understanding, extending that to robotic control becomes a matter of adding one more tool. The path from screen-interacting video model to robot controller may be shorter than the path from current robot learning systems to the same capability. ## [93:54] Why Ethan Left xAI Research ambitions and company priorities diverged. xAI's focus shifted in ways that made certain research directions — particularly on the language model side — impractical from inside. Ethan also notes that the insight driving his departure is the same one underlying his "big claim": if language models are now the primary driver of video quality, the most impactful work to do is on language models, not video models. He frames leaving not as dissatisfaction but as following the evidence about where the leverage is. ## [95:32] Self-Managed Context and the Future of LLMs Ethan's active research question: language models that are aware of their own context state and manage it autonomously, rather than relying on harness-level heuristics like automatic compaction at 80% fill. He draws the parallel to video models struggling with long-horizon generation — the same context management problem appears in both modalities. He points to Claude Code's practice of appending the current timestamp to user messages as an early example of making models context-aware, and expects this pattern to be absorbed into model training rather than remaining an external scaffold. > *"The language models are not aware of how long their own context length is. Once they hit like 80% or something, automatic context compaction is getting triggered, and the model is not aware of that when it's working."* ## [99:59] Ethan's Career Path and Closing Thoughts Ethan traces a decade of transitions: ResNet-era image recognition with the original authors at NVIDIA, self-supervised learning at Facebook AI Research, scaling at NVIDIA Cosmos, extreme-scale compute at xAI. He was rejected from every top PhD program despite first-author papers at top conferences, which pushed him into industry. In hindsight he reads his career as consistently following the scaling frontier — from image recognition to SSL to video to LLMs — and argues that within ML, domain switching is far more tractable than practitioners believe. > *"Within ML, it's actually easier to switch than you think. A lot of people have manifested that 'I work on computer vision, I always have to work on computer vision.' But from my experience, the fundamentals transfer."* ## Entities - **Ethan He** (Person): Former xAI researcher who built Grok Imagine from zero; previously led NVIDIA Cosmos world model; now focused on LLM research - **swyx** (Person): Latent Space co-host; conducts technical interviews on AI engineering and research - **Vibhu Viswanathan** (Person): Latent Space co-host; co-interviewer for this episode - **Grok Imagine** (Software): xAI's image and video generation product; first model (0.9) was the first large-scale audio-video joint generation system - **NVIDIA Cosmos** (Software): Open-source video foundation model for robotics simulation; Ethan's project before xAI; released end of 2024 - **xAI** (Organization): Elon Musk's AI lab; known for fast iteration culture and extreme compute resources - **Flipbook** (Software): Viral demo of real-time generative UI; all interface elements generated by image model in real time - **SynthID** (Software): Google's AI watermarking technology; Ethan notes its pattern has been publicly reverse-engineered - **Step distillation** (Concept): Technique to train a model to replicate a teacher's output in far fewer denoising steps; reduces inference cost 10-25x - **VAE** (Concept): Learned video compression creating smooth latent spaces; temporal compression is efficient but creates real-time latency tradeoffs - **World model** (Concept): Ethan's definition — real-time, interactive, long-horizon video generation; distinct from standard video generation - **Video agents** (Concept): Systems where LLMs orchestrate video generation models, editing tools, and deterministic operations to produce production-quality video - **FramePack** (Concept): Progressive temporal compression approach for long-context video generation; stores recent frames at full resolution, compresses older history

#video-generation#world-models#grok-imagine
Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray
1:09:32
EN/ZH
2 ヶ国語で視聴
Latent Space7日前

Devin’s 80% Moment: Background Agents, 7x PRs, & End of Hand-Held Coding — Walden Yan & Cole Murray

🔬 苦い教訓がタンパク質の世界にやってくる — Alex Rives、BioHub
1:10:12
EN/ZH
2 ヶ国語で視聴
Latent Space8日前

🔬 苦い教訓がタンパク質の世界にやってくる — Alex Rives、BioHub

BioHubのサイエンス責任者であり、Meta FAIRでESM-1からESM-3を主導した研究者Alex Rivesが、BrandonとRJ Honikyのもとを訪れ、マスク言語モデルをタンパク質配列にスケーリングすることで生物の構造・機能・設計が解き明かせるという8年間の確信を語る。今回のエピソードでは、ESMCのスケーリング則を回復させたUniRefからメタゲノミクスへのデータ転換、百年にわたる生化学的分類体系を教師なしで再現したスパース自己符号化器によるフィーチャーアトラス、そして世界モデル探索により治療グレードの一本鎖抗体(SCFV)を設計した初の成功例を取り上げる。さらにRivesは、BioHubの5億ドル規模の仮想生物学イニシアティブと、汎用細胞モデルを生み出すための原則を説く。 ## [00:00] ESMCが抗体を設計する — プレビュー 冒頭のクリップは、インタビュー後半でRivesがESMCによるプログラマブル生物学のアプローチを語る場面から抜粋したもの。タンパク質世界モデルを検索して設計条件を満たす配列を探し出すという手法を説明し、チームがミニバインダーや治療上重要な結合親和性を持つ一本鎖抗体フラグメント(SCFV)を設計したことに言及する。このクリップはフォーマルなイントロに先立って置かれ、エピソードが何を目指しているかを示している。 ## [00:33] 苦い教訓、タンパク質に到来 BrandonとRJ Honikyは、Alexを「いまタンパク質生物学で最も苦い教訓を体現している人物かもしれない」と紹介する。Rivesはそのラベルを受け入れる。確信の原点は2018年。Meta FAIRのチームがマスクトークン予測によるトランスフォーマー言語モデルをタンパク質配列に初めて適用したとき、明示的な監督なしに構造・機能の表現が自発的に現れるのを目撃した。中心的な直観は、Zellig Harrisが1954年の論文「分布構造」で示した考え方から借りている。アミノ酸が現れうるコンテキストは、そのタンパク質の構造・機能・進化的役割によって決まる。全生命から集めた数十億の配列にわたってその統計的な圧力をかけ続ければ、モデルはタンパク質生物学を支配する潜在変数を学ぶはずだ。 > *「私はスケーリング則を信じています。」* ## [06:00] ESMの系譜:ESM2からESMCへ Rivesは4世代のESMを振り返る。ESM2はスケーリングの恩恵を示したが、100億パラメーターで収穫逓減に陥った。モデルが飽和したのではなく、データが飽和していた。金字塔的タンパク質データベースのUniRefは培養生物を中心に収録しており、ヒト関連生物学に強く偏っている。ESMCへの転機はメタゲノムデータだ。熱水噴出孔・極地土壌・下水道から採取された配列であり、生物種の帰属なしに環境DNA断片から直接アセンブルされた不完全なコンティグも含まれる。数十億のメタゲノム配列をトレーニングに追加したことで、対数線形のスケーリング則が復活し、小スケールの実験が60億パラメーターのフラッグシップモデルの表現精度を正確に予測できるようになった。 > *「スケールに対する収穫逓減はもはやない。ESM2はコンピュート制約ではなく、データ制約だったのです。」* ESMCは本質的にバニラトランスフォーマーで、標準的なマスキング目標を使っている。AlphaFoldのようなMSAも、幾何学的帰納バイアスもない。BrandonとRivesは、ESM3のマルチトラックアーキテクチャが生産的な回り道だったかどうかを短く議論する。Rivesは両パラダイムに居場所があると言いつつ、ESMCの結果はこのデータ規模では事前情報が決定的ではなかったことを示唆していると述べる。 ## [18:30] 機械論的解釈可能性とタンパク質フィーチャーアトラス BioHubチームは、ESMCモデルファミリー(300M・600M・6B)の全層にわたってスパース自己符号化器を訓練し、タンパク質表現空間の固有フィーチャー幾何を抽出した。浮かび上がってきたのは、生物学が百年かけて実験的に積み上げた還元的階層構造に近いものだった。基本的なアミノ酸化学から始まり、構造モチーフ、ドメインファミリー、大きな機能テーマへと連なる階層が、その分類体系を一切教えることなく出現したのだ。 > *「あるアミノ酸の選択は、配列中の他のすべてのアミノ酸の選択と完全に絡み合っている。これをうまくやるには、モデルが生物学を表す潜在変数を持つようになるはずです。」* 具体的な発見として、モデルは求核エルボーという触媒モチーフをエンコードしている。これは複数の無関係なタンパク質ファミリーで独立して進化したと考えられる構造で、すべてに対して活性化する単一のフィーチャーとして表現されていた。チームはさらに68億の非重複タンパク質の構造アトラスを構築し、11億のクラスター代表について構造を予測した。SAEフィーチャーを使って進化的に遠い遺伝子編集システムを接続しており、そのクラスターに引き込まれたタンパク質の中には機能未知のものもある。Rivesはそれらを発見待ちキューとして扱っている。ESMアトラスの初版は、外部のグループが新たな遺伝子編集システムを発見するのにすでに使われた。 ## [35:30] ESMCで抗体を設計する Rivesはタンパク質設計を世界モデル探索として描く。生成モデルを逆転させて、目標の結合条件を満たす配列を見つける。ミニバインダーはいまや日常的になった。ナノボディやSCFVは、構造予測ベースの手法にとっては依然難しい。抗体の進化は制約された折り畳みに収束するのではなく多様性を最大化するため、MSAベースのアプローチが機能しにくい。その多様性を大規模にトレーニングしたESMCこそ、表現が最も豊かになるはずの場所だ。 > *「抗体は、分子の構造トポロジーを予測するのと同じように進化情報の恩恵を受けないでしょう。」* チームは少数の試行で治療グレードの親和性を持つSCFV設計に成功したと報告しており、SCFVを完全なIgGに再フォーマットできることにも言及する。ESMFold 2はESMC表現の上に構築された構造予測ヘッドで、MSA不要で一配列あたり数秒で動作し、プロテオーム全体のマルチマーマッピングを現実的なものにする。Rivesは、現在オープンウェイトのマルチマー予測において最高水準にあると述べる。 ## [42:00] BioHubのビジョン:プログラマブル生物学へ BioHubに着任して6ヶ月のRivesは、機関の構造を説明する。先端的な実験生物学・先端的な計測技術・先端的なAIをオープンサイエンスの指針のもとで一体で構築する慈善的研究機関だ。目指す先は個別化された生理機能の予測モデルであり、薬ではなく、特定のヒトゲノムにおける疾患発現まで、タンパク質レベルの分子イベントから細胞回路を通じて追うことのできるシステムだ。 > *「私たちはこの新しいパラダイムのための科学機関を作っています。」* モデル化しなければならない生物学的複雑性のレベルを順に示す。タンパク質(現世代)、細胞(次)、組織・システム、生理機能。タンパク質から細胞へ移行するには、まだ存在しないデータと、おそらくまだ発明されていないモデリング手法が必要だ。現在の「仮想細胞」モデルの汎化能力は乏しく、訓練データをよく表現できても、未観測の介入コンテキストでの結果予測には失敗する。 > *「新規介入を新規未観測コンテキストで行ったときに何が起きるかを予測する能力は、非常に限られています。」* ## [57:00] 仮想生物学イニシアティブと細胞データのスケーリング BioHubは最近、内部のデータ生成・計測技術に4億ドル、外部の取り組みの触媒として1億ドルを発表した。これが合わせて仮想生物学イニシアティブだ。Rivesはこれをシードファンドと位置づけている。実際に必要なデータ量はさらに大きく、BioHubの取り組みが科学コミュニティ全体の投資を引き出すことを期待している。 3つのデータ原則を示す。速度(タンパク質データには半世紀かかった。細胞にはそれだけ待てない)、汎化(訓練分布は、タンパク質にとってのメタゲノムの広さに相当するほど多様な介入・細胞型・コンテキストをカバーしなければならない)、フィードバック(モデルの予測に誘導された能動的な実験ループ。ウェットラボ生物学にRLVRを適用するようなもの)。摂動シーケンシング・空間トランスクリプトミクス・クロスモダリティ単細胞計測が、いま動かせるスケーラブルな技術だ。 コンピュートについて。ESMCはおよそ10億の配列で訓練された。存在すると考えられる配列は約1000億であり、現在のアトラスの68億ですら十分に活用できていない。100倍のコンピュート増強は有益だが、データのスケールアップと並行してこそ意味がある。収穫逓減がいつ現れるかは経験的に開かれた問いだとRivesは言う。ESM2の曲線も、メタゲノムデータがそれを消し去るまでは飽和しているように見えた。 > *「これを数年でやり遂げる方法を見つけなければなりません。汎用AIの発展速度を考えると、生物学は実験科学とデータによって根本的に制約されることになります。」* ## 登場人物 - **Alex Rives** (人物): BioHubサイエンス責任者。ESM-1・ESM-2・ESM-3・ESMC・ESMFold 2の設計者。元Meta FAIR所属。 - **Brandon** (人物): Latent Space「AI for Science」サブシリーズの共同ホスト。Atomic AI(RNA治療薬)所属。 - **RJ Honicky** (人物): 共同ホスト。Miro OmixのCTO・創業者。 - **ESMC** (ソフトウェア): BioHub/EvoScaleによる第4世代タンパク質言語モデル。パラメーター数300M〜6B。メタゲノムデータを含む約10億配列で訓練。MITライセンスのオープンソース。 - **ESMFold 2** (ソフトウェア): ESMC表現上に構築された構造予測モデル。MSA不要で一配列あたり数秒の推論。オープンウェイトのマルチマー予測で最高水準。 - **ESM** (ソフトウェア): Evolutionary Scale Modeling — Rivesのチームが先駆けた多世代タンパク質言語モデルの系譜(ESM-1・ESM-2・ESM-3・ESMC)。 - **スパース自己符号化器 / SAE** (概念): ESMCの表現空間の固有フィーチャー幾何を抽出する機械論的解釈可能性ツール。監督なしで生物学的に解釈可能な階層を明らかにする。 - **苦い教訓** (概念): Richard Suttonの主張。コンピュートとデータを活用した汎用的手法は、ドメイン知識を組み込んだ手法を一貫して上回る。ここではタンパク質生物学のスケーリングに適用されている。 - **メタゲノムシーケンシング** (概念): 培養なしに微生物・ウイルスの多様性を捉える環境DNAシーケンシング。ESMCのスケーリング則を回復させたデータ拡張の源。 - **BioHub** (組織): Chan Zuckerberg BioHub。実験生物学・計測技術・AIの交点でオープンサイエンスツールを構築する慈善的研究機関。 - **仮想生物学イニシアティブ** (概念): BioHubによる5億ドルの取り組み(内部4億ドル・外部1億ドル)。汎用細胞モデルの訓練に必要な細胞スケールのデータを生成するための投資。 - **AlphaFold** (ソフトウェア): DeepMindの構造予測システム。MSAと幾何学的帰納バイアスを使用。ESMCのMSA不要アプローチと対比される。 - **UniRef** (ソフトウェア/データベース): 金字塔的なキュレーション済みタンパク質配列データベース。ESM2の訓練データだったが、スケーリングの頭打ちを引き起こしたボトルネックであることが後に判明。 - **求核エルボー** (概念): 進化的に無関係な複数のタンパク質ファミリーに現れる触媒的構造モチーフ。ESMCではすべてに対して活性化する単一フィーチャーとしてエンコードされている。 - **Zellig Harris** (人物): 言語学者。1954年の論文「分布構造」で、語のコンテキストが意味をエンコードすることを論じた。アミノ酸のコンテキスト統計が生物学的機能をエンコードできる理由についてRivesが引用する理論的先駆者。

#protein-language-models#scaling-laws#esm
⚡️ なぜSFを作るべきか — Sunil Pai、Cloudflare
14:47
EN/ZH
2 ヶ国語で視聴
Latent Space11日前

⚡️ なぜSFを作るべきか — Sunil Pai、Cloudflare

この短編エピソードでは、swyxがSunil Pai——Cloudflareの開発者プラットフォームリードで、swyxいわくCode Modeの生みの親——と対談する。議論は三本柱で展開される:AIエージェントの基盤としてのDurable ObjectsとDynamic Workersへの賭け、差点でキャリア終了かと思ったVercelとのSNS上の誤解、そしてコードをフォークすることが攻撃ではなく敬意の表れである理由。Sunilは最後に開発者へ直接問いかける——インクリメンタルなエージェントフレームワークを作るのをやめ、SFを作れ、と。 ## [00:00] Code Modeを発明したのは誰か? 冒頭の3秒はスレート映像。その直後、swyxがSunilを「Code Modeの発明者」と紹介し、Sunilが大げさな身振りで功績を受け入れ、子供の頃からずっと考えていたと話す場面が続く。旧来の友人同士の純粋な軽口であり、後半から切り取ったティーザーではない。 ## [00:03] イントロとSunil Paiの経歴 swyxがSunilを旧友かつAIE Europeの基調講演者として改めて紹介する。短い近況報告が以降の文脈を固める——Sunilの現在の焦点はCloudflareのAIエージェントプラットフォームで、AnthropicのCloud Managed Agentsの直近リリースが格好の比較対象になっている。 > *「Cloudflare周辺で起きていることを全部キャッチアップしたかっただけです。」* ## [00:30] 新しいクラウドマネージドエージェントについて Anthropicが新たにリリースしたCloud Managed Agents——長期稼働エージェントを構築・デプロイするためのプラットフォーム——がSunilの出発点だ。Anthropicチームも製品も面白いと思うと言いつつ、仕様書を読んで最初に芽生えたのは競争心だったとSunilは明かす。Cloudflareならもっとうまくできるはずだ、と。swyxはその根拠を問う。 > *「その製品を見て、競争したいと思いました。WorkersとDurable Objectsでもっといいものが作れると思って。」* ## [01:10] Cloudflareのコア基盤:Durable ObjectsとDynamic Workers Sunilは、あらゆるエージェントプラットフォームが最終的に必要とすると考える二つのプリミティブを挙げる。Durable Objectsはステートフルなサーバーレスユニットであり、ユーザーランドのライブラリではなくインフラ層でのアクターモデルの世界初実装だとSunilは主張する。Dynamic Workersは、LLMが生成したコードを安全に実行するためのCloudflareの回答——コールドスタートなし、設定可能なAPI面、アウトバウンドトラフィックはデフォルトでロック済みという再設計版evalだ。組み合わせることで、フルVMを立ち上げることなくサンドボックス上でエージェントのステップを実行できる。 > *「インフラ層でのアクターモデルの世界初実装です。ユーザーランドではなく。」* ## [02:34] CloudflareのAIエージェントアーキテクチャ 同僚のMatt CareyによるCloudflare MCPサーバーが、Dynamic Workersの実際の使い方を示す。Cloudflare APIには2,600のエンドポイントがある——エンドポイントごとに一つのツールを公開すれば、どんなLLMのコンテキストウィンドウも即座に枯渇する。代わりに、すべてを二つのツール呼び出し`search`と`execute`に集約し、どちらもアイソレート上で動くJavaScriptコードが支える。エージェントがコードを送り、アイソレートが実行し、結果が返る——やりとりは一往復、型検査付き。 > *「LLMとの往復なし、一度のツール呼び出しで、型検査付き。結局、LLMはコードを実行するのが得意なんです。」* ## [03:40] エージェント型ソフトウェアの未来とハーネスの標準化 swyxは、Anthropicのスペックにあるハーネスというコンセプトがクロスプラットフォームの標準になり得るか問う。Sunilの答えは明快だ——AIエージェントのReactはまだ誰も作っていない。2013年のReactの比喩は意図的だ。JSConfのトークが終わると聴衆が席を立ち、FacebookはJavaScriptを憎んでいると批判したが、Reactはその後のすべてのUIフレームワークを定義した。今はみんなが思い思いの形で自分のハーネスを作っており、言語・企業・インフラをまたいで再現可能なものは何もない。swyxはskill——プレーンなmarkdown——がすでにその統一レイヤーかもしれないと提案し、Sunilはそのアイデアを面白いと思いつつも、具体性の上限を心配する。 > *「本当に難しいですが、頭の中のフレームでは、まだ誰もAIのReactを作っていない、ということです。」* ## [06:11] 「スロップフォーク」現象とオープンソース文化 swyxが「スロップフォーク」——人気プロジェクトのAI生成フォーク——を話題にすると、Sunilがすぐに乗ってくる。彼の解釈では、フォークは盗用ではなく名誉と敬意の表現だ。Reactエコシステムはフォークによって育った。Cloudflare Agents SDKの競合を作りたい人は誰でもやっていい、みんながフォークすれば全員が得をする、と彼は言う。 > *「私の文化では、フォークは名誉と敬意の証です。」* ## [06:36] VercelとCloudflareのSNS上の誤解 JSConf EspañaでSunilはVercelのHarveyと出会い、一緒に過ごす時間を楽しんだ。Vercel Labsのプロジェクト——純粋なJavaScript実装のBashである「Just Bash」——を見つけ、Cloudflareに移植しようと考えた。昼食の時間にOpusをコードベースに向け、5,000行のコードを受け取り、月曜日にきちんと整理してからPRを送るつもりだった。就寝して目覚めると、Cloudflareの経営陣からDMが届いていた——TwitterでVercel CTOがその成果を公に批判し、個人の趣味プロジェクトではなく企業の意図的な行動と位置付けていたのだ。Sunilは率直に返信して経緯を説明し、その後インターネットの半分が彼を擁護するために動いた。 > *「Twitterを開いたら、Vercel CTOが私の作業を批判していて……「Cloudflareがやったことだ」と言っていました。」* ## [09:45] ソフトウェア開発におけるフォークの重要性 swyxはVercelの件をより大きなパターンに結びつける——ライセンスから逃れるためにPythonで書き直されたコードベースがあり、弁護士は結局それも派生作品と裁定した、という話だ。swyxが本当に主張したいのは、スロップフォークを推奨すべきだということ——依存関係をフォークして、ベンダーに取り込み、自分でコントロールする——そうすればLiteLLMやAxiosのような上流の突然の断絶を避けられる。Sunilも同意する——NPM以前、ソフトウェアはUsenet上でまさにこのパターンで広まっており、フォークサイクルを短縮するのはその伝統の継続にすぎない。 > *「フォークはソフトウェアを作る上で根本的なことです。」* ## [12:04] 現代オープンソースリポジトリの敵対的な現実 Cloudflare Agents SDKはプルリクエストの受け付けを完全に停止し、現在はissueのみを受け付けている。Sunilはカンファレンスでオープンソースのメンテナーと話し、誰もが同じことを言っていると語る——リポジトリは敵対的な領域になっており、最悪の攻撃ベクターは丁寧に読むまで完全に正当に見える偽のセキュリティレポートだ。swyxはこれをClaude Codeに関するPeterの朝の講演と結びつける——現在の最大の攻撃面は侵害された依存関係がClaude Codeに入り込むことで、それが使っているすべての開発者を危険にさらす。 > *「オープンソースリポジトリは、人々がその空間で人気を得ることをほぼ恐れるほど敵対的になっています。」* ## [13:04] 締めくくりと独創性への呼びかけ Sunilの締めくくりは直球だ——10番目のエージェントフレームワークを作るのをやめろ。SFを作れ。家族のために何か作れ。Agent SDKを使え、でもインフラとLLMがギリギリ崩れそうなところで使え——次の飛躍はそこにある。swyxはSunilが2018年のReact Rallyで生み出した「alpha thought leading」というフレーズを持ち出して締める。 > *「SF的なものを作れ。家族のために作れ。世界を変える力があなたにはある。みんなに本当にオリジナルなものを作ってほしい。」* ## 登場人物 - **swyx** (人物):Latent Spaceのホスト;Sunilの旧友;2018年のReact RallyでSunilの一言から「alpha thought leading」を生み出した。 - **Sunil Pai** (人物):Cloudflareの開発者プラットフォームリード;swyxにCode Modeの生みの親と称される;AIE Europeの基調講演者。 - **Cloudflare** (組織):クラウドプラットフォーム企業;Durable ObjectsとDynamic Workersの上にエージェントインフラを構築中。 - **Anthropic** (組織):AI企業;Cloud Managed Agentsをリリースし、SunilがCloudflareで競合しようとしている製品。 - **Vercel** (組織):フロントエンドクラウド企業;SunilはそのAI SDKを使用;SNS上の誤解の当事者。 - **Durable Objects** (ソフトウェア):Cloudflareのステートフルサーバーレスプリミティブ;Sunilはインフラ層でのアクターモデルの世界初実装と主張。 - **Dynamic Workers** (ソフトウェア):LLMまたはユーザー生成JavaScriptをコールドスタートなしのセキュアなアイソレート上で実行するCloudflare機能。 - **Just Bash** (ソフトウェア):Vercel Labsのプロジェクト——純粋なJavaScript実装のBash——SunilがTwitter騒動の発端となった時にCloudflareへの移植を試みていた。 - **MCP** (概念):Model Context Protocol;CloudflareのMCPサーバーはDynamic Workersを使い2,600のAPIエンドポイントを二つのツール呼び出しに集約する。 - **スロップフォーク** (概念):既存プロジェクトのAI生成フォーク;Sunilはオープンソースのフォーク文化の継続として位置付け、盗用ではなく敬意の表れとみなす。

#cloudflare#ai-agents#open-source
⚡️ GoogleのオープンAI戦略 — Omar Sanseviero、Google DeepMind
29:58
EN/ZH
2 ヶ国語で視聴
Latent Space11日前

⚡️ GoogleのオープンAI戦略 — Omar Sanseviero、Google DeepMind

AI Engineer Londonの会場から、swyxがOmar Sanseviero — Google DeepMindのHead of Developer Experience — と向き合い、30分で駆け抜ける。Gemma 4のアーキテクチャ上の新機軸、Googleのオープンモデル戦略、DevExチームの次の展開先。Omarは層別埋め込みの仕組み、ファインチューニング熱が冷めた理由、KaggleがDeepMindに加わった意味、そして「自動研究」が実態なのかまだ夢なのかを率直に語る。 ## [00:00] Gemma 4の紹介とチームの守備範囲 Omarが一言で表す:Gemma 4は「これまでリリースした中で最も高性能なオープンモデル」であり、パラメータあたりの知性を最大化しながら完全なマルチモーダル対応を実現し、ローカル推論でも扱いやすいサイズを維持する。 > *「パラメータあたりにできる限り多くの知性を詰め込むことを追求しました。」* ## [00:23] 有効パラメータとアクティブパラメータの違い Gemma 4の小型モデルで核心となる設計変更は、各Transformerブロックに挿入された層別埋め込みテーブルだ。行列積ではなくルックアップで処理するため、3B分の埋め込みパラメータはGPUメモリに常駐する必要がなく、CPUやディスクに置いたまま2Bのアクティブパラメータだけが実際の演算を担う。Omarはこのアプローチがオンデバイス向けに特化したものだと明言し、大規模になればdenseかMoEの方が合理的だと述べる。 > *「Gemma 4モデルはE2Bです。つまりGPUに読み込まれるのは実質20億パラメータ。実際には約50億ありますが、残り30億はCPUにもディスクにも置けます。」* ## [01:43] オンデバイスのユースケースとGemini Nanoの統合 PixelとハイエンドのSamsung端末にはGemini Nanoが標準搭載されており、その基盤となるのがスマートフォンの制約に合わせて設計されたGemma 3Nアーキテクチャだ。Gemma 4と同じパラメータオフロード手法が小型モデルにも適用されている。29B〜31Bへのスケールアップについて、Omarは「実験は続けている、続報を待ってほしい」とだけ答えた。 > *「ハイエンドスマートフォンを買えば、最初からGeminiが使えます。」* ## [03:14] モデルローンチの裏側と開発者エコシステム Gemmaチームは想像より小さく、PM 2〜3名、マーケター1名、そしてコアとなるエンジニアと研究者で構成される。ローンチを複雑にするのは外部との連携図だ。llama.cpp、Ollama、MLX、Hugging Face、vLLM、NVIDIA、AMDなど50近いパートナーを並行調整し、さらにGoogle Cloud、Vertex、ADK、Androidとの社内連携も走らせる。Gemma 4のリリースではAndroid StudioのエージェントモードとのネイティブAPI統合も実現し、開発者がコード補助にオフラインでGemma 4を使えるようになった。 > *「Gemma 4ローンチの外部パートナーは約50社に達し、これまでで最も複雑なリリースでした。」* ## [04:29] オフライン利用とAPI利用の違い、今後のモデル成長 プライバシーとオフラインという軸だけでは語り切れないとOmarは言う。より鮮明な境界線はこうだ:ローカルモデルは今やファンクションコール、指示追従、エージェントタスクで十分な実力を持つが、知識密度ではまだ大規模モデルに劣る。Omarの1〜2年後の見立ては、Gemini Proクラスのモデルが完全にオンデバイスで動き、現在はAPI接続が前提となっている体験を端末上で実現できるようになる、というものだ。 > *「1〜2年のうちに、Gemini Pro並みの強力なモデルがスマートフォン上で直接動く未来が来ると思っています。」* ## [06:26] Gemma 4のマルチモーダル機能とその限界 Gemma 4はGemini 3の研究スタックを継承しており、2Bモデルでも音声理解(音声認識、音声からの翻訳テキスト生成、音声クリップへのQ&A)とビジョン(物体検出、ポインティング、キャプション生成)を扱える。Omarが明示した二つの欠点:画像セグメンテーションは未対応、映像と音声を同一プロンプトで同時入力することもまだできない。ネイティブな音声出力は検討中だが、現時点での発表はない。 > *「映像入力と音声入力はそれぞれ単独では扱えますが、同じプロンプトに視覚と音声の両方を混在させるには、まだ改善が必要です。」* ## [08:08] 多言語トークナイザーの設計思想 GemmaのトークナイザーはGeminiと同じものを使っており、140言語にわたって強い多言語基盤を持つ。Omarが示す具体例:Gemma 3をベースにベトナム語などの東南アジア言語でファインチューニングすると、英語ベンチマークで高得点を出す他のベースモデルを上回る性能が出る。英語向けに最適化されたサブワードで非ラテン文字を無理やり処理するのではなく、各言語に適したトークンを捉えているためだ。 > *「東南アジアの言語、たとえばベトナム語でこれらのモデルをファインチューニングすると、他のベースモデルの方が英語では優れていたとしても、Gemmaの方が良い結果を出します。」* ## [09:30] AI Engineerに集結したGoogleのDeveloper Experienceチーム DeepMindのホームであるロンドンに、AI Engineer Europeのためにフルチームで乗り込んだのは意図的なメッセージだ。Omarが連れてきたのはGemma 4開発、拡散テキスト生成、ロボティクス、オンデバイスML、Androidにまたがる研究者たちで、DevExの顔見せにとどまらない。swyxは一言で表す:「あの会社は本当に何でもやっている。イルカの研究までしている。」 > *「ロボティクスから研究、Androidまで揃えました。会社が作っているものすべてを見せられるのは本当に面白い。」* ## [10:42] 研究領域の紹介:テキスト向け拡散モデル GoogleはI/OでGemini Diffusionを発表した。これは画像ではなくテキストを生成する拡散Transformerで、自己回帰デコードより大幅に高速だ。Omarの率直な評価:品質はまだ自己回帰モデルに及ばず、分布変化がルーティングに異なる影響を与えるためファインチューニングも難しい。swyxは「拡散モデルが素早いSystem 1として動き、自己回帰モデルが複雑な計画を担う」という構成を提示し、Omarはあり得ると思うが時期尚早だと答えた。 > *「今のところはまだ非常に実験的な段階で、通常の自己回帰モデルから得られるものより品質は少し劣っています。」* ## [13:37] ファインチューニングの現状とコミュニティの動向 ファインチューニングコミュニティの熱は2023年頃にピークを迎えた。Omarは今、潮が引いているのを見ている。Gemma 4ローンチで27Bビジョンモデルをファインチューニングしようとしていた複数のパートナーが、ベースモデルですでに事足りると判明して途中でやめた。かつてファインチューニングが必要だった汎用的な挙動変更は、今やプロンプトだけで対応できる。残るのはヘルスケアや金融などのドメイン特化ファインチューニングと、ベースモデルが更新された際のLoRA互換性管理という運用課題だ。 > *「そういう事例が多く見られたので、今は汎用的な会話モデルとしてのファインチューニングへの熱量が落ちていると感じています。」* ## [16:29] 密なアーキテクチャと疎なアーキテクチャのトレードオフ Gemma 4は近いパラメータ数の大型モデルを2種類出荷している。31BのDenseモデル(量子化すればコンシューマーGPUで動く最高性能)と、アクティブパラメータ4Bの27B MoE(同じハードウェア枠で最速の推論)だ。サイズの選択は開発者への親切心から来ている。Omarがファインチューニング担当者に向けて発する警告:MoEのトレーニングレシピとハイパーパラメータはdenseモデルからそのまま移せない。入力分布の変化がどのエキスパートを発火させるかを変えてしまうため、ルーティングに予測しにくい影響が出る。 > *「MoEはファインチューニングが難しい。推論は優れているのに、ファインチューニングしようとするとつまずく人が多い。」* ## [18:29] パラメータあたりの知性と今後の研究 Gemma 2から3、4と続く中で、Googleはパラメータ総数を約30Bに保ちながら性能の上限を大きく引き上げてきた。パラメータあたりの知性が向上し続けていることの直接的な証明だ。比較の難しさも正直に認める:MoEのスパース性とパラメータオフロードが混在すると、パラメータ数は共通の通貨として機能しなくなる。Omarの見通しはこうだ:知識の限界はおそらく構造的なもので、3年後の30Bモデルでも固定重みに詰め込める情報量の情報理論的な壁から、ニッチな事実の想起は難しいだろう。 > *「パラメータあたりの知性とは何か。それをどう最大化するか。」* ## [20:09] Gemma Scopeとメカニスティック解釈可能性 Googleは2025年12月にGemma Scopeをリリースした。Gemma 3モデルの全層にわたるアクティベーションを分析するツールキットで、全層をカバーするペタバイト規模のアクティベーションデータセットが付属する。Omarはメカニスティック解釈可能性をML研究への低コスト入口として勧める。アクティベーション分析にトレーニングクラスタは不要で、実験を通じてTransformerの内部動作への具体的な直感が養える。 > *「始めるために大量の計算資源は必要ありません。モデルがどう動くかを理解できる領域です。」* ## [21:12] 研究とエンジニアリングの交差点 研究者をエンジニアリング会議に連れてきた理由:エンジニアはモデルの作られ方を理解すると信頼感が増す、たとえ自分でトレーニングすることがなくても。OmarとswyxはともにこMに、研究とエンジニアリングの境界が曖昧になっていることを指摘する。研究者の仕事の多くは理論というよりも実験的なアブレーションに近く、コーディングエージェントによってエンジニアも以前は研究者が必要だった実験に直接アクセスできるようになった。Omarは、RedditやDiscordのコミュニティが論文になる前に研究機関と同じ手法を独自に再発見した例として、フランケンマージとAxolotlコミュニティを挙げる。 > *「何が効いて何が効かないかを試し、動かして確認する、という作業が多い。私にはそれはエンジニアリングに近い。」* ## [23:59] 「自動研究」とエージェント自動化への見方 swyxが本質的な問いを立てる:自動研究は「エージェントによるパラメータスイープ」にすぎないのか、それとも誰も探しに行かなかった「第37手」を生み出せるのか。Omarは慎重に懐疑的だ。AutoMLの実績はほぼグリッドサーチの焼き直しで、深いアーキテクチャ研究は1〜2年では自動化できないと見る。ただし、ファインチューニングそのものはすぐにエージェント駆動になると考えている。Hugging FaceのAutoTrainやAxolotlのCLIのようなツールを使って、トレーニングコードを書く代わりにエージェントに指示を出すだけになる。 > *「次世代のファインチューニング担当者はコードを一切書かない人たちになる。ほとんどの人は数個の操作だけでファインチューニングするようになる。」* ## [26:06] チーム拡大、グローバル拠点、Kaggle統合 DevExチームはシンガポールとインドで採用を進めている。DeepMindの研究オフィスと同じ建物に入ることで、DevRelスタッフが孤立した営業サテライトオフィスからではなく、廊下を歩いて研究者に会いに行ける。組織面での大きなニュースはKaggleがDeepMindに加わったことだ。コンペや評価インフラがGemma/Geminiの能力上の課題と直結し、コミュニティが作ったベンチマークを学習シグナルとして還流させられる。Omarはこのモデルをフィードバックループで動いていると表現する:チームがSNSやイベントで開発者が何を作っているかを把握し、その知見をモデル開発側に届ける。 > *「Gemma、Gemini、そしてあらゆるツールの作り方は、スタートアップ、コミュニティ、開発者からのフィードバックに基づいています。」* ## 登場人物 - **Omar Sanseviero** (人物): Google DeepMindのHead of Developer Experience。以前はHugging FaceでDevRelを立ち上げ、現在はGemmaの開発者エコシステムを率いる。 - **swyx** (人物): Latent Spaceポッドキャストのホスト。AI Engineer London 2026でのインタビュアー。 - **Gemma 4** (ソフトウェア): Googleのオープンモデルファミリー。層別埋め込みアーキテクチャ(E2B有効パラメータオフロード)を採用し、2B/4B/27B MoE/31B denseの各バリアント、140言語対応、マルチモーダル入力をサポート。 - **Gemini Nano** (ソフトウェア): GemmaアーキテクチャのオンデバイスモデルでPixelおよびハイエンドSamsungスマートフォンにOSレベルで標準搭載。 - **Gemma Scope** (ソフトウェア): Googleのメカニスティック解釈可能性ツールキット。Gemma 3モデルの全層にわたるアクティベーションを分析し、2025年12月にペタバイト規模のアクティベーションデータとともにリリース。 - **Gemini Diffusion** (ソフトウェア): Googleの実験的なテキスト生成向け拡散Transformer(画像ではない)。Google I/Oで発表。主な利点は推論速度。 - **Kaggle** (組織): コンペ・ベンチマークプラットフォーム。Google DeepMindに加わり、コミュニティが作成した評価をGeminiの能力フィードバックループに統合。 - **Google DeepMind** (組織): Googleの統合AI研究機関。Gemma、Gemini、ロボティクス、オンデバイスML、メカニスティック解釈可能性を横断する広いスコープを持つ。 - **AI Engineer London** (組織): 応用AIエンジニアリング会議(2026年版)。インタビューの収録場所であり、DeepMindの本拠地。 - **MoE (Mixture of Experts)** (概念): トークンごとに一部のパラメータのみを活性化するスパースアーキテクチャ。同等のパラメータ数のdenseモデルより推論が速いが、分布に敏感なルーティングによりファインチューニングが難しい。 - **Per-layer embedding** (概念): Gemma 4のアーキテクチャ変更点。各Transformer層にルックアップテーブル型の埋め込みを挿入することで、行列積のコストなしに30億パラメータをGPUの外に置ける。 - **Intelligence per parameter** (概念): Gemma 2→3→4にわたって改善されてきたパラメータあたりの能力密度。総パラメータ数を約30Bに保ちながら性能を伸ばしてきた指標。

#gemma#google-deepmind#open-models
AI Agents Need Computers: 74% MoM Growth, 850K/Day Runs, & New Agent Cloud — Ivan Burazin, Daytona
1:11:40
EN/ZH
2 ヶ国語で視聴
Latent Space14日前

AI Agents Need Computers: 74% MoM Growth, 850K/Day Runs, & New Agent Cloud — Ivan Burazin, Daytona

Ivan Burazin, CEO of Daytona, discusses the massive shift from building developer environments for humans to providing composable computers for AI agents. With 74% month-over-month growth and 850,000 daily runs, Daytona provides the bare-metal infrastructure required for stateful, high-performance agentic workflows. This conversation explores the technical challenges of spiky compute, the $10 trillion computer-use market, and why the future AI cloud will look more like Stripe than AWS. ## [00:00] Hook Ivan Burazin describes the intense, direct demand for Daytona's infrastructure, with potential users calling him personally to request access. This level of interest signaled a massive, untapped market for providing execution environments to every future AI agent. The team realized they had identified a critical missing piece in the AI development stack. > *I've never experienced this that people literally call you if you do not give them access. Like they want access right now.* > *[0, 0]* > * ] }, { * > *title": "Introduction* > *{'start': 72.0, 'summary': "Host swyx introduces Ivan Burazin, noting their shared history in the developer experience and 'end of localhost' movements. Ivan recalls reaching out to swyx years ago for advice on developer experience while working at a previous role. They reflect on how their early interactions and mutual interests in cloud-based development tools eventually led to their current collaboration.", 'quotes': ['I was one of the co-founders of code anywhere... we were thinking a long time of like local host should die.', [1, 36], '\n ]\n },\n {\n ', 'title": "CodeAnywhere', 'Shift', 'and the end of localhost', {'start': 195.0, 'summary': 'Ivan discusses his long history with his co-founder, dating back to early 2000s virtualization and the creation of CodeAnywhere. As the first browser-based IDE, CodeAnywhere predated modern infrastructure like Docker and Kubernetes, which provided the team with deep foundational knowledge. After a successful run with the Shift developer conference, they returned to their infrastructure roots to launch Daytona.', 'quotes': ['We originally started stacking stacking servers doing like virtualization in the early 2000s... and that was a services company which we sold.', [3, 38], '\n ]\n },\n {\n "title": "What Daytona is: composable computers for AI agents",\n "start": 358.0,\n "summary": ', "Ivan defines Daytona as a provider of 'composable computers' for AI agents", "moving beyond the limited industry term 'sandboxes.' He explains that agents require diverse computing environments tailored to specific tasks", 'much like different hardware setups for human professionals. This API-driven infrastructure allows agents to execute code in production-grade environments rather than just temporary test boxes.', {'quotes': ['What Daytona is today is essentially composable computers for AI agents... the market calls them sandboxes which [is] misleading.', [6, 41], '\n ]\n },\n {\n ', 'title": "The pivot from dev environments to AI sandboxes', {'start': 487.0, 'summary': "Ivan explains how observing early agents like Devon and OpenHands led to a realization that AI agents require a dedicated compute runtime. While their initial SaaS offering for human automation saw low traction, it attracted developers who specifically needed sandboxes for their agents. This feedback loop revealed a massive, underserved market for agent-specific infrastructure that standard cloud providers weren't addressing.", 'quotes': ['a lot of people reached out that were building agents and they were like hey my agent needs a compute sandbox runtime', [8, 50], '\n ]\n },\n {\n ', 'title": "The New Year’s Eve MVP and customers begging for API keys', {'start': 617.0, 'summary': "On New Year's Eve, Ivan 'vibe-coded' the first MVP of what would become the new Daytona. Although the CTO initially dismissed the code as 'garbage,' the core idea was strong enough to warrant a two-week professional rebuild. When they demoed this version to previous skeptics, the response was immediate and overwhelming, with users demanding API access before the calls even ended.", 'quotes': ["I've never experienced this that people literally call you if you do not give them access.", [12, 18], '\n ]\n },\n {\n ', 'title": "Bare metal', 'stateful sandboxes', 'and Daytona’s scheduler', {'start': 776.0, 'summary': "The team approached the technical architecture from first principles, deciding to run on bare metal rather than traditional VMs. They aimed to combine the speed of AWS Lambda with the stateful, long-running nature of an EC2 instance. This allows agents to 'pause and come back' to their work, much like a human closing a laptop lid, without losing state or performance.", 'quotes': ["agents will be like humans in the sense of you don't want your laptop to be shut down until you're done with work", [13, 57], '\n ]\n },\n {\n ', 'title": "60ms startup', 50, 0, 'sandboxes', 'and 850K daily runs', {'start': 1048.0, 'summary': "Daytona's infrastructure is optimized for both individual speed and massive concurrency, with a single instance spinning up in just 60 milliseconds. This scale supports high-volume customers who perform nearly 850,000 runs daily, with some requesting capacity for half a million concurrent CPUs. The system utilizes a custom scheduler and local NVMe drives to eliminate network latency and maximize IOPS.", 'quotes': ['Our time to spin up one is 60 milliseconds with network latency... if you want to spin up 50,000 at once, we are now at about 75 seconds.', [17, 40], ',\n ', 'The biggest customer of ours does like about 850', 0, "every single day is sort of where they're where they're just shy of a million.", [18, 17], '\n ]\n },\n {\n ', 'title": "Spiky RL/eval workloads and the new agent infra problem', {'start': 1313.0, 'summary': "The 'spiky' nature of AI workloads presents a major challenge for compute providers, leading to a mean utilization rate of only 15% despite peaks hitting 90%. Workloads are categorized into 'background agents' that follow human cycles and 'evaluations/RL' which fire off massive bursts of activity at unpredictable hours. To manage this, Daytona must use capacity commits to handle sudden bursts of 100,000 or more CPUs.", 'quotes': ["Daytona's mean utilization is 15%... because it's very spiky. But it's very spiky but we get up to 90%.", [23, 1], '\n ]\n },\n {\n ', 'title": "RL workloads', 'Kubernetes pain', 'and dynamic resizing', {'start': 1692.0, 'summary': "Daytona competes primarily against managed Kubernetes services like EKS and GKS, positioning itself as a more ergonomic 'Twilio or Stripe' for compute. Unlike Kubernetes, Daytona offers a seamless API for spinning up sandboxes with significantly faster startup times. A key advantage is the ability to dynamically resize sandboxes on the fly to prevent out-of-memory (OOM) errors, a feature difficult to implement on other platforms.", 'quotes': ["Daytona although it's a compute provider it's more akin to a Twilio and Stripe from a consumption perspective than it is an AWS", [29, 46], '\n ]\n },\n {\n ', 'title": "Why every AI agent needs a computer', {'start': 2011.0, 'summary': "Ivan outlines the massive scale of knowledge work, estimating a $50 trillion global salary pool, much of which is locked in legacy Windows applications. He argues that true automation requires 'human emulators' that can interact with these legacy systems via GUIs when APIs are incomplete. By automating 40% of this work, the market opportunity for agentic computer use reaches approximately $10 trillion annually.", 'quotes': ['If you take 40% of that, you get to essentially like 10 trillion dollars a year.', [35, 20], '\n ]\n },\n {\n ', 'title": "macOS sandboxes and Apple’s licensing problem', {'start': 2328.0, 'summary': "The discussion shifts to the difficulties of hosting Mac OS sandboxes compared to Windows and Linux. Apple's restrictive licensing only allows two parallel VMs per machine and requires a 24-hour lock-in for users, making per-second billing economically unfeasible. Furthermore, security restrictions prevent moving memory snapshots between physical machines, severely limiting the scalability of agentic workloads on Mac hardware.", 'quotes': ['Apple is shooting itself in the foot... if it would just enable a concurrency model similar to what you can get on a Windows.', [40, 52], '\n ]\n },\n {\n ', 'title": "Why CLI may matter more than MCP', {'start': 2668.0, 'summary': "The discussion compares the Model Context Protocol (MCP) to the Command Line Interface (CLI) for agentic action. While MCP acts as an interface for APIs, the CLI allows agents to execute scripts and perform deep data analysis within a sandbox. This layer of indirection enables more complex agentic workflows beyond simple data retrieval, allowing agents to actually 'do things' rather than just integrate.", 'quotes': ['the MCP is an interface against an API whereas the CLI is like you can actually go do things... the difference between integrations and actually running scripts.', [45, 34], '\n ]\n },\n {\n ', 'title": "Open source', 'GitHub stars', 'and agent integration', {'start': 2891.0, 'summary': "Ivan details Daytona's transition to an AGPLv3 license for its sandbox product to balance openness with commercial protection. This 'copyleft' approach allows enterprise use but prevents competitors from building proprietary forks without contributing back. Keeping the core engine transparent builds trust with users and allows large enterprises to bypass lengthy security audits by providing agents with full context.", 'quotes': ["in the new sandbox product we did add a AGPL3... you essentially can't make a competitor without open sourcing your stuff.", [49, 49], '\n ]\n },\n {\n ', 'title": "Git', 'CI/CD', 'and agent collaboration bottlenecks', {'start': 3191.0, 'summary': 'Current versioning systems like GitHub are often too slow for the high-velocity output of AI agents, leading to bottlenecks in CI/CD pipelines. Some developers are creating makeshift solutions like dumping codebases into JSON files on S3 to bypass Git overhead. There is a growing need for an agent collaboration layer that precedes the traditional Git-based pipeline to handle companies generating over 1,000 PRs per day.', 'quotes': ["GitHub as-is was an overhead... it wasn't fast enough what they needed.", [54, 3], '\n ]\n },\n {\n ', 'title": "Founder life and building a 25-person infra company', {'start': 3495.0, 'summary': "Daytona's success stems from a core team of 13 people who have worked together for over seven years, fostering a high-trust culture. Ivan acknowledges the difficulty of the founder journey, including being away from family, but posits that growth requires 'pain.' He views his work as building the spiritual successor to serverless and Kubernetes for the agent era, requiring radical responsiveness as a differentiator.", 'quotes': ['Of the 25 people in Daytona, I think about 13 of them we have worked with seven years plus.', [58, 57], '\n ]\n },\n {\n ', 'title": "AI SaaS', 'token resale', 'and API-first business models', {'start': 3764.0, 'summary': 'Ivan presents a critical take on the SaaS ecosystem, arguing that the market is incorrectly applying a premium to vendors who simply resell AI tokens. He points out that these models have significantly worse margins than traditional SaaS. Instead, he advocates for companies to expose their data via APIs and charge for consumption, allowing for actual revenue acceleration through increased agentic usage.', 'quotes': ["The market is adding premium to SAS vendors that are reselling tokens. And I think that's incorrect.", [62, 54], '\n ]\n },\n {\n "title": ', 'GPU sandboxes', 'data centers', 'and compute growth', {'start': 3970.0, 'summary': 'Daytona plans to introduce GPU sandboxes to support workloads like 3D rendering and reinforcement learning on CAD, rather than focusing on inference. While the company currently runs on bare metal via colocation providers, Ivan notes they are architected to potentially own data centers in the future. He currently avoids the high capital risk of building data centers for single-digit margin gains.', 'quotes': ['We will [offer GPUs], but not for inference. Like essentially what we think about is like the GPU sandbox.', [66, 21], '\n ]\n },\n {\n ', 'title": "Why the AI cloud may look more like Stripe than AWS', {'start': 4188.0, 'summary': "The conversation concludes by imagining the 'AWS for AI Agents,' which Ivan suggests might look more like Stripe than a traditional cloud provider. This future 'AI Cloud' will integrate sandboxes, web search, and databases as fundamental primitives. While companies like Cloudflare and OpenAI are competing for this space, Ivan hints that many more infrastructure primitives for agents are yet to be developed.", 'quotes': ["There will be a cloud built out specifically for agents and so that cloud will have sandboxes and it will have web search and it'll have databases.", [70, 47], '\n ]\n },\n {\n ', 'title": "Closing thoughts', {'start': 4286.0, 'summary': 'The discussion ends with the observation that the AI infrastructure market is growing at an unprecedented baseline of 40-75% month-over-month. Ivan and swyx reflect on the race to secure hardware and the shift toward specialized agent clouds that will define the next decade of computing.', 'quotes': ["The entire infrastructure market is growing 40% plus or minus month over month... if you're not growing 40%ish... you don't have to come to work.", [68, 23], '\n ]\n }\n ],\n ', 'entities": [\n {\n "name": "Ivan Burazin', {'type': 'person', 'description': 'CEO of Daytona and co-founder of CodeAnywhere.'}, {'name': 'swyx', 'type': 'person', 'description': 'Host of Latent Space and early investor in Daytona.'}, {'name': 'Daytona', 'type': 'organization', 'description': 'A company providing composable computers and sandboxes for AI agents.'}, {'name': 'CodeAnywhere', 'type': 'organization', 'description': 'The first browser-based IDE, co-founded by Ivan Burazin.'}, {'name': 'Devon', 'type': 'product', 'description': 'An early AI software engineer agent.'}, {'name': 'OpenHands', 'type': 'product', 'description': 'An open-source AI agent project formerly known as OpenDevin.'}, {'name': 'Kubernetes', 'type': 'technology', 'description': "Orchestration technology mentioned as a competitor to Daytona's ergonomic API."}, {'name': 'Apple', 'type': 'organization', 'description': 'Mentioned regarding restrictive Mac OS virtualization licensing.'}, {'name': 'Salesforce', 'type': 'organization', 'description': 'Cloud-based software company mentioned for its API-first strategy.'}, {'name': 'GitHub', 'type': 'organization', 'description': 'Developer platform noted for being a bottleneck in agentic CI/CD workflows.'}, {'name': 'Nvidia', 'type': 'organization', 'description': 'The primary provider of GPUs whose supply constraints dictate market growth.'}, {'name': 'Stripe', 'type': 'organization', 'description': 'Used as a comparison for the consumption-based model of the future AI cloud.'}], 'tags': ['ai-agents', 'infrastructure', 'sandboxing', 'bare-metal', 'cloud-computing', 'developer-tools', 'computer-use', 'saas-growth'], 'seo_title': "AI Agents Need Computers: Ivan Burazin on Daytona's Pivot", 'seo_description': 'Ivan Burazin explains why AI agents need composable computers and how Daytona pivoted from dev environments to 850K daily agent runs.', 'confidence': {'score': 0.98, 'rationale': 'The summary synthesizes multiple detailed chunks covering technical metrics, business strategy, and market philosophy with high fidelity to the source.'}}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}]}* ## [01:12] Introduction ## [03:15] CodeAnywhere, Shift, and the end of localhost ## [05:58] What Daytona is: composable computers for AI agents ## [08:07] The pivot from dev environments to AI sandboxes ## [10:17] The New Year’s Eve MVP and customers begging for API keys ## [12:56] Bare metal, stateful sandboxes, and Daytona’s scheduler ## [17:28] 60ms startup, 50,000 sandboxes, and 850K daily runs ## [21:53] Spiky RL/eval workloads and the new agent infra problem ## [28:12] RL workloads, Kubernetes pain, and dynamic resizing ## [33:31] Why every AI agent needs a computer ## [38:48] macOS sandboxes and Apple’s licensing problem ## [44:28] Why CLI may matter more than MCP ## [48:11] Open source, GitHub stars, and agent integration ## [53:11] Git, CI/CD, and agent collaboration bottlenecks ## [58:15] Founder life and building a 25-person infra company ## [1:02:44] AI SaaS, token resale, and API-first business models ## [1:06:10] GPU sandboxes, data centers, and compute growth ## [1:09:48] Why the AI cloud may look more like Stripe than AWS ## [1:11:26] Closing thoughts

The Agent-Native Cloud: Jake Cooper on Railway's Future
1:29:54
EN/ZH
2 ヶ国語で視聴
Latent Space15日前

The Agent-Native Cloud: Jake Cooper on Railway's Future

Jake Cooper, CEO of Railway, details the platform's evolution from a high-burn startup to a sustainable, bare-metal cloud infrastructure powering 3 million users. He argues that the rise of AI agents necessitates a fundamental rebuild of the cloud, moving away from human-centric tools like Kubernetes and pull requests toward high-density CLI handles and production forking. This conversation provides a roadmap for building modular, high-scale systems capable of supporting the next generation of automated software development. ## [00:00] Intro Jake Cooper argues that developers should stop writing code by hand and instead focus on reviewing agent-generated code to maintain architectural integrity. He emphasizes that while AI tools have improved significantly, underlying architectural patterns matter more than ever in an automated workflow. The hosts introduce Jake as the 'Conductor' of Railway, setting the stage for a discussion on the future of cloud platforms and developer experience. > *you should be reviewing the code that you are writing instead of trying to go and write it by hand.* > *[0, 10]* ## [01:19] What Is Railway? Railway is described as a platform that allows users to deploy applications and databases instantly via a canvas or AI prompts like Claude. Jake explains that the goal is to manage software versioning and environment cloning to reduce the complexity of traditional tools like Docker and Kubernetes. By tracking all changes, Railway enables developers to fork production environments into parallel universes for safe validation without reproducing staging environments manually. > *railway is the easiest way to ship anything.* > *[2, 29]* > *we want to make it really easy for not just to like deploy things, but for you to almost like evolve applications over time.* > *[2, 49]* ## [03:26] Jake’s Path to Railway Jake details his professional journey from front-end work at Wolfram to building distributed systems for Jump bikes at Uber using Cadence. He describes his engineering philosophy as a willingness to 'swim to the bottom of the pool,' which includes writing kernel patches to ensure the best possible user experience. Additionally, he critiques GitHub's architecture, specifically the 'broken pointers' created by cloning, which complicates upstream contributions. > *we will swim to the bottom of the swimming pool to go and get the experience* > *[4, 35]* > *GitHub's original sin is that it's like almost a series of broken pointers.* > *[6, 2]* ## [07:32] Railway’s Six-Year Growth Story Jake presents a growth chart illustrating the rapid increase in daily signups for the Railway platform, which has transitioned from a 'slow grind' to adding 100,000 users weekly. Early growth was driven by high-touch interaction on Discord and a determination to acquire the first 100 core users manually. This visual data serves as a transition into the company's history of scaling and its move toward becoming a primary cloud provider. > *so I just wanted to like pull up this glorious chart you say which is basically your usage or number of daily signups* > *[7, 34]* > *Trying to get those initial like first 100 users to like actually kind of come back to it.* > *[8, 21]* ## [10:11] Rebuilding the Business After the Free Tier At one point, Railway was losing $500,000 a month while only generating $50,000 in revenue, despite having $20 million in the bank. Cooper realized this was an unsustainable business model and chose to prioritize long-term viability over vanity metrics, temporarily closing the free tier to rebuild. The company now maintains a lean team of 35 people, preferring to build automated systems rather than throwing headcount at problems. > *We basically had to kind of close off the the free kind of users for a little while, rebuild the business.* > *[11, 47]* > *We're 35 people right now... we don't want to just like add headcount for the sake of headcount.* > *[10, 52]* ## [12:36] Agents as the Next Software Platform Over the last six months, Railway has prioritized 'agentic' development as the primary mechanism for building and deploying software. Cooper believes the industry is moving from assembly and high-level languages to 'words' as the primary interface. He envisions a future where thousands of agents run in parallel, requiring new tools for coordination and version control to manage the super-exponential growth of workloads. > *We've moved from assembly to C to C++ to JavaScript to now like words.* > *[13, 23]* ## [14:48] Railway’s Infrastructure Philosophy Jake Cooper explains that Railway prioritizes control over low-level primitives like network, compute, and storage to optimize for AI agent workloads. By avoiding Kubernetes in favor of custom orchestration, the team can place workloads with high precision to ensure memory efficiency. This level of control is necessary to prevent cost structures from ballooning as agent usage increases and requires thousands of parallel instances. > *you have to be very very efficient with these agents... or you're going to massively massively blow up your cost structure* > *[15, 10]* > *How do you get agents to coordinate? How do you go and get them to be able to like safely version changes?* > *[14, 28]* ## [17:01] Bare Metal, Cloud Economics, and the Compute Crunch Cooper describes the transition to bare metal as highly lucrative, reporting a payback period of just three months compared to cloud rental costs. This strategy allows the company to achieve 70% margins while leveraging hardware that remains viable for several years. He also notes the surprising appreciation of hardware assets, such as RAM, due to the global compute shortage and supply chain constraints. > *our payback period when we go to to metal... if we rent it in the cloud, our payback period is about 3 months.* > *[17, 2]* > *hardware and all of this stuff is... appreciated in value because RAM has gone up* > *[17, 50]* ## [18:41] Cloud Bursting and Five-Cloud Networking To maintain growth without being compute-constrained, Railway utilizes a hybrid cloud strategy for bursting capacity across AWS, GCP, and Oracle. This required building a custom network overlay capable of straddling five different cloud environments simultaneously. While this complexity led to past reliability challenges, it now allows Railway to scale rapidly regardless of individual provider quotas or hardware availability. > *I spent a weekend rebuilding our entire like network like overlay essentially so that we could straddle uh five different clouds* > *[19, 41]* > *we still maintain like cloud presence for like bursting essentially* > *[18, 52]* ## [21:39] Data Center Debt and Infra Financing Cooper highlights the strategic use of data center debt, secured against hardware, as a more efficient alternative to venture capital for infrastructure expansion. By treating compute capacity as a linear driver of revenue, Railway can scale as quickly as they can deploy new hardware. He encourages infrastructure startups to explore diverse financing tools rather than relying solely on expensive venture equity for physical assets. > *we can scale revenue as basically as quickly as we can scale compute* > *[21, 20]* > *our margins on metal are like quite high for the like 70%.* > *[20, 46]* ## [24:50] Data Centers in Space Jake Cooper and the hosts explore the technical challenges of placing data centers in space, specifically the issue of heat dissipation in a vacuum. Cooper expresses skepticism toward current proposals that ignore fundamental thermodynamic laws, comparing the 'figure it out later' mentality to science fiction. He highlights the difficulty VCs face in distinguishing between visionary ideas and technical 'grifts' in the space-tech sector. > *I haven't seen anybody like prove how you're going to go and dissipate that much heat in a vacuum* > *[25, 16]* > *how do you know what's like basically not possible and like is a grift versus like uh is possible but like sounds completely insane* > *[26, 16]* ## [26:43] What Agents Need From Infrastructure Cooper outlines the infrastructure needs of AI agents, noting they require versioning, observability, and storage similar to humans but at a 1000x scale. He predicts that current industry standards like Kubernetes and Envoy will become bottlenecks as agentic workloads compress development cycles. To support this growth, infrastructure must be modular enough to allow for the rapid replacement of failing components without human intervention. > *the workload profile doesn't change so much as it gets like massively massively compressed because you need to do thousands of these things* > *[28, 28]* > *you just need at a thousandx scale* > *[29, 13]* ## [29:43] CLIs, Canvas, and Agent-Native UX Cooper explains that while humans prefer simplicity, agents benefit from high-density CLI interfaces with numerous flags that serve as 'handles.' The Railway Canvas is also evolving into an output mechanism and 'context anchor' rather than just an input tool. This hierarchical view of infrastructure prevents critical knowledge from being siloed as teams scale complex 'hyperstructures' using automated agents. > *If you hand it to an agent and you say, 'Hey, that's 40 arguments and 600 flags.' Like, oh yeah, this is excellent.* > *[30, 35]* > *It has to be almost like an anchor for your context. It has to be like a port in the storm.* > *[34, 27]* ## [36:34] Central Station, Incidents, and Responsible Disclosure Railway utilizes an internal tool called Central Station to aggregate feedback and user context, moving away from static communication channels like Slack. The team emphasizes transparency by exposing real-time metrics and detailed incident reports, operating under a core value of 'honor.' This approach involves over-disclosing issues to users rather than providing vague or misleading information during outages. > *We'd rather overdisclose and know that you know that something is wrong versus almost like having your provider gaslight you.* > *[40, 22]* > *If you can dynamically aggregate that information and dynamically route it to the right person... this is no longer a manual process.* > *[37, 10]* ## [41:49] Safe Rollouts, SRE Agents, and Production Forks To mitigate the impact of bugs, Railway employs incremental rollouts and makes it easy to test behaviors in safe, shadowed environments. Cooper argues that production should not be treated as 'sacred' to the point of stagnation; instead, infrastructure should allow for trivial production forks. This is essential for AI agents, which face a 'stacking entropy' problem without safe iteration primitives to prevent system drift. > *We've built so much ceremony around like production is sacred... we need to get to a point where it's just trivially easy to test different behaviors.* > *[41, 33]* > *I think if you don't have the primitives to make iterating in production safe, it becomes very very difficult.* > *[44, 3]* ## [46:19] AI SRE, Specs, Code, and Tests Jake Cooper reflects on his transition from an AI skeptic to a believer, noting that the safety of AI SREs depends on infrastructure primitives. He advocates for the 'Holy Trinity' of software engineering: a clear specification, the code, and the tests. By aligning these three, developers and agents can reconcile discrepancies and maintain system integrity during rapid, automated iteration. > *If you just unleash an AI SRE on your production infrastructure... it's going to nuke your production database.* > *[46, 37]* > *You need three points essentially which is you need a clear spec... you need the code and then you need the tests.* > *[48, 22]* ## [49:43] Self-Replicating Infrastructure and the New Serverless The speakers explore the concept of agents using the Railway CLI to modify their own infrastructure, creating a self-replicating loop. This shift necessitates a move away from expensive, static virtual machines toward cheap, instantaneous 'atomic units of deploy' like isolates or sandboxes. The goal is to make throwaway copies of production as trivial and cost-effective as possible for agentic experimentation. > *The agent can like modify its own infra which I think is... yeah it's nuts.* > *[50, 4]* > *How do you go and make those throwaway copies like as trivial as possible to spin up run super cheap etc.* > *[50, 53]* ## [54:37] Heroku, Temporal, and Workflow Engines Cooper attributes the decline of Heroku to Salesforce's lack of focus on compute as a core business, leading to product stagnation. Railway positions itself as a 'fluid compute' provider, leveraging Cooper's decade of experience with Temporal (and its precursor Cadence) for durable workflows. Railway is a power user of Temporal, using it to manage complex, long-running infrastructure tasks at scale. > *The business of Salesforce is to build a really really good CRM... and then you acquire this business as a compute business that's kind of an offshoot* > *[55, 33]* > *I have used Temporal for almost like 10 years now, right? Because like Cadence, all of us other things.* > *[60, 5]* ## [1:05:26] Railpack, Nixpacks, and Lazy-Loaded Filesystems Railway is developing Railpack, an engine for determining source code dependencies, which evolved from their earlier Nix-based tool, Nixpacks. While Nix offers theoretical benefits for versioning, Railway found it caused significant image bloat and scaling issues for real-world workloads. They are now exploring content-addressable file systems to enable lazy loading of data into memory for faster deployments. > *If you want version X and version Y, you end up bloating a lot of your kind of like package like space.* > *[66, 2]* ## [1:07:20] Coding Agents, Token Spend, and Roadmap Acceleration With a monthly cloud spend reaching $300,000, Railway heavily incentivizes the use of AI coding agents among its employees. Cooper argues that manual code generation is an inefficient use of time, urging developers to focus on architectural patterns and code review. This allows the team to 'speedrun' their product roadmap by automating complex infrastructure tasks and test generation. > *If you are writing code by hand you are doing this wrong... you should be reviewing the code that you are writing.* > *[67, 37]* > *If you're not using the AI systems to almost like speedrun your road map... then you're kind of missing a large point.* > *[69, 12]* ## [1:12:15] The Pull Request Is Dying The traditional SDLC is undergoing a radical transformation where the pull request and manual code review are losing relevance. Impact is increasingly measured by the 'percentage of tokens that end up in production' rather than lines of code. As AI systems handle more reconciliation and validation, the focus shifts from the PR to the initial prompt and final deployment. > *The pull request is dying... it's going to be the prompt... and beyond that code review is also kind of dying.* > *[72, 23]* > *The really naive way to go in and measure this is almost like your percentage of tokens that end up in production.* > *[71, 40]* ## [1:13:47] Feature Flags and the Agent-Era SDLC Jake Cooper discusses the critical role of feature flagging in managing the 1000x compression of the SDLC driven by AI agents. He argues that incremental rollouts and blast radius management through flagging will become even more essential for safety as deployment speed increases. This culture of flagging allows for rapid experimentation without compromising system stability for enterprise customers. > *Everything's just going to get compressed by like a thousandx so that everybody can go and do that.* > *[77, 21]* ## [1:17:34] Cattle, Pets, and Cloning Machines Jake offers a contrarian view on the 'cattle not pets' philosophy, suggesting that snapshotting allows developers to treat infrastructure like 'pets' again. By snapshotting every frame and lazily loading file systems, the overhead of traditional DevOps tools like Dockerfiles is reduced. Railway even modifies the kernel to support persistent connections during these system snapshots. > *I think you can move towards having pets so long as... you have a cloning machine for your pets.* > *[78, 2]* > *If you can snapshot every single thing at every frame, then like it actually doesn't matter if you know that obliterated.* > *[78, 12]* ## [1:20:48] Solo Founder Lessons Jake reflects on his path as a solo founder, contrasting it with the Silicon Valley consensus of finding a co-founder. He emphasizes the need to be obsessed with every layer of the stack, from kernel-level changes to go-to-market strategies. He argues that having two co-founders can often lead to deadlocks without a clear tiebreak, whereas solo leadership allows for singular vision. > *Two is the worst number of co-founders is because you have no tiebreak... you basically are like, well, I disagree on this thing.* > *[82, 49]* ## [1:25:31] Focus, GPUs, and Building a New Cloud Railway is intentionally avoiding the GPU provider market for now to maintain its core mission, though Cooper admits GPUs are an inevitable part of their long-term roadmap. He stresses that companies are defined as much by what they choose not to do as by what they execute. The ultimate goal is full vertical integration to ensure a seamless experience from logic to execution. > *I think you're you're defined almost more by the things that you don't do than the things that you do* > *[86, 8]* > *I can tell you for a fact that we will not be doing GPUs now, but we 100% will be doing GPUs at some point.* > *[86, 50]* ## [1:29:39] Closing Thoughts Cooper reveals that Railway is moving toward 100% ownership of its data centers to avoid copying the infrastructure of legacy hyperscalers. By inventing their own infrastructure from scratch, Railway aims to support 'vibe coding,' where the friction between a thought and a live application is completely removed. This approach empowers a new generation of 'citizen developers' to build at the speed of thought. > *there should be no friction in between what your thought is and reality that kind of comes out.* > *[89, 4]* > *we've been very very deliberate to like invent our own infrastructure from scratch.* > *[88, 30]* ## Entities - **Jake Cooper** (person): CEO and 'Conductor' of Railway. - **Railway** (organization): A cloud platform designed for easy deployment and environment management. - **Uber** (organization): Jake's former employer where he worked on distributed systems for Jump bikes. - **Temporal** (software): A workflow orchestration platform used by Railway for reliable infrastructure tasks. - **Salesforce** (organization): The CRM company that acquired Heroku, leading to its perceived stagnation. - **Heroku** (organization): A pioneer PaaS platform that Railway is often compared to. - **AWS** (organization): Amazon Web Services, used by Railway for hybrid cloud bursting. - **GCP** (organization): Google Cloud Platform, one of the five clouds Railway straddles. - **Claude** (software): An AI model mentioned as an interface for deploying on Railway. - **GitHub** (organization): A code hosting platform discussed regarding its architectural flaws in versioning. - **Kubernetes** (software): An orchestration system Railway chooses to avoid for higher-order control. - **Central Station** (product): Railway's internal tool for aggregating user context and support feedback.

#cloud-computing#ai-agents#infrastructure
The Next War Is Already Here — Yaroslav Azhnyuk, The Fourth Law & Noah Smith, Noahpinion
1:59:28
EN/ZH
2 ヶ国語で視聴
Latent Space17日前

The Next War Is Already Here — Yaroslav Azhnyuk, The Fourth Law & Noah Smith, Noahpinion

Ukraine produced 4 million FPV drones last year; China could produce 4 billion. That asymmetry frames two hours of unusually concrete conversation between Yaroslav Azhnyuk — serial tech founder turned AI-drone builder at The Fourth Law — and economist Noah Smith, who has been writing about the economics of drone warfare since before most Western policy circles took it seriously. They cover the full tech stack (cameras, autonomy modules, fiber optic links, interceptors, a semiconductor fab under construction), a five-level autonomy taxonomy, an eight-dimension autonomous-battlefield framework, and China's manufacturing edge that has no near-term Western answer. The through-line: the West is still planning to fight the last war, Ukraine is the defense valley where the next war is already live, and the gap is widening faster than most people realize. ## [00:00] Cold Open: China's 4 Billion Drones and the Cameras-to-Explosives Pipeline Yaroslav opens cold with a single arithmetic comparison that structures the rest of the episode. Ukraine, not an industrial powerhouse, built 4 million FPV drones in a year. China, with an order-of-magnitude larger manufacturing base and a consumer electronics supply chain already producing the same cameras, motors, and chips, could produce 4 billion. Noah immediately asks whether that makes China the supreme conventional military power on earth right now. Yaroslav won't claim certainty, but won't rule it out either. > *"I don't think we have all the information to claim that, but we cannot count it out. And that alone should be, you know, a big warning sign."* The cold open also plants the personal pivot that the rest of the episode unpacks: Yaroslav went from making cameras that fling treats to pets to cameras that fling explosives to occupiers. ## [01:04] Introduction: Brandon, Noah Smith, and Yaroslav Azhnyuk Guest host Brandon normally runs a science podcast; this episode is the exception. Noah Smith — Noahpinion Substack, economist focused on industrial policy and geopolitics — is co-host and co-interviewer. Yaroslav sets the personal context: on February 23rd, 2022, he and his then-fiancée landed in Kyiv at 11 p.m. on what turned out to be one of the last flights into the city. Eight hours later, the bombs fell. The 17-hour drive west that followed — empty streets, gas stations out of fuel, pouring diesel into windshield-washer canisters — reads like a scene from an apocalyptic film because, for the people living it, it was exactly that. > *"We basically packed our belongings and got in the car and spent 17 hours riding west. That was exactly like that. I, you know, missiles are falling, like there was smoke in Kyiv."* ## [05:41] From Tech Entrepreneur to Defense: PetCube, Brave One, and the D3 Fund Yaroslav's path from pet-tech to defense wasn't a straight line. In San Francisco from 2014 to 2020 building PetCube (one of the leading pet-camera companies), he had never taken military coursework and considered wars a thing of the past. Day one of the invasion he knew he would fight back with everything he could — but weapons weren't the first instinct. Early efforts included lobbying U.S. Congress on Lend-Lease (passed May 2022, underdelivered), co-founding Brave 1 (Ukraine's defense-innovation cluster, analogous to DIU), and helping seed the D3 Fund co-started by Eric Schmidt. By 2023, two things became undeniable: the war would last, and drones had permanently redefined warfare — the first software-defined weapon platform in history, where a battlefield capability upgrade can be pushed overnight like a software update. > *"It's like if you were able to push a software update and get all of your Roman legionaries a new helmet. That has never been possible before."* ## [10:42] The Ethics of Building Weapons: Dual-Use Technology and the Wolf at the Door Brandon raises the dual-use problem: the technology won't stay in Ukrainian hands. Yaroslav's answer is pragmatic rather than philosophical. Every technology from fire to large language models is dual-use; the question for a maker is whether the marginal risk of their contribution outweighs the immediate need. Ukraine is in a forest with a wolf. You deal with the wolf first, then consult Greenpeace. He's clear-eyed that no technology stays contained — the parallel concern about LLMs freely available in North Korea and Russia applies equally to drone autonomy — but frames his own company's responsibility narrowly: they supply to the Ukrainian government and armed forces, not to arbitrary buyers. > *"When you're in a situation where you're in a forest in front of a wolf, you know, you first going to deal with a wolf that wants to eat you and then you're going to go consult Greenpeace."* ## [14:01] The Tech Stack: Cameras, Autonomy Modules, Interceptors, and a Semiconductor Fab The Fourth Law's structure is three interlocking business units. Cameras (daytime and thermal, sold to 200+ Ukrainian drone manufacturers). Drone autonomy modules (sold to the same ecosystem). And UAV products sold direct to the armed forces: FPV strike drones, bombers, Shahed interceptors, and ISR interceptors — drones that hunt Russian reconnaissance drones before they can relay targeting data. The thermal-camera arm is about to start construction on two semiconductor fabs to manufacture sensor chips in-house, driven by the realization that dependence on foreign sensor supply chains is a strategic vulnerability. > *"We're about to start construction of two semiconductor plants to make sensors for thermal cameras. That's super exciting for me as a computer science guy — doing semiconductor, super cool."* ## [18:47] Fiber Optic vs. AI: The Radio Horizon Problem and $32/km Cable The chapter is really about why radio-only FPV drones fail at long range — not just from jamming, but from the curvature of the Earth. Below roughly 60-100 meters altitude at 30-40 km range, a drone enters a radio shadow behind hills, forests, or the horizon itself. The pilot loses video and control precisely when closing on a target that is, by definition, on the ground. Fiber optic cable ($32/km, spooled from the drone) solves the shadow problem but adds weight, limits range, and reduces maneuverability. AI fills the gap differently: terminal guidance lets the drone complete the last few hundred meters autonomously even after the radio link breaks. The two approaches aren't mutually exclusive — you can run AI on top of a fiber optic link to command hundreds of drones with fewer operators. > *"If your drone goes low — and usually Russian infantry and vehicles, they're on the ground and you want to hit them, you need to go low — lower you go, maybe you'll get behind a hill or behind a forest, and if you're far enough you'll just get behind the curvature of the Earth."* ## [25:32] FPV Drones: The New God of War — 70–80% of Frontline Casualties Artillery was historically called "the god of war" because it caused 80% of battlefield casualties. On the current Ukrainian front line, 70-80% of casualties are inflicted by FPV drones — the same fraction, a different weapon. Tanks, designed to dominate land warfare for decades, are now routinely destroyed by $400 consumer-grade quadcopters because armor was never built to defend against attacks from directly above. The trajectory follows the same curve as calculators becoming irrelevant once smartphones arrived: not a linear substitution but an exponential displacement where the new technology's influence grows nonlinearly. > *"They used to say that artillery is the god of war because artillery used to cause like 80% of casualties, and now on that ranking FPV drones rule."* ## [28:28] The Five Levels of Drone Autonomy: From Terminal Guidance to Full Autonomy Yaroslav lays out five autonomy levels describing where the field stands and where it's heading. Level 1 is terminal guidance — the drone flies under human control and locks onto a target only in the final seconds. Level 2 is bombing — dropping munitions from altitude without directly ramming a target. Levels 3-4 introduce increasing target-selection and navigation independence: the drone can identify radio-emitting equipment, track vehicles, or navigate through GPS-denied environments. Level 5 is full autonomy — launch-and-forget, no human in the loop for any mission phase. Current battlefield deployment sits mostly at Levels 1-3. The jump to higher levels isn't primarily a technical problem anymore; it's a deployment, doctrine, and trust problem. Human confirmation remains in the loop at every stage involving lethal targeting decisions — for now. > *"Technology progresses and its influence grows nonlinearly. It's all exponential."* ## [41:37] The Eight Dimensions of the Autonomous Battlefield The five autonomy levels describe a single drone's capability. The eight dimensions describe the full battlefield context those drones operate in. Dimension 1: level of autonomy (the five-level scale). Dimension 2: platform type (quadcopter, fixed-wing, missile, naval drone). Dimension 3: environment (day/night, urban/forest/open terrain). Dimension 4: target type (moving vehicle, static structure, radio emitter). Dimension 5: swarm size and coordination. Dimension 6: command-and-control architecture. Dimension 7: sensing modality (optical, thermal, RF). Dimension 8: infrastructure (simulation, data pipelines, security, deployment tooling). Each dimension interacts with every other. A Level-4 autonomous drone performing well in open daylight terrain may fail completely in a forest at night. Battlefield AI systems have to be evaluated across all eight dimensions simultaneously, not just on the single axis of autonomy level. > *"I say dimension because each of them works with another. It's crucial to understand how autonomy evolves in a modern battlefield environment."* ## [45:32] AI Safety and the Morality of Autonomous Weapons Yaroslav's position flips the standard AI-safety framing: in five to ten years, it will be *immoral* to use weapons *without* AI, because human-only weapons produce more collateral damage and friendly fire. He draws the analogy to manually driven cars — once autonomous vehicles are the norm, letting a human drive on a public road becomes the dangerous choice. Noah pushes to the logical endpoint: a Level-6 "AI general" — one large model that ingests all battlefield data and agentically selects targets, with humans reduced to repairing drones. Yaroslav says technically it could be done now. The constraint is deployment and trust, not capability. He references what was publicly described about AI-assisted target designation in the Iran operation: AI surfaces 127 targets, human reviews the list and presses okay. That's already close to an AI general with a rubber-stamp layer. > *"I think 5 to 10 years from now it will be immoral to use weapons without AI because weapons without AI will be more likely to cause collateral damage or unwanted damage."* ## [51:31] The End of the Rifleman? Noah's 2013 Prediction vs. Battlefield Reality Noah revisits a prediction he made in 2013: the rifleman is obsolete, replaced by standoff weapons. Ukraine both confirms and complicates it. FPV drones have unquestionably displaced the rifle as the primary instrument of attrition — but infantrymen haven't disappeared. They dig trenches, hold terrain, conduct logistics, and survive for months in dugouts under continuous drone threat by adapting: better camouflage, smaller movement signatures, drone-awareness drills. Yaroslav extends the timeline question to humanoid robots. The world is built for bipedal humans; there's genuine utility in a platform that can operate a rifle, open a door, or crew a vehicle. He puts a Terminator-style scenario — humanoid combat robots — at 10 years out, not science fiction. But modern warfare, they agree, is a multi-dimensional problem — dozens of drone types, land ops, reconnaissance, psychological operations, aviation, tanks, logistics — and the press focus on whichever technology is newest understates how much every layer still matters. > *"Modern warfare is really very complex and the fact that drones are the latest coolest thing doesn't mean that now it's that and only that."* ## [01:05:13] China's Manufacturing Advantage and Western Vulnerabilities This is where Noah Smith's economics background drives the conversation. The U.S.-China drone comparison isn't about unit price or autonomy level — it's about manufacturing throughput at scale. China's consumer electronics supply chain already produces the motors, cameras, chips, and battery cells that go into FPV drones. Switching that capacity to military production requires regulatory will, not retooling. Ukraine builds fixed-wing drones with 10 km range from hobby components; China can build fixed-wing drones with 200-300 km range at the same cost curve. The West's vulnerability isn't just quantity. It's thermal cameras (overwhelmingly sourced from China), semiconductor fabs (two generations behind on drone-relevant sensors), and procurement speed (a Western defense contract takes years to award; Ukraine iterates weekly). Yaroslav is optimistic about Western human capital — the engineers exist — but openly frustrated with European institutional inertia and uncertain about whether the U.S. has fully absorbed the lessons from Ukraine and the Middle East. > *"We don't have all the information to claim that, but we cannot count that out. If we want to keep the resemblance of our good past life, we have to do something about it."* ## [01:24:21] Policy Advice for Western Defense: Defense Valley and the Widening Gap Yaroslav's top policy prescriptions are framed around the William Gibson quote he attributes to Arthur C. Clarke: the future is already here, just not evenly distributed. Kyiv is Defense Valley — the place where the future of war arrived first, with hundreds of specialized companies, battle-tested commanders at every rank, and a government that learned to move at startup speed. Priority 1: deep integration with Ukraine's defense ecosystem, not just procurement but embedded learning. Priority 2: procurement reform — the drone-dominance initiative is the right direction and needs to scale 10x. Priority 3: long-range drone readiness for contested maritime environments (Shahed-class drones with 2,000 km range cover the entire Pacific island chain). He worries that the U.S. learned less from Ukraine than it should have and may be repeating the pattern with Iran. > *"Kyiv and Ukraine is sort of the defense valley. It's the point where the future of defense has already arrived, and there's a ton of things to learn from that."* ## [01:32:54] The Drone Race: Who's Ahead, Category by Category Russia was at parity or ahead in drone capability 18 months ago; Ukraine has since pulled ahead on FPV and autonomy. But Russia has a 4x population advantage and significantly more industrial capacity than Ukraine alone — scale disparity is why Western supply matters. The race breaks down by category: FPV strike (Ukraine leads), ISR reconnaissance (contested), glide bombs (Russia leads, dropping from bomber aircraft at scale), deep-strike drones (Russia leads on volume), and interceptors (Ukraine innovating rapidly, Russia catching up). Russia uses helicopters to intercept Ukrainian deep-strike drones — a costly but effective countermeasure revealing how each new offense spawns a tailored defense, at weekly iteration cycles. > *"Everyone says Russia's behind right now in the drone war. But that wasn't true a year ago."* ## [01:41:57] Countermeasures: Shotguns, Jammers, Lasers, and Fishnets Shotguns work — they're the primary kinetic countermeasure against incoming FPV drones — but only for a trained soldier who can hit a 20 cm target moving at 100 km/h under combat stress. Electronic jammers are the most widespread defense: block the radio or GPS link and the drone loses guidance. The catch is that the same spectrum the jammer blankets is often used by your own forces, and jammers are being defeated by frequency-hopping and fiber optic links. Russian tanks now look like porcupines — improvised metal cages and electronic-warfare antennas bolted on top to defeat top-attack drones. Ukraine's answer is shaped charges specifically tuned for the gap between the cage and the hull. Lasers are effective but expensive ($10M+ per system to kill a $400 drone) and slow to slew onto fast-moving targets. Fishnets — literally mesh nets — are being deployed around static positions because they're cheap, snag rotors, and require no power. > *"Then the tanks — if you look at Russian tanks and sometimes Ukrainian tanks or equipment — they all look like porcupines."* ## [01:58:19] The Wedding and Final Takeaway: Be Prepared for War Brandon closes with two questions. First: did Yaroslav actually get married in that chapel on February 23rd? They got legally married, but postponed the reception until the war is over. Second: one takeaway for the audience. Yaroslav's answer is a restatement of the Roman proverb: *si vis pacem, para bellum*. > *"You want peace, be prepared for war. Got to invest in defense and security."* ## Entities - **Yaroslav Azhnyuk** (Person): Founder of The Fourth Law (AI drone autonomy + thermal cameras, Ukraine); previously co-founder of PetCube; co-founder of Brave 1 and D3 Fund; born and raised in Kyiv. - **Noah Smith** (Person): Economist; author of the Noahpinion Substack; co-host for this episode; focus on industrial policy, manufacturing economics, and geopolitics. - **Brandon** (Person): Regular Latent Space host (science podcast background); guest host for this episode. - **The Fourth Law** (Organization): Yaroslav's AI-guided drone company; three business units — thermal cameras, drone autonomy modules, UAV products (FPV strike, bombers, interceptors). Leading drone-AI team in Ukraine. - **PetCube** (Organization): Consumer pet-camera company Yaroslav co-founded in San Francisco (2014–2020); the origin of the "cameras that fling treats / cameras that fling explosives" pivot. - **Brave 1** (Organization): Ukraine's defense-innovation cluster; analogous to DIU (Defense Innovation Unit) in the U.S.; co-founded with Yaroslav's involvement. - **D3 Fund** (Organization): Defense-tech investment fund co-founded with Eric Schmidt (ex-Google CEO) to accelerate Ukraine's drone ecosystem. - **FPV Drone** (Concept): First-Person-View drone — pilot sees through onboard camera in real time; currently responsible for 70-80% of frontline casualties; dominant tactical weapon of the Ukraine conflict. - **Five Levels of Drone Autonomy** (Concept): Yaroslav's taxonomy from terminal guidance (Level 1) to full autonomous operation (Level 5); most current battlefield deployment is Levels 1-3. - **Eight Dimensions of the Autonomous Battlefield** (Concept): Yaroslav's framework for evaluating drone systems across platform type, environment, target class, swarm scale, C2 architecture, sensing modality, and infrastructure. - **Defense Valley** (Concept): Yaroslav's term for Kyiv/Ukraine as the global hub where the future of defense tech is already live — analogous to Silicon Valley for consumer tech. - **Radio Horizon** (Concept): Earth-curvature effect that cuts radio/video links to low-flying FPV drones at 30-40 km range; primary technical driver for fiber optic drone adoption. - **Shahed** (Concept): Iranian-designed loitering munition used by Russia; fixed-wing, up to 2,000 km range; archetype for long-range drone threats to Western bases and Pacific-scenario planning.

#drones#ukraine#defense-tech
Abridgeの内側:1億回の診察を聴くAI — Abridge の Janie Lee & Chai Asawa
1:06:38
EN/ZH
2 ヶ国語で視聴
Latent Space21日前

Abridgeの内側:1億回の診察を聴くAI — Abridge の Janie Lee & Chai Asawa

Abridge の Janie Lee と Chai Asawa が swyx と Redpoint の Jacob Effron に加わり、Latent Space × Unsupervised Learning のクロスオーバー回として、AIスクライブが医療の「臨床インテリジェンス層」へと進化した軌跡を語る。エアコン型のプロダクト哲学、事前承認のユースケース、臨床医サイエンティストと LLM ジャッジを中心に組まれた eval スタック、HIPAA がデータフライホイールをどう変形させるか、そして 1 億件超の医療会話を安定稼働させるために何が必要かを詳しく掘り下げる。 ## [00:00] イントロダクション Janie Lee のピッチから始まる。コンテキストがすべてであり、アラートは受動的から能動的へ転換すべきで、プロダクト自体はエアコンのように背景に溶け込み、臨床リスクがあるときだけ動き出すべきだという考え方が示される。続いて swyx が短いリスナーへの呼びかけを挟み、広告なしで購読を促す。 > *「私たちがよく言うのは、プロダクトをエアコンのように感じてほしいということです。背景でこっそり物事をよくしていればいい。」* — Janie Lee ## [01:17] Abridge が解決すること swyx が年次の Latent Space × Unsupervised Learning クロスオーバーとして紹介し、Redpoint が Abridge に投資しているため Jacob Effron が参加していると説明する。Janie は Abridge を医療システム向け臨床インテリジェンス層と位置づけ、ドキュメンテーションから話を始める。臨床医は週に 10 〜 20 時間かけてノートを書いており、患者と臨床医の会話は、請求・支払い・診断といったほぼすべての下流成果物の起点にある。Chai は、患者・支払者・ガイドライン・文献すべてのコンテキストを押さえれば、受診前後を含むあらゆる接点が対応可能になると補足する。 > *「Abridge は医療システム向けの臨床インテリジェンス層です。私たちはドキュメンテーションから始め、臨床医のために構築してきました。」* — Janie Lee ## [03:22] 周囲記録から臨床インテリジェンスへ Janie は Abridge の 3 つの「幕」を辿る。時間を節約する(医師が夜の時間を取り戻せる元々のスクライブ製品、いわゆる「パジャマタイム」)、医療システムの収益を守り拡大する(記録的な低い営業利益率のなかで)、そして最終的には命を救う。週に何百万回も開かれ、受診の前後を問わず使われるという事実が、この拡張を実現可能にしている。 > *「『パジャマタイム』と呼ばれています……仕事後にパジャマ姿で、毎日ノートの書き込みや整理をしている医師たちのことです。」* — Janie Lee ## [05:21] 臨床意思決定支援とコンテキストの重要性 Jacob が Abridge の臨床意思決定支援と Chai の前職 Glean での経験を比較する。Chai の対比はこうだ。Glean では誤答は不便で済むが、医療ではリスクが高く、ユーザーの接点ははるかに狭い。扱うペルソナは少ないが、すべての出力が確実に届かなければならない。それがオフライン評価から段階的ロールアウトまですべてを形作り、過去 10 年のハッカソンで毎回挑戦されてきた「あなたを本当に知るアシスタント」という Jarvis ビジョンにもつながっている。 > *「Jarvis ビジョン——この 10 年で参加したどのハッカソンにも必ず Jarvis の競合チームがいた。でも Abridge はまさにその機会から生まれ、その方向に進み続けていると思う。」* — Chai Asawa ## [08:14] アラート疲労、プロアクティブ・インテリジェンス、事前承認 Jacob がアラート疲労の古典的な問題を提起する。エアコンの静寂を破り、実際に割り込むべきタイミングをどう判断するか。Janie の具体例は事前承認だ。現状では数週間後に届く MRI の却下通知を、患者がまだ診察室にいる間にリアルタイムのプロンプトへ変換できる。支払者のポリシー、EHR データ、過去の診断、クリニック固有のプロトコルを条件として組み合わせる形だ。ネックはデータの配管で、事前承認が機能するには、必要なすべての信号を正しいタイミングで組み合わせられなければならない。 > *「事前承認の例を実現するためだけでも、どれだけのデータが必要か考えてみてください。」* — Janie Lee ## [13:53] アンビエントAIのフォームファクターと医療顧客 swyx がフォームファクターを尋ねる。現在の主要な接点はモバイルだが、Abridge はデスクトップ、EHR 内ブラウザプラグイン、入院設定向けの院内デバイス、看護師向けワークフローでも動いており、AR も視野に入りはじめている。顧客は多層構造で、CMIO・CFO・CIO・臨床医・患者・支払者・製薬会社がそれぞれのループに存在し、支払者とのやり取りは Abridge の生データへの直接アクセスではなく構造化データ交換を通じて行われる。 > *「アンビエント AI についてよく話されていますね。主にスマートフォン上ですか?」* — swyx ## [18:16] 医療AIで最も難しい問題 Abridge で最も難しい AI の問題を一つ挙げるよう求められ、Chai は高品質・低レイテンシ・低コストのリアルタイム支援をハイステークスな臨床現場で実現することを選ぶ。支払者ポリシーの長テールをシステムが推論できる中間表現に変換することがその具体例の一つで、パレートフロンティアは常に動き続けており、既製品の進歩を待つのではなく自ら押し上げる必要がある。 > *「もちろんパレートフロンティアは常に変わり続けていますが、私たちはいまそれをやろうとしています。」* — Chai Asawa ## [19:43] フロンティアモデル、独自データ、モデル戦略 Jacob が既製品利用と自社開発の線引きを尋ねる。Chai の考え方は、フロンティアモデルが医療の一般知識を吸収し続けるなかで、Abridge の優位性は独自の医療会話データと、その上に積み上げられた専門科別の振る舞いにある、というものだ。エンドプロダクトの体験が最重要であり、ワークフローごとに組み合わせを変えながらモデル非依存の姿勢を保っている。 > *「これにはこれを使って、あれにはあれを使う。最終的に大事なのはベストなプロダクト体験だけです。」* — Chai Asawa ## [22:24] エージェントのファイルシステムとしてのEHR Chai が今後 1 年のフレームを示す。あらゆるエージェントは内部的にコーディングエージェントであり、医療においては EHR がファイルシステムとして機能する——現在のどのモデルのコンテキストウィンドウにも収まりきらない巨大な構造化情報の集積だ。Janie は、目標はあくまで臨床医を患者との対話に集中させることだと付け加える。会話をやり直すのではなく、適切なコンテキストを適切な瞬間に用意することが重要だ。 > *「ほとんどすべてのエージェントは内部的にコーディングエージェントです。ファイルシステムが何であれ与えれば、自分のコードを書ける……EHR はファイルシステムとして考えることができます。」* — Chai Asawa ## [25:20] パーソナライズ、メモリ、臨床医の好み Jacob が Abridge の医師ごとのパーソナライズについて尋ねる。Janie の答えは階層構造になっている。個々の編集がシグナルになり、専門科ごとのデフォルトがその上に乗り、医療システムのポリシーがすべてを包む。Chai はメモリを新しい記録システムとして語る。訪問をまたいでシグナルを統合するバックグラウンドジョブは、人間の睡眠が記憶を整理するプロセスに似ており、モデルは編集と非編集の両方から「学習」していく。 > *「私たちにとってもう一つ興味深いのは、メモリがほぼ新しい記録システムの一つになっているということです。」* — Chai Asawa ## [31:57] Evals、LLMジャッジ、段階的ロールアウト Janie が eval スタックの全体像を説明する。社内臨床医が「LFD」ファーストパスレビューを行い、LLM ジャッジはそのアノテーション済みデータに対してキャリブレーションされ、サードパーティ評価者が独立したチェックを加え、専門科別 eval が汎用的なものでは見逃す問題を補足する。Chai は自動運転車のアナロジーを使う。現実との接触をできるだけ早くしたいが、それは段階的ロールアウトを通じてのみで、オフライン分布が本番分布と実際に一致するよう保ちたいと語る。 > *「現実とできるだけ早く接触したい。ただし段階的ロールアウトを経由して。どれだけオフライン eval セットを充実させても、その分布を実際の分布に一致させたいのです。」* — Chai Asawa ## [38:04] HIPAA、非識別化、プライバシー プライバシーはデータフライホイールのハード制約として扱われる。Chai は、オンライン eval やラーニングの基礎として使うデータはすべて非識別化が必要で、一方向処理でなければならないと説明し、そのためのエンジニアリングプロセスを整備していると語る。Janie は、顧客契約が Abridge 社内での PHI アクセス権限も制限しているため、学習データに還流できるものの基準は、ポリシー上だけでなく契約上も厳しいと補足する。 > *「私たちが使うデータはすべて非識別化されている必要があります。オンライン eval セットやラーニングの基礎として使う実世界データはすべてそうしなければなりません。」* — Chai Asawa ## [40:38] 1億件の会話とスケールでの運用 1 億件超の会話という規模では対応すべき問題が変わる。モデルルーティング、ポストトレーニング、信頼性バジェット、コール単位のコストがすべて一級の関心事になる。Chai は臨床医に提供できる知見について話し、タイムラインをさらに先まで延ばす。同じ会話データが最終的に患者や消費者への直接シグナルとしても機能し得ると語る。 > *「1 億件の会話というデータセットには膨大なものが詰まっています。臨床医に提供できるインサイトのようなものが想像できます。」* — Chai Asawa ## [45:27] EHR統合と臨床インテリジェンス層 swyx が EHR との関係を尋ねる。Abridge は深い相互運用性に多大な投資をしている。EHR パートナーシップは臨床医の採用において必須条件だが、Abridge がその上に積み上げる価値は別の次元にある——受診をまたいだコンテキスト、支払者を意識した推論、EHR 自体が構造的に生み出せない種類の臨床インテリジェンスだ。 > *「主要なパートナーの一つが EHR です。その関係がどんなものか気になります。」* — swyx ## [47:56] 医療規制、レイテンシ、ハイステークスAI Jacob が規制から Abridge が学んだことを尋ねる。Janie は一般的な語り口に反論する。医療 AI には実は追い風となる規制環境があり、基準が非常に高いからこそ、最も難しい問題がここで最初に解かれることになると言う。Chai は、フロンティアが動き続けることを承知しながら現在出荷している「巧みな工夫」について語り、そのうちいくつかは 5 年後には通用しなくなるという現実を受け入れていると話す。 > *「これは最も難しいAIの問題が最初に解かれる場所だと思います。基準がとても高いから。」* — Janie Lee ## [51:28] 臨床医サイエンティストと長テールの品質 Janie が Abridge 内部の「臨床医サイエンティスト」というロールを説明する。フルスタックエンジニアから「非常に機転の利くプロンプターまで」技術的なバックグラウンドを持つ医師たちで、プロダクトチームや eval チームに組み込まれている。LFD 基準を書く人たちが臨床的に有用な意味を実際に理解しているため、出荷するものの基準が上がる。swyx はこれを既知の弱点に対するアクティブラーニングと結びつけ、多くの AI ショップで失われた技芸だと評する。 > *「『臨床医サイエンティスト』というロールがあります。私たちのリーダーの一人が最近、彼らのことを『ミュータント』と表現していたのを聞きました。」* — Janie Lee ## [54:21] Glean からの教訓と耐久性のあるAIインフラ Jacob が Chai に Glean から引き継いだものを尋ねる。答えの多くは時間が経っても通用するものについてだ。コンテキスト層、イベントドリブンシステム、Kafka、Temporal、ソケット、Google ドキュメントの共同編集プレイブックから来た CRDTs。マルチエージェントシステムは人間と同じ競合解決の問題を引き継ぐ。過去 10 年のインフラパターンは捨てられるのではなく、目的を変えて再利用されている。 > *「イベントドリブンな技術は多い……Kafka、Temporal、ソケットなど、それらをどうまとめるかというのも実は耐久性があると思います。」* — Chai Asawa ## [58:20] エージェンティックな医療ワークフローの未来 より自律的な Abridge がどんな姿になるかを簡単に交わす。患者との関係における臨床医の役割を軸に置きながら、バックグラウンドでできることを増やす方向で——検査結果への反応、フォローアップの下書き、臨床医の関係を引き継ぐことなく代わりに能力を発揮する形で。 > *「患者との繋がりにおける臨床医の重要な役割を信じたうえで、臨床医の代わりにさらに多くの能力を発揮していきます。」* — Chai Asawa ## [58:51] PRD、プロダクトの明確さ、本格的なAIプロダクト構築 Jacob のクイックファイア質問:この 1 年で AI についての考えが変わったことは。Janie は一般論に反論する。プロトタイプがすべてではなく、PRD は死んでいない。プロダクトが複雑になり AI で動くようになるほど、きちんとした PRD の文章化訓練の重要性は増すのだと主張する。残りのセクションは、医療での本格的な AI プロダクト構築について——オーナーシップ、文章仕様の規律、デモ主導開発への抵抗だ。 > *「過激な意見はプロトタイプがすべてであり、PRD は死んだというものです。」* — Janie Lee(考えを変えた見解として) ## [64:28] Abridge でのAIコーディングツール swyx の定番アウトロ質問。Abridge は社内で Claude Code と Cursor を使っている。Jacob は半ば冗談で目標を挙げる——Claude が売上ゼロで 10 億ドル企業を動かすところを見てみたいと。 > *「Claude がやってくれると思います。売上ゼロで 10 億ドル企業を動かすところを見てみたい。」* — Jacob Effron ## [65:23] アウトロ Chai がリスナーを Abridge のウェブサイトに誘導する。ハルシネーション低減、evals などのホワイトペーパーが公開されている。swyx と Jacob が感謝の言葉とともに締めくくる。 > *「Abridge のウェブサイトにはたくさんのホワイトペーパーがあり、ハルシネーション低減など多くの興味深い取り組みをまとめています。」* — Chai Asawa ## 登場人物 - **Janie Lee** (人物): Abridge の初期から中核を担うオペレーター。臨床インテリジェンス層のプロダクト・商業面を担当。 - **Chai Asawa** (人物): Abridge の臨床意思決定支援リード。以前は Glean に在籍。 - **swyx** (人物): Latent Space のホスト。 - **Jacob Effron** (人物): Redpoint Ventures のパートナー。Unsupervised Learning ポッドキャストのホスト。 - **Abridge** (組織): 医療 AI 企業。臨床インテリジェンス層を構築しており、周囲記録から始まり、意思決定支援・事前承認・evals・EHR 統合へと拡大している。 - **Glean** (組織): エンタープライズ AI 検索企業。Chai の前職であり、水平展開と垂直特化の対比として参照される。 - **Redpoint Ventures** (組織): Abridge に投資するベンチャーキャピタル。Unsupervised Learning クロスオーバーの拠点。 - **EHR (Electronic Health Record)** (概念): 医療システムが基盤とする記録システム。Chai の定義では、医療エージェントのファイルシステムとして機能する。 - **Prior authorization(事前承認)** (概念): Abridge の中核ユースケース。数週間かかる支払者の却下を、受診中のリアルタイム案内へと変換する。 - **LFD プロセス** (概念): Abridge 内部の臨床医主導のファーストパスレビュー。LLM ジャッジのキャリブレーションと eval 基準の定義に使われる。 - **臨床医サイエンティスト** (概念): Abridge 独自のロール。技術的なバックグラウンドを持つ医師で、プロダクトチームや eval チームに組み込まれている。 - **段階的ロールアウト** (概念): Abridge の展開規律。実トラフィックの一部に限定してリリースし、オフライン分布の正直さを保つ。自動運転のリリースパターンを模している。 - **Claude Code** (ソフトウェア): Abridge が社内で使用する AI コーディングツール。 - **Cursor** (ソフトウェア): Abridge が社内で使用する AI コーディングエディタ。

#ai-healthcare#ambient-ai#abridge
⚡️ Matt Pocock - Why Engineering Fundamentals matter MORE now
22:02
EN/ZH
2 ヶ国語で視聴
Latent Space28日前

⚡️ Matt Pocock - Why Engineering Fundamentals matter MORE now

Matt Pocock joins swyx at AI Engineer Europe to argue that the old software design canon — DDD, deep modules, ubiquitous language — matters more, not less, in the AI coding era. The thesis: code is not just a compile target; a codebase that is easy for humans to change is easy for AI to change. Along the way they cover course-making, why traditional lectures still beat AI-native learning, and TypeScript's quiet takeover of AI engineering. ## [00:04] Opening at AIE Europe and the Cursed Course swyx welcomes Matt to the AI Engineer Europe podcast booth in London. Matt jokes that AIE is "the worst" event he has ever attended (the location is in fact astonishing) before turning to his Claude Code course, which is just wrapping up its two-week cohort. He explains why he runs short cohorts: AI moves so fast that self-paced courses cannot guarantee updates, and the "curse" of releasing into breaking changes — AI SDK v5 dropped on day two of his AI SDK v4 course, and the Claude Code source leaked during this one — is now baked in. The conversation then turns to teaching as a craft. Matt rejects the "pundit" branch of YouTuber identity — he is not trying to predict the future, only to teach durable material — and notes that being a teacher first is what differentiates his content. > *I'm not a guy who's trying to predict the future. I'm just trying to teach.* ## [02:51] Why Engineering Fundamentals Matter More with AI Matt previews his AIE talk. The popular narrative says code no longer matters because English plus an AI compiler can produce applications. Every time he tried to ignore the code, he ended up with "a terrible mess." So he went back to the classics — *Extreme Programming*, *The Pragmatic Programmer*, *A Philosophy of Software Design*, DDD — and discovered they ported directly into prompts. Keeping the architecture in your head, even when you delegate implementation, yields outsized dividends. > *If you have a code base that's easy to change for humans, it's going to be easy for AI to change, too.* ## [04:23] Narrow Waist and Deep Modules swyx introduces the "narrow waist" concept from internet architecture (TCP/IP, HTTP at layers 3–4) as a way to contain AI-generated slop: define rigid interfaces, delegate the inside. He extends it to running AIE as a nine-person business — "model-view-claw" instead of MVC, where coordination across people and AI is the real systems problem. Matt maps this onto John Ousterhout's notion of *deep modules*: a large amount of functionality behind a simple interface, ports and adapters style. This is, in his experience, the best way to use AI for coding — be intentional about the interface as a human, then delegate the implementation. > *Deep modules basically — a large amount of functionality with a simple interface. Kind of ports and adapters, right?* ## [06:37] Domain-Driven Design Meets AI DDD is having a moment, and Matt argues it works *because* the framework has been around long enough to sit in the latent space of these models. You do not have to invent new vocabulary; you can bolt on a system that is composable and that the model already understands. The deeper point: DDD is fundamentally about aligning code with language, which is exactly what you want when speaking to an AI. He makes it concrete with the `mattpocock/skills` repo (≈13k stars) and its "ubiquitous language" skill — a Claude Code skill that scans your codebase, surfaces the arcane jargon, and refines it with you into a markdown file he keeps open while prompting. He references it from `agents.md` but does not paste it wholesale, so the agent finds it when searching for those terms. > *Essentially, you're trying to create a unified domain model so that the AI and you are speaking the same language.* ## [10:05] Teaching as an Overpowered Skill swyx asks how Matt got so good at explaining things. Matt credits six years as a voice coach before becoming a developer — communication felt like an unfair advantage when he started as a junior. He has since narrowed his focus: split time between learning material and finding the right phrases for it. The old texts help because they give him pre-built mental models to explain new ideas through. He walks through his course-making process: an "explore and exploit" phase, a Zettelkasten-style Obsidian vault, a custom planning app, P1/P2/P3 prioritization, and the rule that *each lesson teaches exactly one thing* with dependencies made explicit. Most of what he produces ends up on the cutting room floor. > *The ability to communicate always just felt like a ridiculous overpowered skill that I had in my locker that no one else had.* ## [13:20] How People Actually Learn AI Engineering The conversation turns to whether AI has changed how people learn. Matt distinguishes knowledge (lectures), skills (interactive exercises), and wisdom (small-group discussion — and now, talking to an AI). Counterintuitively, the more he leans into AI-experimental teaching, the more it turns his audience off. Most learners still want traditional lectures; swyx recalls Maven's cohort-based education arc landing in the same place. Matt's compromise is to force the work without forcing the form: in his TypeScript material he throws learners into a problem first and gives them the knowledge afterwards. > *The more I lean into the kind of AI experimental stuff, the more it actually turns people off my materials.* ## [15:04] TypeScript Overtaking Python swyx flags that TypeScript overtook Python in the GitHub survey this year — a shift he did not see coming, particularly in AI engineering where Python's expressiveness has been dominant on the backend. Matt's echo chamber is 100% TypeScript, but his real argument is ecosystem: when you care about UX and shipping chat-style applications, the framework gravity is in TypeScript (Vercel's Next.js, Cloudflare's variants). swyx admits this would meaningfully change which frameworks he promotes. > *If you're concerned about UX, concerned about shipping great stuff, you're mostly doing it in TypeScript.* ## [16:45] Inversion of Control and Composable Skills Matt looks ahead. His TypeScript-evals bet (Everlight) stalled — "no one's excited to do evals." The next frontier is *inversion of control*: as coding agents converge on similar architectures (Firebase-style backends, small tool sets), the interesting axis becomes how much control sits with the developer versus the harness. Claude Code's opacity buys ease of use but loses observability; Pydantic AI ("Pi") swings the other way — total control, total maintenance burden. He closes by pointing past coding agents entirely. Software engineers are a step ahead because AI produces quality output in their domain, but the composable skills he authors — like his three-sentence "grill me" skill that makes the AI interrogate you until you reach a shared understanding — generalize to any domain where you want the AI aligned with you. > *The inversion of control is going to be really important — you put more control in the hands of the developer and less in the harness.* ## Entities - **Matt Pocock** (Person): Creator of Total TypeScript and AI Hero; teaches TypeScript and AI Engineering through two-week cohort courses. - **Shawn Wang / swyx** (Person): Host; founder of AI Engineer and the AIE conference series. - **AI Engineer Europe (AIE)** (Organization): The London conference where this conversation was recorded; Matt's talk hit 1M views in 13 days — fastest in AIE history. - **AI Hero** (Organization): Matt's AI engineering education platform (aihero.dev). - **Claude Code** (Software): Anthropic's coding agent; subject of Matt's just-finished course and a recurring example throughout. - **Domain-Driven Design (DDD)** (Concept): Software methodology centered on aligning code with the language of the business domain; Matt argues it ports cleanly into AI prompting. - **Ubiquitous Language** (Concept): DDD practice of maintaining a shared vocabulary doc; Matt's namesake Claude Code skill scans a repo and refines this with the user. - **Deep Modules / Narrow Waist** (Concept): Architectural pattern (Ousterhout / internet protocols) of large functionality behind a small interface — Matt's preferred shape for AI-assisted codebases. - **mattpocock/skills** (Software): Matt's open-source repository of Claude Code skills; ≈13k stars at recording time. - **Pydantic AI (Pi)** (Software): Python agent framework built from low-level primitives; cited as the high-control counterpoint to Claude Code's opaque harness. - **Obsidian** (Software): Note-taking app reportedly run by a team of four; the example for non-engineering domains where AI leverage compounds.

#ai-engineering#software-design#typescript
🔬How GPT-5 derived new results in theoretical physics and quantum gravity — Alex Lupsasca, OpenAI
1:31:51
EN/ZH
2 ヶ国語で視聴
Latent Space30日前

🔬How GPT-5 derived new results in theoretical physics and quantum gravity — Alex Lupsasca, OpenAI

Alex Lupsasca — 2024 New Horizons Breakthrough Prize winner and OpenAI resident scientist — recounts how GPT-5 resolved a year-long open problem in quantum field theory: proving that single-minus gluon tree amplitudes are non-zero and finding their compact closed form. He then describes how the publicly available GPT Pro, given the gluon paper as a seed, independently generalized the result to graviton amplitudes in under three days of human clock time. Throughout the conversation, Lupsasca reflects on what this trajectory means for how physics is done, how the next generation of physicists will be trained, and where the remaining bottlenecks — verification, creativity, and publishing infrastructure — still lie. ## [00:00] Introduction to AI's impact on physics research Lupsasca opens in medias res, framing the episode's central claim before the formal introduction: AI has crossed a threshold where it can resolve questions that stumped human experts for over a year. He describes this not as a curiosity for theoretical physicists but as a profound, if underappreciated, change in the nature of scientific discovery itself. > *"That's a certain milestone that we've passed, and I think maybe for the average person on the street who doesn't care about theoretical physics, this is not very noticeable, but I think it's a very profound change and we've really passed some kind of a threshold."* ## [00:43] Guest introduction: Alex Luposka The hosts — Brandon (Atomic AI) and RJ Honicky (Miro Omix) — introduce Lupsasca as a Vanderbilt professor and OpenAI fellow who holds both the 2024 New Horizons in Physics Breakthrough Prize (often called the "Oscars for science") and the IUPAP Young Scientist Award. Lupsasca immediately sets the narrative arc: a year ago, AI was useful for email but not for his work; ChatGPT o3 was the first model that genuinely helped with research math; then GPT-5 reproduced one of his hardest published results in 30 minutes. > *"When GPT-5 came out it was able to reproduce one of my best papers that took me a very long time to come up with in like 30 minutes. And that's when I really became AI pilled."* ## [02:49] Alex joining OpenAI and the shift in physics research After GPT-5's release, Lupsasca began evangelizing the shift to colleagues who were skeptical. Finding OpenAI equally excited, and being on sabbatical, he joined as resident scientist — the person physicists around the world now email when something astonishing happens. He describes receiving an inbound that week about Codex simulating the Sachdev-Ye-Kitaev (SYK) model in 10 minutes, a feat that many research groups had struggled to achieve due to the narrow Venn diagram of physicists with strong coding skills. > *"I talked to OpenAI. They were also really excited and I thought I have to get in on this and to understand that this is happening and not be a part of it is a huge mistake so I have to go to OpenAI."* ## [04:08] The release of GPT-5 and the shift in capabilities Lupsasca contrasts the lukewarm Twitter reception of GPT-5 (complaints that it was not better at writing email) with what he observed at the science frontier. He notes GPT-5.4 is another significant jump, and describes how AI capabilities for physics have been accelerating rapidly since o3, the first reasoning model strong enough for research-grade mathematics. He uses this as a bridge to the central technical story of the episode: a pair of new papers on gluon and graviton scattering amplitudes. > *"At the science frontier the capabilities were really taking off."* ## [10:05] Explaining Quantum Field Theory and amplitude calculations Lupsasca gives an accessible primer on quantum field theory (QFT), the framework that reconciles special relativity and quantum mechanics. The key objects in QFT are scattering amplitudes — complex-valued functions that encode the quantum probability for a set of incoming particles (with given energies, momenta, and polarizations) to scatter into a set of outgoing particles. These amplitudes are computed at particle colliders like the LHC, and knowing the n-point amplitude (for any number n of particles) encodes essentially the full content of the theory. > *"If you have a particular force and you're able to compute the n-point amplitudes... you know everything about the theory."* ## [14:20] Overview of gluons and the strong force Gluons are the force-carrying particles of the strong nuclear force — the force that, despite like-charge repulsion between protons, holds the atomic nucleus together. They are the QFT analog of photons for electromagnetism and gravitons for gravity. Like photons, gluons carry a polarization (helicity): positive (right-handed) or negative (left-handed). This helicity structure is central to the paper discussed next. > *"The strong force is mediated by the exchange of the particles of the strong force, which are called gluons, because they're what glues together the nucleus of the atom."* ## [14:38] Discussing the first research paper on single-minus gluon tree amplitudes Lupsasca unpacks the paper's title — "Single-Minus Gluon Tree Amplitudes Are Non-Zero" — piece by piece. Tree amplitudes are the leading-order (no-loop) contributions to scattering. All-plus-helicity amplitudes are exactly zero by a symmetry argument. Single-minus amplitudes — where all but one gluon have positive helicity — were assumed in textbooks to also be zero by the same argument. The paper proves they are not. The result involves collaboration with Alfredo Guevara (IAS), David Skinner (Cambridge), Andrew Strominger (Harvard), and Kevin Wheel. > *"If you look at the lecture notes and textbooks that have been written on this, the same argument that rules out the all-plus amplitudes also appears to rule out the single-minus amplitudes."* ## [20:56] How ChatGPT helped solve a year-long physics puzzle Strominger, Guevara, and Skinner had understood for about a year that the textbook argument has a loophole: when particles are collinear (exactly aligned in momentum), the standard dimensional-analysis reasoning fails, and single-minus amplitudes can be non-zero. But computing what those non-zero amplitudes equal had eluded them. Lupsasca invited Strominger to visit OpenAI and work on it with AI. The week before Strominger's flight, Lupsasca began using ChatGPT Pro. By the time Strominger landed, they had the answer. > *"Using ChatGPT we solved the problem before he even got off the plane."* ## [23:02] Complexity of manual calculations in physics Lupsasca shows the audience a concrete illustration of the difficulty: the six-point single-minus amplitude, worked out by hand by Alfredo Guevara, is a sum of 32 terms each of which is itself a product of four complicated factors. The number of terms grows factorially with the number of particles n — super-exponential growth. This is the messy representation that the group had been staring at for a year, seeking the analog of the elegant Parke-Taylor formula. > *"By the time you get to six terms, it explodes in your face."* ## [26:12] The history and mechanics of Feynman diagrams Feynman diagrams are a visual language introduced by Richard Feynman to organize perturbative QFT calculations: diagrams represent possible intermediate histories of a scattering process, and the full amplitude is a sum over all of them. Diagrams are organized by number of vertices (interaction points); each additional vertex is suppressed by the coupling constant, so tree diagrams (fewest vertices) dominate. Loop diagrams — where intermediate particles are created and annihilated — contribute smaller corrections. The combinatorial explosion of tree diagrams is the root cause of factorial growth. > *"In principle, there are infinitely many pictures to sum over."* ## [27:44] The Parke-Taylor formula and the quest for simplification In the 1980s, Parke and Taylor computed the "maximally helicity violating" (MHV, or double-minus) gluon amplitudes through a heroic Feynman diagram expansion. Despite the factorial number of terms, everything canceled to leave a single compact formula — the Parke-Taylor formula — that fits in half a line. Strominger, Guevara, and Skinner spent a year looking for the analogous compact formula for the single-minus case. Their search stalled at the level of the messy Feynman representation. > *"Andy, Alfredo and David spent the last year chasing the analog of the Parke-Taylor formula, the very simple answer that was obtained in the '80s for the double minus amplitudes."* ## [31:26] Using ChatGPT to find the simplification in the special phase space region When the five-point single-minus amplitude was fed to ChatGPT Pro, the model identified a special subregion of phase space (where one particle's frequency has opposite sign) in which the amplitude simplifies from eight terms to a product of just three. This appears not to have been a known fact; the model wrote Python code and tested thousands of possibilities to deduce it. Moving to the six-point amplitude (Guevara's hand calculation), ChatGPT simplified 32 terms to a product of 4. It then conjectured the general n-point formula — with only linear growth in the number of terms, the best possible behavior. GPT-5.2 Pro guessed the formula but could not prove it. > *"The formula that it proposed, instead of having this factorial growth... here it's actually linear. So if you double the number of particles, you only double the number of terms."* ## [38:07] Proving the formula from scratch to ensure validity To obtain a proof, Lupsasca used an internal OpenAI model with extended reasoning. He gave it the problem cold — without the conjectured formula — and asked it to find the general answer in the special phase-space region. After 12 hours of computation, the model independently rediscovered the same formula and produced a complete three-step proof. The proof constitutes the bulk of the published paper. The team kept the AI attribution to one paragraph, framing the paper as a physics result that stands on its own merits. > *"We gave it the whole problem from scratch... and it came back with the same formula which we had not given it. So it rediscovered the correct formula. But this time it also found the proof."* ## [41:00] Determining the scientific impact and future research Asked to compare the result to the Parke-Taylor formula, Lupsasca is candid that scientific impact is only assessable decades later, but argues the result is genuinely surprising and should open a line of attack toward deeper questions in quantum gravity. The conversation pivots naturally to the second paper. > *"I think the true value of a paper can only be assessed decades into the future based on how much future work it leads to and what developments it opens up."* ## [42:27] Introduction to the second paper on graviton amplitudes Gravitons are the hypothetical quanta of gravity — the spin-2 force carrier analogous to the spin-1 photon (electromagnetism) and gluon (strong force). Unlike gluons, gravitons have never been directly detected, but they are central to quantum gravity theory. The second paper, "Single-Minus Graviton Tree Amplitudes Are Non-Zero," shows the same loophole applies to gravity and that a compact formula extends there too — despite gravitons being mathematically more complex than gluons. > *"We wrote this paper which is called single minus graviton tree amplitudes are non-zero. So it's the same title almost, except with graviton instead of gluon."* ## [45:41] Defining particles, irreducible representations, and symmetry Lupsasca sketches the modern QFT definition of a particle (an irreducible representation of the Poincaré group, classified by Wigner according to mass, spin, and charge) and explains why gravitons are spin-2 while gluons and photons are spin-1, making graviton polarization data twice as rich. Crucially, the second paper was complete within three days of the first going public — most elapsed time was spent verifying correctness, not computing. > *"Most of the time was spent verifying the answer, not writing, which is insane, actually, if you take a step back."* ## [47:46] How GPT Pro generalized the research to gravity For the graviton paper, no internal model was needed — the publicly available ChatGPT GPT-5.2 Pro sufficed. Lupsasca provided the gluon paper as context plus two paragraphs describing the key mathematical changes, then said "Good luck. You're a brilliant theoretical physicist." Over a 110-page exchange, the model worked through the graviton calculation — applying the directed matrix tree theorem, a piece of known combinatorics that neither Lupsasca nor collaborators had thought to invoke — produced correct intermediate results, and wrote a draft paper very close to the final arXiv version from section 3 onward. > *"It's a real solid result in quantum gravity that was done pretty much completely by an AI with human steering it and asking kind of the right questions."* ## [53:57] The epistemological shift: Is this a new way of doing physics? The hosts raise the central epistemological question: if an undergraduate with domain knowledge and good prompting could have done this, what does graduate training mean now? Lupsasca agrees this is the hardest open question facing academia. He notes that arduous calculation trains not just skill but self-confidence, that the gap between coursework and the research frontier is growing, and that many "easy" problems professors once assigned to students are now solvable by AI in minutes. He offers two concrete ways AI has already changed his own workflow: dramatically reducing time spent confused between steps, and enabling parallel AI scouts that explore multiple research directions simultaneously. > *"With AI, actually, you can launch 10 instances of chat and have each one try a different route and send it as a scout that moves very fast into the unknown."* ## [59:27] The use of AI as a 'scout' for research directions Lupsasca elaborates on the scout metaphor: rather than carefully mapping a route from A to C before committing to it, a researcher can now dispatch many AI "scouts" in parallel, get rapid feedback on which directions are promising, and redirect human attention accordingly. Even when a scout makes errors, its signposts reduce orientation cost for the human following. This constitutes a qualitatively new mode of research — one where the bottleneck shifts from calculation to judgment about which directions matter. > *"Even if ChatGPT doesn't always get everything right, just kind of having a scout that signposts some key steps along the way that you can use to anchor your own movement is extremely helpful."* ## [61:44] The role of 'taste' and collaboration with AI The hosts push on the problem of "taste" — the ability to identify which questions are at the productive edge of knowledge. Lupsasca argues that working effectively with ChatGPT requires the same skill a professor develops advising students: knowing what question to give, at what level of detail. "Taste" — knowing where the frontier is and which questions there are tractable — is the last skill to develop and the one AI currently lacks. AI is, he says, like an extremely technically skilled graduate student: given a sharp, well-posed question, it can do incredibly hard computations correctly, but it does not yet know which question to ask. > *"The difference between a good physicist and a great physicist is knowing what is the right question to ask — that is actually the hardest part of being a scientist."* ## [70:23] Personal evolution from AI skeptic to resident scientist Lupsasca recapitulates his personal arc: skeptic → converted by o3 (which solved in 11 minutes a calculation that would have taken him days) → "AI-pilled" by GPT-5 (which reproduced, in 30 minutes, his best published result on black hole Love numbers and tidal symmetries — a paper whose training cutoff predated its arXiv release) → now resident scientist at OpenAI. He notes that no competing model at the time could match GPT Pro on that calculation. > *"In under 30 minutes, with one hint... it completely solved this problem, which is one of the nicest calculations that I've ever done."* ## [72:46] Solving a black hole perturbation problem with GPT-5 Lupsasca details the "Move 37" moment that converted him: his paper "Why Is There No Love in Black Holes?" establishes new symmetry generators for perturbations of a Kerr black hole (explaining why black hole Love numbers — tidal response coefficients, named after mathematician Augustus Love — are exactly zero). When GPT-5 Pro was first given the full problem cold, it failed. But after being primed with the simpler flat-space warm-up (a 200-year-old known result), it then solved the full Kerr black hole problem in 18 minutes. > *"GPT-5 was able to reproduce one of my hardest calculations, which I think the number of people in the world that could do that you could count on your hands."* ## [76:34] Discussing whether AI can make original, conceptual leaps The hosts ask whether AI is doing genuine recombination versus true creative leaps. Lupsasca cites Terry Tao, who has not yet seen an AI proof that cannot be traced to an obscure reference. But Lupsasca has been impressed and frames the distinction as one of degree rather than kind — humans may also be recombination machines. He believes continued scaling will produce feats of insight that look like creativity, and notes OpenAI is actively working on enabling models to take bigger, more out-of-distribution leaps suited to scientific discovery. > *"I'm not sure there's a qualitative difference. I think it's just a matter of degree — as we continue scaling the capabilities, I don't see why it's going to stop."* ## [80:09] Challenges of 'AI slop' and the future of academic publishing With models now capable of turning out a physics paper in 30 minutes when properly steered, the arXiv preprint server is being flooded with submissions. Lupsasca distinguishes legitimate use (expert steering + careful verification) from "AI slop" — poorly prompted outputs submitted without adequate checking. His proposed response: raise the bar rather than increase volume. The single-minus amplitude papers open a clear line of attack toward genuine quantum gravity questions; the goal should be to pursue harder problems, not to publish incrementally. > *"Instead, I think now that we have this new tool that gives us AI superpowers, I think we should just raise the bar for what it means to write a good paper."* ## [83:13] The bottleneck of writing academic papers Asked what single bottleneck he would remove, Lupsasca nominates the paper-writing process itself — finding it increasingly strange that researchers use AI to do calculations, compress results into a static paper, and then readers feed that paper back into AI to understand it. He envisions interactive, LLM-embedded papers as a plausible future. He also identifies two missing capabilities in current models: (1) the spark of creativity to identify the next important question, and (2) reliable self-verification, so that the onus of checking long AI-generated proofs does not fall entirely on humans. > *"Maybe some kind of interactive paper which lives in some LLM. Maybe your whole paper is some ChatGPT page... I think we're going to head in that direction."* ## [90:19] Final takeaways and looking ahead to the next year Lupsasca's closing message: pay attention. The trajectory from "useful for email" to "solves open problems in quantum gravity" has taken roughly 18 months. Models are solving open problems that expert communities spent years on. Extrapolating forward, with more scaling already in the pipeline, the next 6 to 12 months should bring further surprises. The right posture is excitement, careful verification, and a commitment to pursuing harder problems. > *"If you just extrapolate that into the future, imagine where we're going to be in 6 months or a year — I think it's kind of surreal to live through this time, but it's really happening."* ## Entities - **Alex Lupsasca** (Person): Theoretical physicist, Vanderbilt University professor and OpenAI resident scientist; 2024 New Horizons Breakthrough Prize and IUPAP Young Scientist Award winner; expert in black hole physics and scattering amplitudes. - **Andrew Strominger** (Person): Harvard professor and Lupsasca's former PhD advisor; pioneer of celestial holography; co-author of both single-minus amplitude papers. - **Alfredo Guevara** (Person): Postdoctoral researcher at the Institute for Advanced Study (IAS); performed the foundational hand calculations underpinning the AI-assisted breakthrough. - **David Skinner** (Person): Professor at Cambridge University; co-author of the single-minus gluon amplitude paper. - **Terry Tao** (Person): Fields Medal-winning mathematician at UCLA; referenced regarding the question of whether AI proofs involve genuine creativity. - **Scattering Amplitudes** (Concept): Complex-valued functions in quantum field theory encoding probabilities for particles to scatter; the central mathematical objects of both papers discussed. - **Single-Minus Gluon/Graviton Amplitudes** (Concept): Tree-level scattering amplitudes where all but one particle have positive helicity; previously assumed zero in textbooks but shown non-zero in a collinear phase-space region. - **Parke-Taylor Formula** (Concept): Compact closed-form result for maximally helicity violating (MHV, double-minus) gluon amplitudes derived in the 1980s; the template whose analog was sought for single-minus amplitudes. - **Feynman Diagrams** (Concept): Diagrammatic technique to organize perturbative QFT calculations; individual diagrams represent distinct intermediate-particle histories whose amplitudes are summed. - **Love Numbers** (Concept): Coefficients encoding tidal deformability; famously vanish for black holes, a fact connected to hidden symmetries studied in Lupsasca's "Why Is There No Love in Black Holes?" paper. - **Celestial Holography** (Concept): Research program exploring symmetries of quantum gravity via scattering amplitude structure; motivates studying graviton amplitudes. - **OpenAI** (Organization): AI research company where Lupsasca serves as resident scientist; developer of GPT-5 and the internal extended-reasoning model used for the amplitude proof. - **arXiv** (Organization): Open-access physics and mathematics preprint server; mentioned in the context of AI-generated "slop" flooding submissions. - **GPT-5 / ChatGPT Pro** (Software): OpenAI's frontier language model used as the primary AI tool in both amplitude papers; capable of extended reasoning steps of 20-34 minutes per prompt.

#theoretical-physics#quantum-field-theory#gpt-5