scripod.com
The Frontier of Spatial Intelligence with Fei-Fei Li

Overview

Shownote

Highlights

Transcript

Chapters

Pins

The Frontier of Spatial Intelligence with Fei-Fei Li

a16z Podcast

Nov 13
a16z Podcast

a16z Podcast

Nov 13
OverviewShownoteHighlightsTranscriptChaptersPins

Shownote

Fei-Fei Li and Justin Johnson are pioneers in AI. While the world has only recently witnessed a surge in consumer AI, they have long been laying the groundwork for the innovations transforming industries today. With the recent launch of Marble, the first ...

Highlights

As AI evolves beyond language and into the physical world, pioneers Fei-Fei Li and Justin Johnson are leading a transformative shift toward spatial intelligence. Their work, rooted in decades of research, is now materializing through World Labs and its groundbreaking product, Marble. This conversation explores how the foundations of modern AI are being extended to understand and generate 3D environments, opening new frontiers across technology and industry.
05:07
The fundamental importance of data in AI was realized during early research at Caltech.
08:03
Deep learning was unlocked by both increased compute and access to large labeled datasets.
12:00
Neural artistic style conversion inspired breakthroughs in generative AI
16:21
The North Star is to unlock spatial intelligence
18:36
The right time to build spatial intelligence is now, driven by smartphone camera data.
21:15
Ben Mildenhall's NERF paper revolutionized 3D reconstruction with efficient neural rendering.
23:15
Reconstruction and generation in computer vision are converging through NERF and diffusion models
27:36
3D world representation better aligns with physical reality than 2D video or token-based models
29:04
Spatial intelligence is the North Star for building intelligent systems that understand 3D worlds.
40:00
Ben Mildenhall and Christoph Lassner are recognized as legends in the field of spatial intelligence.
41:57
Fei-Fei Li and Justin Johnson solved a long-term goal in spatial intelligence

Chapters

The Next Decade of AI
00:00
Origins: Backgrounds of the Founders
02:45
The Rise of Deep Learning & ImageNet
06:50
Algorithmic Unlocks: Compute, Data, and Supervised Learning
08:00
From Predictive to Generative AI
12:00
The Journey to Spatial Intelligence
16:20
Defining Spatial Intelligence
18:35
3D Data, Computer Vision, and Breakthroughs
21:15
Reconstruction vs. Generation in Computer Vision
23:15
Spatial Intelligence vs. Language Models
24:45
Applications: Virtual, Augmented, and Physical Worlds
29:00
Building World Labs: Team and Vision
39:55
The North Star: Measuring Success in Spatial Intelligence
41:55

Transcript

Fei-Fei Li: This is fundamentally, philosophically, to me, a different problem. Justin Johnson: The previous decade had mostly been about understanding data that already exists. But the next decade was going to be about understanding new data. Fei-Fei Li...