iCreatAI News
Skip to content
Latent Space· Basil Chatha·· 24 days agoAI score62

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal CEO

Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal CEO

AI summary

In this interview, Modal CEO Erik Bernhardsson explains why fixed-term GPU capacity contracts look like rectangles while real workloads grow, spike, and fall, and describes Modal's approach of pooling demand across thousands of customers to use capacity elastically. He also discusses Modal's sandboxes, which he says have grown to roughly a third of revenue, and the infrastructure work—such as checkpointing and GPU memory snapshots—that makes fast startup possible. Modal reports crossing $1 billion in annualized run rate, raising a $750 million Series D at a $16 billion valuation, and spinning up nearly three billion sandboxes.

Source: Latent Space · latent.space