Skip to content

TODAY

Modal Labs adds GPU snapshot/restore for sub-second cold starts

Serverless GPU just got real — 70B model cold start under 800ms makes per-request inference economical.

Published: 2026-04-27
Sign in to save

Sources

Tags

modalinfrastructuregpuserverless

We use cookies

Anonymous analytics help us improve the site. You can opt out anytime. Learn more

Modal Labs adds GPU snapshot/restore for sub-second cold starts · BuilderWorld