CEO and Co-Founder at unikraft.io . Millisecond starts, scale to 0 and autoscale now at KraftCloud -- kraft.cloud/signup 🚀
Millisecond cold starts are a reality at kraft.cloud , as is milliseconds scale to zero. What's new, and available soon, is being able to have 𝘀𝘁𝗮𝘁𝗲𝗳𝘂𝗹 scale to zero in milliseconds 🔥 First, some numbers, using NGINX as an example: ⚡️ Cold start: 24 milliseconds ⚡️ First stateful scale to zero (suspend): 174 ms ⚡️ Scale to one (resume): 3.67 ms ⚡️ Further stateful scale to zero (suspends): 2 ms I'll be writing a blog post to explain this in more detail, but basically the use of unikernels (extremely specialized VMs) allows for fast suspend/resume of their state. The second and subsequent suspends are quick since we do incremental snapshots. Finally, note that this mechanism is agnostic to the workload, so while we used NGINX as an example, this works with more complex apps/langs/frameworks like Node.js .
CTO | O'Reilly author | Consultant | JSON Schema TSC
1moOut of curiosity, can you explain what the first stateful scale zero is doing and how the caching works for further scale to zeroes?