All Articles

Serverless Containers Will Make VMs Irrelevant by 2028

VMs had a 30-year run. But serverless containers — Fargate, Cloud Run, Container Apps — are making infrastructure management optional. Here's why this shift is unstoppable.

DevOpsBoysMar 30, 20264 min read
Share:Tweet

I've been saying this for two years and the data is finally backing it up: the VM is dying. Not today, not in 2026, but by 2028 most new workloads won't run on VMs — they'll run on serverless container platforms where infrastructure is someone else's problem.

This isn't hype. It's a structural shift that's already happening.

The VM's Original Sin

Virtual machines solved a real problem in 2001: multiple workloads on one physical server. But they brought a tax: every VM is a full operating system. You manage kernel patches, security updates, disk partitioning, network interfaces, boot sequences. For every application you run, you're also running 400MB of OS overhead that has nothing to do with your business logic.

Containers reduced that overhead. Kubernetes orchestrated containers at scale. But you still needed VMs underneath. The node pool, the worker nodes, the EC2 instances — you were still managing infrastructure, just one layer higher.

Serverless containers break that chain entirely.

What Serverless Containers Actually Are

Not "serverless" in the Lambda sense (stateless functions, 15-minute timeout, cold start nightmares). Serverless containers are full container workloads that run without you managing the underlying nodes.

  • AWS Fargate: Run ECS or EKS pods without managing EC2 instances
  • Google Cloud Run: HTTP container workloads, scale-to-zero, zero infra management
  • Azure Container Apps: KEDA-based autoscaling, Dapr integration, zero node management
  • AWS EKS Fargate profiles: Kubernetes control plane you manage, data plane Fargate handles

You write a Dockerfile. You push an image. You define CPU/memory. The platform handles everything else.

The Math Has Changed

In 2020, Fargate was expensive. EC2 spot instances were 3-4x cheaper for sustained workloads. The cost argument kept teams on VMs.

That math is shifting:

Hidden VM costs most teams don't count:

  • SRE time managing node pools and upgrades (~20% of eng capacity for mid-size teams)
  • Over-provisioning buffer (most teams run at 40-60% utilization on VMs)
  • Security patching and CVE response cycles
  • Incident cost from node failures and OS-level issues

Fargate/Cloud Run advantages:

  • Per-second billing means you pay for actual usage, not reserved capacity
  • Scale-to-zero eliminates idle cost for batch/async workloads
  • Security patches are the cloud provider's problem
  • Node upgrades simply don't exist

For teams paying 2 engineers to manage their Kubernetes node pools, serverless containers are often cheaper in total cost.

The Developer Experience Gap Is Widening

Here's the thing nobody talks about: most developers hate managing infrastructure. They want to ship features. The Kubernetes learning curve — kubeconfig, RBAC, PodDisruptionBudgets, node affinity, network policies — creates massive friction for product teams.

Cloud Run's deployment model:

bash
gcloud run deploy my-service \
  --image gcr.io/project/my-service:latest \
  --region us-central1 \
  --allow-unauthenticated

That's it. HTTP traffic, TLS, autoscaling, rolling deployments — all handled. No YAML manifests, no Helm charts, no kubectl apply.

For 80% of web services, this is enough. For the other 20% that need stateful workloads, complex networking, or GPU compute — yes, managed Kubernetes is the right answer. But that 80% doesn't need to learn Kubernetes.

Why This Won't Eliminate DevOps Engineers

A common panic I see: "if serverless containers take over, DevOps is dead." Wrong.

The complexity doesn't disappear — it moves.

  • Platform engineers will build golden paths on top of serverless platforms
  • Observability becomes harder (you can't SSH into a Fargate task)
  • Cost optimization requires new skills (per-vCPU billing is different from EC2 pricing)
  • Security posture changes (no node-level hardening, network policies are service-mesh-based)
  • Multi-region resilience, traffic management, and failover still need expertise

DevOps work shifts from infrastructure provisioning to platform engineering and observability. Less time patching nodes, more time building developer platforms and ensuring reliability.

The 2028 Prediction

By 2028:

  • New SaaS startups will default to serverless containers (Cloud Run, Container Apps, Fargate). Running your own nodes will feel like running your own data center did in 2015.
  • Enterprise teams will run hybrid: serverless containers for stateless services, managed Kubernetes (EKS/GKE/AKS) for stateful workloads, GPU workloads, and services needing fine-grained networking control.
  • VMs will exist for legacy systems, on-prem compliance requirements, and workloads that genuinely need bare-metal-adjacent performance. Their share of new deployments will be under 10%.

What You Should Learn Now

If you want to stay relevant:

  1. Learn serverless container platforms deeply — not just the happy path. Understand Fargate task networking, Cloud Run concurrency model, Container Apps scaling triggers.
  2. Master observability without SSH — OpenTelemetry, distributed tracing, structured logging. You can't kubectl exec into a Fargate task.
  3. Learn FinOps for serverless — per-request pricing requires different optimization strategies than EC2 reserved instances.
  4. Build platform abstractions — the teams that win will build internal developer platforms that hide infrastructure complexity, whether it's VMs or serverless containers underneath.

The engineers who will be most valuable in 2028 are the ones building platforms that make developers productive — not the ones who know the most about EC2 instance types.


Preparing for cloud-native certifications? KodeKloud has hands-on labs for AWS, GCP, and Kubernetes that cover exactly these architectures. Start with their free tier.

Newsletter

Stay ahead of the curve

Get the latest DevOps, Kubernetes, AWS, and AI/ML guides delivered straight to your inbox. No spam — just practical engineering content.

Related Articles

Comments