Serverless Containers Will Make VMs Irrelevant by 2028
VMs had a 30-year run. But serverless containers — Fargate, Cloud Run, Container Apps — are making infrastructure management optional. Here's why this shift is unstoppable.
I've been saying this for two years and the data is finally backing it up: the VM is dying. Not today, not in 2026, but by 2028 most new workloads won't run on VMs — they'll run on serverless container platforms where infrastructure is someone else's problem.
This isn't hype. It's a structural shift that's already happening.
The VM's Original Sin
Virtual machines solved a real problem in 2001: multiple workloads on one physical server. But they brought a tax: every VM is a full operating system. You manage kernel patches, security updates, disk partitioning, network interfaces, boot sequences. For every application you run, you're also running 400MB of OS overhead that has nothing to do with your business logic.
Containers reduced that overhead. Kubernetes orchestrated containers at scale. But you still needed VMs underneath. The node pool, the worker nodes, the EC2 instances — you were still managing infrastructure, just one layer higher.
Serverless containers break that chain entirely.
What Serverless Containers Actually Are
Not "serverless" in the Lambda sense (stateless functions, 15-minute timeout, cold start nightmares). Serverless containers are full container workloads that run without you managing the underlying nodes.
- AWS Fargate: Run ECS or EKS pods without managing EC2 instances
- Google Cloud Run: HTTP container workloads, scale-to-zero, zero infra management
- Azure Container Apps: KEDA-based autoscaling, Dapr integration, zero node management
- AWS EKS Fargate profiles: Kubernetes control plane you manage, data plane Fargate handles
You write a Dockerfile. You push an image. You define CPU/memory. The platform handles everything else.
The Math Has Changed
In 2020, Fargate was expensive. EC2 spot instances were 3-4x cheaper for sustained workloads. The cost argument kept teams on VMs.
That math is shifting:
Hidden VM costs most teams don't count:
- SRE time managing node pools and upgrades (~20% of eng capacity for mid-size teams)
- Over-provisioning buffer (most teams run at 40-60% utilization on VMs)
- Security patching and CVE response cycles
- Incident cost from node failures and OS-level issues
Fargate/Cloud Run advantages:
- Per-second billing means you pay for actual usage, not reserved capacity
- Scale-to-zero eliminates idle cost for batch/async workloads
- Security patches are the cloud provider's problem
- Node upgrades simply don't exist
For teams paying 2 engineers to manage their Kubernetes node pools, serverless containers are often cheaper in total cost.
The Developer Experience Gap Is Widening
Here's the thing nobody talks about: most developers hate managing infrastructure. They want to ship features. The Kubernetes learning curve — kubeconfig, RBAC, PodDisruptionBudgets, node affinity, network policies — creates massive friction for product teams.
Cloud Run's deployment model:
gcloud run deploy my-service \
--image gcr.io/project/my-service:latest \
--region us-central1 \
--allow-unauthenticatedThat's it. HTTP traffic, TLS, autoscaling, rolling deployments — all handled. No YAML manifests, no Helm charts, no kubectl apply.
For 80% of web services, this is enough. For the other 20% that need stateful workloads, complex networking, or GPU compute — yes, managed Kubernetes is the right answer. But that 80% doesn't need to learn Kubernetes.
Why This Won't Eliminate DevOps Engineers
A common panic I see: "if serverless containers take over, DevOps is dead." Wrong.
The complexity doesn't disappear — it moves.
- Platform engineers will build golden paths on top of serverless platforms
- Observability becomes harder (you can't SSH into a Fargate task)
- Cost optimization requires new skills (per-vCPU billing is different from EC2 pricing)
- Security posture changes (no node-level hardening, network policies are service-mesh-based)
- Multi-region resilience, traffic management, and failover still need expertise
DevOps work shifts from infrastructure provisioning to platform engineering and observability. Less time patching nodes, more time building developer platforms and ensuring reliability.
The 2028 Prediction
By 2028:
- New SaaS startups will default to serverless containers (Cloud Run, Container Apps, Fargate). Running your own nodes will feel like running your own data center did in 2015.
- Enterprise teams will run hybrid: serverless containers for stateless services, managed Kubernetes (EKS/GKE/AKS) for stateful workloads, GPU workloads, and services needing fine-grained networking control.
- VMs will exist for legacy systems, on-prem compliance requirements, and workloads that genuinely need bare-metal-adjacent performance. Their share of new deployments will be under 10%.
What You Should Learn Now
If you want to stay relevant:
- Learn serverless container platforms deeply — not just the happy path. Understand Fargate task networking, Cloud Run concurrency model, Container Apps scaling triggers.
- Master observability without SSH — OpenTelemetry, distributed tracing, structured logging. You can't
kubectl execinto a Fargate task. - Learn FinOps for serverless — per-request pricing requires different optimization strategies than EC2 reserved instances.
- Build platform abstractions — the teams that win will build internal developer platforms that hide infrastructure complexity, whether it's VMs or serverless containers underneath.
The engineers who will be most valuable in 2028 are the ones building platforms that make developers productive — not the ones who know the most about EC2 instance types.
Preparing for cloud-native certifications? KodeKloud has hands-on labs for AWS, GCP, and Kubernetes that cover exactly these architectures. Start with their free tier.
Stay ahead of the curve
Get the latest DevOps, Kubernetes, AWS, and AI/ML guides delivered straight to your inbox. No spam — just practical engineering content.
Related Articles
Edge Computing Will Decentralize Kubernetes by 2028
Why Kubernetes is moving from centralized cloud clusters to distributed edge deployments. Covers KubeEdge, k3s, Akri, and the architectural shift toward edge-native infrastructure.
How to Set Up Crossplane for Self-Service Infrastructure on Kubernetes
A step-by-step tutorial on setting up Crossplane to provision and manage cloud infrastructure directly from Kubernetes. Build a self-service platform where developers can request AWS, GCP, or Azure resources through kubectl.
Kubernetes Will Become Invisible by 2028 — And That's the Point
The engineers who built Kubernetes never wanted you to think about it. A new generation of abstractions is quietly removing Kubernetes from the developer's line of sight — and the companies doing it best are winning the talent war.