KubeCon + CloudNativeCon India 2025

As Generative AI moves from prototype to production, Kubernetes has emerged as the foundational substrate powering this transition. In this session, I explore how Kubernetes is accelerating the adoption of GenAI and AI agents—from orchestrating large model training and serving, to powering Retrieval-Augmented Generation (RAG), fine-tuning pipelines, and real-time inference, and agentic workflows. I discuss real-world implementations, cutting-edge open-source projects, and reusable design patterns that highlight how the cloud-native ecosystem is evolving to meet the unique demands of AI-native workloads. Whether you’re building foundation models or deploying intelligent agents at scale, Kubernetes is fast becoming the operating system of the GenAI revolution.

Expedia Group’s RCP platform is transitioning to ArgoCD as its control plane. As part of this journey, we are adapting ArgoCD’s industry-leading technology to meet our current and future needs. A critical component of this effort involves fine-tuning the repo-server, originally optimized for GitOps workflows, to manage over 4,000 unique Helm charts at a scale of 12,000 applications, with a forecasted future scale of 30,000 applications.

This talk delves into our deep-dive scalability testing of the repo-server component, exploring memory usage patterns, troubleshooting performance bottlenecks, and addressing memory burst issues. We share our solutions to stabilize the repo-server under heavy load, and provide actionable recommendations based on configurations and parameters that worked for us. These insights aim to benefit the broader community in their own scalability endeavors.

Remember how you instantly close that glitchy food delivery app when it freezes mid-order? The same principle now applies to developer tools. Every minute spent battling deployment pipelines or debugging environment issues creates unnecessary friction.

This friction impacts your ability to deliver business value. It affects the things that matter: speed to market, talent retention, and competitive advantage. Leading organizations today are now designing for developer joy with the same intensity they apply to customer experiences.

Let us look at how forward-thinking technology leaders are transforming their platforms into competitive advantages by designing for developer delight. We’ll also learn how community insights can accelerate your DX improvements and why investing in seamless developer workflows is now a strategic priority that directly impacts your bottom line in today's talent-driven market.

Great DX isn't just a technical nicety—it's how you'll win in today's competitive market.

Is basic monitoring and logging using prometheus and ELK stack enough? Our DevOps automation platform suffered a major Kubernetes outage due to weak observability despite having the basic setup in place.

What Went Wrong?
Our "good enough" setup fell apart when it mattered most. Logs were a mess with no correlation, & tracing was half-baked, leaving us clueless during debugging. One customer’s CI/CD pipeline overwhelmed shared resources and brought everyone down. Aggressive autoscaling overloaded the control plane. Worst of all, a single tenant’s failure affected the entire cluster.

How did we fix it?
We swapped basic Prometheus for a distributed setup that could handle the scale. Workloads got isolated per tenant and team, with multi-tenancy baked in and dedicated monitoring to match. Fine-grained autoscaling & experimentation with tracing tools(Parca/Odigos). The result? A cluster that bends but doesn’t break.

If you want to avoid your own outage horror story, this talk is for you.

As organisations push to accelerate software delivery, Kubernetes has emerged as the backbone of modern platform engineering, enabling businesses to transcend traditional infrastructure and build scalable, high-performance platforms that empower developers to effortlessly deploy, manage, and scale applications.

In this session, I’ll dive into how Kubernetes is revolutionising platform engineering — turning complex infrastructure into self-service environments that drive automation, scalability, and developer efficiency. Through real-world case studies and forward-thinking strategies, I’ll demonstrate how Kubernetes helps organisations unlock unprecedented flexibility, accelerate delivery cycles, and build platforms that scale seamlessly in today’s dynamic landscape.