KubeCon + CloudNativeCon India 2025

As Generative AI moves from prototype to production, Kubernetes has emerged as the foundational substrate powering this transition. In this session, I explore how Kubernetes is accelerating the adoption of GenAI and AI agents—from orchestrating large model training and serving, to powering Retrieval-Augmented Generation (RAG), fine-tuning pipelines, and real-time inference, and agentic workflows. I discuss real-world implementations, cutting-edge open-source projects, and reusable design patterns that highlight how the cloud-native ecosystem is evolving to meet the unique demands of AI-native workloads. Whether you’re building foundation models or deploying intelligent agents at scale, Kubernetes is fast becoming the operating system of the GenAI revolution.

Expedia Group’s RCP platform is transitioning to ArgoCD as its control plane. As part of this journey, we are adapting ArgoCD’s industry-leading technology to meet our current and future needs. A critical component of this effort involves fine-tuning the repo-server, originally optimized for GitOps workflows, to manage over 4,000 unique Helm charts at a scale of 12,000 applications, with a forecasted future scale of 30,000 applications.

This talk delves into our deep-dive scalability testing of the repo-server component, exploring memory usage patterns, troubleshooting performance bottlenecks, and addressing memory burst issues. We share our solutions to stabilize the repo-server under heavy load, and provide actionable recommendations based on configurations and parameters that worked for us. These insights aim to benefit the broader community in their own scalability endeavors.

Remember how you instantly close that glitchy food delivery app when it freezes mid-order? The same principle now applies to developer tools. Every minute spent battling deployment pipelines or debugging environment issues creates unnecessary friction.

This friction impacts your ability to deliver business value. It affects the things that matter: speed to market, talent retention, and competitive advantage. Leading organizations today are now designing for developer joy with the same intensity they apply to customer experiences.

Let us look at how forward-thinking technology leaders are transforming their platforms into competitive advantages by designing for developer delight. We’ll also learn how community insights can accelerate your DX improvements and why investing in seamless developer workflows is now a strategic priority that directly impacts your bottom line in today's talent-driven market.

Great DX isn't just a technical nicety—it's how you'll win in today's competitive market.