The Microsoft Azure Container Networking staff is happy to announce Retina, a cloud-native container networking observability platform that allows Kubernetes customers, admins, and builders to visualise, observe, debug, and analyze Kubernetes’ workload site visitors no matter Container Community Interface (CNI), working system (OS), and cloud. We’re excited to launch Retina as an open-source repository that helps with DevOps and SecOps associated networking circumstances to your Kubernetes clusters and we invite the open-source neighborhood to innovate together with us.
Retina
A cloud-native container networking observability platform
Embracing and advancing open-source software program
Cloud native applied sciences like Kubernetes have made constructing functions that may run anyplace, simpler. On the identical time, many functions have grow to be extra complicated, and managing them within the cloud is more and more tough. As firms construct cloud-native functions composed of interconnected companies after which deploy them to a number of public clouds in addition to their non-public infrastructure, community associated observability, troubleshooting, and debugging has grow to be more and more tough.
With the facility of prolonged Berkley Packet Filter (eBPF), it’s now doable to supply actionable community insights together with how containerized micro-services work together and accomplish that in non-intrusive methods with none change within the functions itself—that’s precisely what Retina units out to attain. Retina will assist democratize community observability and troubleshooting by bringing new focus to the expertise of utility builders. Retina supplies builders with easy methods to watch and troubleshoot their functions for points equivalent to packet drops and latency with out worrying concerning the complexities of the underlying community infrastructure and transformations.
Based mostly on our constructive expertise locally with eBPF and Cilium, we’re excited to construct on this relationship and interact each extra intently and with extra communities. We imagine that by opening Retina to the neighborhood, we are able to profit from knowledgeable suggestions, progressive concepts, and collaborative efforts that can assist improve and broaden Retina’s capabilities.
Retina options and capabilities
Drawing from our intensive expertise managing a number of container networking companies for the Azure Kubernetes Service (AKS), we recognized essential gaps in community monitoring, the gathering of community metrics and traces from Kubernetes clusters. Retina is a cutting-edge resolution that closes these gaps and is designed to sort out the complicated challenges of managing and supporting Kubernetes networks offering infrastructure- and site-reliability engineers complete insights into cluster networking. Retina additionally supplies deep site visitors evaluation with Kubernetes-specific context, translating metrics into both industry-standard Prometheus or community circulation logs.
Current open-source options are sometimes tightly coupled with particular CNI’s, OS, or knowledge planes, thereby limiting their versatility and use. Because of this, Retina has been designed and developed to be a extremely versatile, adaptable, and extensible framework of plugins able to working seamlessly with any CNI, OS, or cloud supplier—making it a precious addition to any present toolset. Retina helps each Linux and Home windows knowledge planes, guaranteeing it meets the varied wants of infrastructure- and site-reliability engineers, whereas sustaining a minimal reminiscence and CPU footprint on the cluster—this stays true even at scale. Retina’s pluggability design ethos helps us simply lengthen and adapt to handle new use circumstances with out relying on any particular CNI, OS, or knowledge aircraft.
One in every of Retina’s key options supplies deep community site visitors insights that embody Layer 4 (L4) metrics, Area Identify System (DNS) metrics, and distributed packet captures. It seamlessly integrates the Kubernetes app mannequin providing pod-level metrics with detailed context. It emits actionable networking observability knowledge into industry-standard Prometheus metrics offering node-level metrics (for instance, ahead, drop, Transmission Management Protocol (TCP), Consumer Datagram Protocol (UDP), and Linux utility) and pod-level metrics (equivalent to fundamental metrics, DNS, and API server latency.)
Retina’s distributed packet captures are label-driven—permitting customers to specify what, the place, and who to seize packets from. Moreover, it supplies historic context of community circulation logs and superior debugging capabilities that improve community troubleshooting and efficiency optimization.
Our imaginative and prescient for Retina
Many enterprises are multi-cloud and wish options that work effectively not simply on Microsoft Azure, however on different clouds in addition to on-premises. Retina is open-source and multi-cloud from day one. By open-sourcing Retina, we goal to share our information and imaginative and prescient for Kubernetes networking observability with the broader cloud-native ecosystem. Our hope is that Retina will evolve and develop by collaboration with different builders and organizations who share comparable experiences and objectives on this discipline.
When it comes to structure, extensibility was key from the outset and can stay going ahead. Retina affords extensibility in knowledge assortment—permitting customers to simply add new metrics and insights. It additionally affords extensibility in exporters—enabling customers to combine with different monitoring methods and instruments. This flexibility ensures that Retina can adapt to completely different use circumstances and environments, making it a flexible and highly effective platform for Kubernetes networking observability. In conclusion, we envision Retina as a platform permitting anybody to contribute, lengthen, and innovate on finally creating a sturdy, purpose-built, and complete resolution for Kubernetes networking observability.
Getting began
We hope this weblog publish has given you an outline of Retina, its options, and advantages. Retina is a mission that we’re very enthusiastic about, and we welcome your suggestions, strategies, and contributions. Whether or not you’re a community engineer, a DevOps engineer, a web site reliability engineer, or a cloud-native fanatic, we invite you to check out Retina and see the way it can assist you achieve deeper visibility into your Kubernetes networks.