KAHIBARO Bookshelves
Discord Login Register

19.1. Kubernetes ecosystem overview

Landscape of the Kubernetes Ecosystem

The Kubernetes ecosystem is a broad collection of open source projects, commercial products, standards, and communities that build on top of core Kubernetes. OpenShift itself is one opinionated distribution inside this ecosystem. Understanding the ecosystem helps you see where OpenShift fits and what complementary technologies you might encounter.

This chapter focuses on:

  • How the ecosystem is structured (distributions, add‑ons, platforms).
  • The role of the Cloud Native Computing Foundation (CNCF).
  • Major ecosystem categories and representative projects.
  • Where OpenShift aligns with or differs from other ecosystem components.

We will not go deep into OpenShift‑specific features here; those are covered in many other chapters.

CNCF and the Cloud‑Native Landscape

The Cloud Native Computing Foundation (CNCF) is the main umbrella organization for cloud‑native projects, including Kubernetes. It provides:

  • Project hosting and governance for open source projects.
  • Certification programs (e.g., Certified Kubernetes, CKAD/CKA exams).
  • Conferences and community events like KubeCon + CloudNativeCon.
  • Reference landscape diagram showing hundreds of projects across categories.

Key CNCF project tiers:

  • Graduated projects – mature, widely adopted, with strong governance and users (e.g., Kubernetes, Prometheus, Envoy).
  • Incubating projects – growing adoption, still building maturity.
  • Sandbox projects – experimental, early‑stage ideas.

OpenShift builds on several CNCF projects (Kubernetes, Prometheus, etc.) and integrates them into a supported platform.

Distributions vs Platforms vs Managed Services

Within the ecosystem, it is useful to distinguish:

  • Kubernetes distributions – Packages of upstream Kubernetes plus defaults and add‑ons, installable on your own infrastructure.
  • Kubernetes platforms – Distributions plus opinionated integrations for networking, storage, security, CI/CD, and user experience (OpenShift fits here).
  • Managed Kubernetes services – Cloud‑hosted, provider‑operated clusters where you do not manage control plane infrastructure.

Examples:

  • Distributions
    • vanilla Kubernetes (kubeadm, community builds),
    • k3s, microk8s, kind (for development and edge).
  • Platforms
    • Red Hat OpenShift,
    • VMware Tanzu,
    • Rancher (as a management layer over multiple distros).
  • Managed services
    • Amazon EKS,
    • Google GKE,
    • Azure AKS,
    • Red Hat OpenShift Service on AWS (ROSA), Azure Red Hat OpenShift, etc.

OpenShift spans multiple categories: a platform you can run yourself, and a basis for several managed offerings.

Major Categories in the Kubernetes Ecosystem

The ecosystem is typically organized into functional domains. Below are the most relevant ones for OpenShift users, with emphasis on relationships rather than deep technical details.

Cluster Lifecycle and Provisioning

Tools and projects that create, upgrade, and manage clusters:

  • Cluster API – Declarative cluster lifecycle management using Kubernetes‑style APIs for clusters themselves.
  • kubeadm – Community tool to bootstrap Kubernetes clusters.
  • Installer frameworks – E.g., kops, kubespray, kind for local development clusters.

OpenShift has its own installer and lifecycle tooling but increasingly aligns conceptually with ecosystem approaches like Cluster API.

Networking and Service Connectivity

Networking in the ecosystem covers:

  • Container Network Interfaces (CNI) – Pluggable networking implementations:
    • Calico, Flannel, Cilium, Weave Net, etc.
  • Service meshes – Advanced service‑to‑service communication:
    • Istio, Linkerd, Kuma, Consul.
  • Ingress controllers and gateways – HTTP/HTTPS entry points:
    • NGINX Ingress, HAProxy, Envoy‑based gateways, and the emerging Kubernetes Gateway API.

OpenShift ships with its own SDN (and OVN‑Kubernetes) and an integrated ingress controller, while also supporting mesh technologies such as Istio‑based meshes through Operators.

Storage and Data Management

Typical categories:

  • CSI (Container Storage Interface) drivers – Integrations with storage backends (cloud block/file storage, SAN/NAS, software‑defined storage).
  • Software‑defined storage:
    • Rook/Ceph, OpenEBS, Longhorn.
  • Backup and disaster recovery:
    • Velero and commercial equivalents.

OpenShift Storage solutions (like OpenShift Data Foundation) are built on these ecosystem concepts and interfaces (e.g., CSI).

Observability: Metrics, Logging, Tracing

The “observability stack” around Kubernetes is well‑developed:

  • Metrics and monitoring
    • Prometheus (time‑series metrics collection),
    • Alertmanager,
    • visualization tools like Grafana.
  • Logging
    • Fluentd/Fluent Bit, Vector, Loki, Elasticsearch‑based stacks.
  • Distributed tracing
    • Jaeger, OpenTelemetry, Zipkin.

OpenShift uses several of these as built‑in components or optional Operators, aligning closely with CNCF standards like Prometheus and OpenTelemetry.

Security and Policy

Security‑related projects span many layers:

  • Runtime and image security
    • Falco (runtime behavior detection),
    • Trivy, Clair, Grype (image scanning),
    • Cosign and Sigstore (image signing and supply‑chain security).
  • Policy and governance
    • Open Policy Agent (OPA) and Gatekeeper,
    • Kyverno (policy as code for Kubernetes).
  • Identity and access integration
    • Projects that connect Kubernetes with enterprise identity providers (OIDC, SAML, etc.).

OpenShift incorporates image scanning, admission controls, and policy tooling; it can also integrate with broader ecosystem tools for supply‑chain and runtime security.

Application Delivery: CI/CD, GitOps, and Packaging

The ecosystem for delivering applications to Kubernetes includes:

  • Helm – Package manager for Kubernetes, defines reusable application charts.
  • Kustomize – Template‑free configuration customization (now part of kubectl).
  • GitOps tools
    • Argo CD,
    • Flux.
  • CI/CD systems integrating with Kubernetes
    • Jenkins, GitHub Actions, GitLab CI, Tekton, etc.

OpenShift builds on these ideas through:

  • OpenShift Pipelines (Tekton‑based),
  • OpenShift GitOps (Argo CD‑based),
  • support for Helm and Kustomize alongside OpenShift‑specific mechanisms like Templates and Operators.

Workload Types and Specialized Frameworks

Beyond basic stateless workloads, the ecosystem has specialized frameworks:

  • Data and analytics
    • Apache Spark on Kubernetes, distributed data frameworks.
  • AI/ML
    • Kubeflow, KServe, MLflow integrations,
    • GPU scheduling and device plugins.
  • Serverless and event‑driven
    • Knative (serverless on Kubernetes),
    • event frameworks like CloudEvents, and streaming systems (Kafka, NATS).

OpenShift’s serverless, AI/ML, and data platforms use several of these upstream projects, wrapped in an integrated experience.

Operators and APIs

The Operator pattern is itself an important part of the ecosystem:

  • Operator SDK – Toolkit for building Operators.
  • OperatorHub.io – Catalog of community and vendor Operators.
  • CRDs (Custom Resource Definitions) – Mechanism for extending Kubernetes APIs that Operators rely on.

OpenShift’s Operator Framework and OperatorHub build on and shape this part of the ecosystem, making Operators a first‑class method for delivering platform services and applications.

Standards, Compatibility, and Interoperability

To make the ecosystem coherent, several standardization efforts exist:

  • Kubernetes conformance – Ensures a distribution correctly implements the Kubernetes APIs.
  • CNI, CSI, and CRI – Interfaces for networking, storage, and container runtimes.
  • OpenTelemetry, OpenMetrics, OpenTracing (now merged into OpenTelemetry) – Common observability standards.
  • OCI (Open Container Initiative) – Standards for container images and runtimes.

OpenShift adheres to these standards where applicable, which:

  • Eases portability of workloads between OpenShift and other Kubernetes environments.
  • Allows many ecosystem tools (e.g., CSI drivers, metrics exporters) to work with minimal or no modification.

Where OpenShift Fits in the Ecosystem

Within this broader landscape, OpenShift can be viewed as:

  • A Kubernetes distribution and platform that:
    • Integrates multiple CNCF and adjacent projects into a cohesive product.
    • Adds opinionated defaults, security hardening, and enterprise support.
  • A participant and contributor:
    • Contributes code upstream to Kubernetes and related projects.
    • Helps drive standards (e.g., around Operators, observability, security).
  • A platform for running ecosystem tools:
    • Many ecosystem tools are installed as Operators or Helm charts on OpenShift.
    • OpenShift clusters can coexist with and be managed alongside other Kubernetes offerings in hybrid and multi‑cluster architectures.

Understanding this placement helps you:

  • Recognize which documentation or community resources are generic Kubernetes vs. OpenShift‑specific.
  • Reuse Kubernetes skills and tools when working with OpenShift.
  • Choose complementary ecosystem components in a way that fits OpenShift’s model and support boundaries.

Trends in the Kubernetes Ecosystem

Some current trends that influence OpenShift and similar platforms:

  • Consolidation around GitOps and declarative workflows for both apps and cluster operations.
  • Growth of platform engineering: internal platforms built on Kubernetes, using tools like Backstage plus Operators and GitOps.
  • Shift toward multi‑cluster, multi‑cloud, and edge topologies, with tools for fleet management and policy.
  • Rising focus on supply‑chain security, SBOMs, and end‑to‑end signing/verification of artifacts.
  • Convergence of AI/ML and data platforms on Kubernetes, standardizing on GPU support, data access patterns, and model serving.

OpenShift’s roadmap (covered in the next chapter) is tightly linked to these ecosystem dynamics, often adopting and productizing emerging patterns once they mature in the broader community.

Views: 0

Comments

Please login to add a comment.

Don't have an account? Register now!

Where to Move

Move chapter:

  • ☰ 1. Course Overview
    • ☰ 1.1. What is OpenShift
      • ☰ 1.2. Why OpenShift is used in modern IT and cloud environments
        • ☰ 1.3. OpenShift vs Kubernetes
          • ☰ 1.4. Typical OpenShift use cases
            • ☰ 1.5. Structure and goals of the course
            • ☰ 2. Containers and Cloud-Native Fundamentals
              • ☰ 2.1. What is a container
                • ☰ 2.2. Containers vs virtual machines
                  • ☰ 2.3. Introduction to Docker and container images
                    • ☰ 2.4. Container registries
                      • ☰ 2.5. Basics of cloud-native applications
                      • ☰ 3. Kubernetes Fundamentals
                        • ☰ 3.1. What is Kubernetes
                          • ☰ 3.2. Kubernetes architecture
                            • ☰ 3.3. Control plane components
                              • ☰ 3.4. Worker node components
                                • ☰ 3.5. Kubernetes objects and resources
                                  • ☰ 3.6. Declarative configuration model
                                  • ☰ 4. OpenShift Architecture
                                    • ☰ 4.1. Overview of OpenShift architecture
                                      • ☰ 4.2. Control plane in OpenShift
                                        • ☰ 4.3. Nodes and machine roles
                                          • ☰ 4.4. OpenShift Operators
                                            • ☰ 4.5. OpenShift networking model
                                              • ☰ 4.6. OpenShift storage model
                                              • ☰ 5. OpenShift Installation and Deployment Models
                                                • ☰ 5.1. OpenShift deployment options
                                                  • ☰ 5.2. Installer-Provisioned Infrastructure
                                                    • ☰ 5.3. User-Provisioned Infrastructure
                                                      • ☰ 5.4. Managed OpenShift services
                                                        • ☰ 5.5. Single-node OpenShift
                                                          • ☰ 5.6. Cluster lifecycle management
                                                          • ☰ 6. Accessing and Using OpenShift
                                                            • ☰ 6.1. OpenShift web console
                                                              • ☰ 6.2. OpenShift CLI (oc)
                                                                • ☰ 6.3. Authentication and authorization
                                                                  • ☰ 6.4. Projects and namespaces
                                                                    • ☰ 6.5. Resource quotas and limits
                                                                    • ☰ 7. Building and Deploying Applications
                                                                      • ☰ 7.1. Application deployment concepts
                                                                        • ☰ 7.2. Source-to-Image (S2I)
                                                                          • ☰ 7.3. Container-based deployments
                                                                            • ☰ 7.4. DeploymentConfigs and Deployments
                                                                              • ☰ 7.5. Rolling updates and rollbacks
                                                                              • ☰ 8. Networking in OpenShift
                                                                                • ☰ 8.1. Services and service discovery
                                                                                  • ☰ 8.2. Routes and ingress
                                                                                    • ☰ 8.3. Network policies
                                                                                      • ☰ 8.4. Load balancing
                                                                                        • ☰ 8.5. External access to applications
                                                                                        • ☰ 9. Storage in OpenShift
                                                                                          • ☰ 9.1. Persistent storage concepts
                                                                                            • ☰ 9.2. Persistent Volumes
                                                                                              • ☰ 9.3. Persistent Volume Claims
                                                                                                • ☰ 9.4. StorageClasses
                                                                                                  • ☰ 9.5. Dynamic provisioning
                                                                                                    • ☰ 9.6. Stateful applications
                                                                                                    • ☰ 10. Configuration and Secrets Management
                                                                                                      • ☰ 10.1. ConfigMaps
                                                                                                        • ☰ 10.2. Secrets
                                                                                                          • ☰ 10.3. Environment variables
                                                                                                            • ☰ 10.4. Managing sensitive data
                                                                                                              • ☰ 10.5. Best practices for configuration
                                                                                                              • ☰ 11. Scaling and High Availability
                                                                                                                • ☰ 11.1. Horizontal pod autoscaling
                                                                                                                  • ☰ 11.2. Vertical scaling
                                                                                                                    • ☰ 11.3. Self-healing and pod restarts
                                                                                                                      • ☰ 11.4. High availability concepts
                                                                                                                        • ☰ 11.5. Multi-zone and multi-region clusters
                                                                                                                        • ☰ 12. Monitoring, Logging, and Observability
                                                                                                                          • ☰ 12.1. Built-in monitoring stack
                                                                                                                            • ☰ 12.2. Metrics and alerts
                                                                                                                              • ☰ 12.3. Logging architecture
                                                                                                                                • ☰ 12.4. Distributed tracing
                                                                                                                                  • ☰ 12.5. Troubleshooting applications
                                                                                                                                  • ☰ 13. Security in OpenShift
                                                                                                                                    • ☰ 13.1. Security model overview
                                                                                                                                      • ☰ 13.2. Role-Based Access Control
                                                                                                                                        • ☰ 13.3. Security Context Constraints
                                                                                                                                          • ☰ 13.4. Image security and scanning
                                                                                                                                            • ☰ 13.5. Network security
                                                                                                                                              • ☰ 13.6. Compliance and auditing
                                                                                                                                              • ☰ 14. CI/CD and DevOps with OpenShift
                                                                                                                                                • ☰ 14.1. DevOps concepts
                                                                                                                                                  • ☰ 14.2. CI/CD pipelines overview
                                                                                                                                                    • ☰ 14.3. OpenShift Pipelines (Tekton)
                                                                                                                                                      • ☰ 14.4. GitOps with Argo CD
                                                                                                                                                        • ☰ 14.5. Integrating OpenShift with external CI tools
                                                                                                                                                        • ☰ 15. Operators and Platform Services
                                                                                                                                                          • ☰ 15.1. What are Operators
                                                                                                                                                            • ☰ 15.2. Operator Lifecycle Manager
                                                                                                                                                              • ☰ 15.3. Installing and managing Operators
                                                                                                                                                                • ☰ 15.4. Common platform Operators
                                                                                                                                                                  • ☰ 15.5. Custom Operators
                                                                                                                                                                  • ☰ 16. Upgrades, Maintenance, and Operations
                                                                                                                                                                    • ☰ 16.1. OpenShift upgrade process
                                                                                                                                                                      • ☰ 16.2. Backup and restore
                                                                                                                                                                        • ☰ 16.3. Node maintenance
                                                                                                                                                                          • ☰ 16.4. Cluster troubleshooting
                                                                                                                                                                            • ☰ 16.5. Capacity planning
                                                                                                                                                                            • ☰ 17. OpenShift on HPC and Specialized Workloads
                                                                                                                                                                              • ☰ 17.1. Running batch workloads on OpenShift
                                                                                                                                                                                • ☰ 17.2. OpenShift and GPUs
                                                                                                                                                                                  • ☰ 17.3. MPI and parallel workloads in containers
                                                                                                                                                                                    • ☰ 17.4. Hybrid HPC and cloud workflows
                                                                                                                                                                                    • ☰ 18. OpenShift in Practice
                                                                                                                                                                                      • ☰ 18.1. Typical OpenShift workflows
                                                                                                                                                                                        • ☰ 18.2. Development to production lifecycle
                                                                                                                                                                                          • ☰ 18.3. Case studies from industry
                                                                                                                                                                                            • ☰ 18.4. Common pitfalls and best practices
                                                                                                                                                                                            • ☰ 19. Future Directions and Ecosystem
                                                                                                                                                                                              • ☰ 19.1. Kubernetes ecosystem overview
                                                                                                                                                                                                • ☰ 19.2. OpenShift roadmap
                                                                                                                                                                                                  • ☰ 19.3. Serverless and event-driven workloads
                                                                                                                                                                                                    • ☰ 19.4. AI and data platforms on OpenShift
                                                                                                                                                                                                    • ☰ 20. Final Project and Hands-On Exercises
                                                                                                                                                                                                      • ☰ 20.1. Deploying a containerized application
                                                                                                                                                                                                        • ☰ 20.2. Implementing CI/CD with OpenShift
                                                                                                                                                                                                          • ☰ 20.3. Securing and scaling an application
                                                                                                                                                                                                            • ☰ 20.4. Monitoring and troubleshooting report