K8s Infra

Proxmox Base

Resources:

• CPU
• RAM
• Ceph
  • Cephfs
  • Persistant Volumes
  • Object Store (S3, manual install)

Clusters

Infra Cluster

Observation

https://banzaicloud.com/blog/multi-cluster-monitoring/

• Thanos -> S3
• Grafana
• Elasticsearch
• Kibana

Authentication

• Dex

Registry

• Harbor

Users

• ArgoCD -> Deploy to Compute Clusters

Compute Cluster

Registry -> Infra/Harbor

Auth -> Infra/Dex

• Kube-State-Metrics
• Prometheus -> Infra/Thanos
• Fluent-Bit -> Infra/Elasticsearch
• MetalLB
• Ingress-Nginx
• Build Pipelines (Tekton, ?)
• Apps

AddOns

• https://istio.io/blog/2020/multi-cluster-mesh-automation/