Kubernetes Measure Definitions

Prerequisites/troubleshooting lack of K8s metrics in Ternary:

It is important to note that we use Google's native Cloud Monitoring to gather Kubernetes metrics. It is enabled by default on GKE clusters. If you do not have it enabled, you will need to enable it for Ternary to ingest your Kubernetes cluster, namespace, workload and pod metrics.

Another issue we have seen, if Cloud Monitoring is enabled and we are still not seeing metrics, is permissions related issues in publishing the metrics to the GCP console in Cloud Monitoring. For example, if you use a custom service account and not the default Compute Engine service account the absence of metrics could be explained by missing roles such as roles/logging.logWriter, roles/monitoring.metricWriter, roles/stackdriver.resourceMetdata.writer. You can check if Kubernetes metrics are being published by navigating to the Metrics Explorer in the GCP console and replicating this query:

• Metric: Kubernetes Container - CPU Usage time
• Filters: project_id=your_project_id
• groupingFunction: Sum
• groupByLabels:
  • cluster_name
  • node_name
  • top_level_controller_name
  • top_level_controller_type
  • container_name
  • location
  • namespace_name
  • pod_name
• perSeriesAligner: Rate
• alignmentPeriod: 1h

If this query returns no results the issue may be in Cloud Monitoring metrics for Kubernetes being published to the GCP console.

Kubernetes Container Measure Definition

Kubernetes Node Measure Definition