Thanos (Multi Cluster Prometheus) Tutorial: Global View - Long Term Storage - Kubernetes
Source: YouTube · Anton Putra · published May 10, 2023 · 51:01
This video demonstrates how to set up Thanos to extend Prometheus for distributed monitoring across Kubernetes clusters, solving scalability and data retention challenges 0:00.
Key Takeaways:
• Traditional Prometheus setups have limitations including 15-day data retention, inability to aggregate metrics across multiple clusters, and VPN hassles when switching between environments 1:25
• Remote read approach uses sidecars with Prometheus that expose data to a centralized Thanos querier, but requires potentially exposing local Prometheus to the internet 3:07
• Remote write is the preferred production approach where Prometheus pushes metrics to a Thanos receiver, offering better performance and compatibility with managed Prometheus services 5:54
• Setting up mutual TLS secures communication between components and is essential when exposing Thanos components externally 22:10
• For production deployments, implement sharding with multiple receiver instances and consider using five shards for optimal performance 42:01
The tutorial provides a comprehensive guide to implementing Thanos for long-term metric storage and cross-cluster monitoring in Kubernetes environments.
Sources:
Generate CPE Credits
Generate a professional CPE document from this video's transcript.
Estimated credit: 1 CPE hours
Estimate uses the video runtime (1 hour ≈ 1 CPE, rounded to the nearest 0.5, minimum 0.5, maximum 2.0). The final amount can be lower after review, never higher.
Topic: Cloud Security. Commonly maps to: Security Architecture and Engineering, Communication and Network Security. Exact CISSP domains are assigned during generation.
Free account. One generation at a time, with a daily limit.
CPEBuddy is independent and not affiliated with or endorsed by ISC2, ISACA, or any certification body. Exports are formatted for common CPE submissions; acceptance is at your certification body's discretion.
Transcript Preview
First 800 characters of the transcript
Let's take a look at a common Prometheus setup. Let’s say you have a development environment. Typically you would use a Kubernetes cluster
to run your apps, maybe managed AWS EKS service. You would deploy your applications within
Kubernetes, and you might also have a few standalone services running on virtual machines
outside of Kubernetes. Often, we run stateful applications like databases
outside of Kubernetes. For example, this could include Kafka, Cassandra,
or even a self-hosted Postgres database. Next, you'd set up Prometheus in the Kubernetes
cluster using the Prometheus Operator, and configure it to collect data from both the
containers within Kubernetes and the standalone virtual machines. Typically, we also install Grafana on the
same cluster and connect it to Prometheus as a dat…