feat(helm)!: Update chart loki to 6.12.0

[wyoa-bot]

This PR contains the following updates:

Package	Update	Change
loki (source)	major	5.41.4 -> 6.12.0

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR has been generated by Renovate Bot.

[wyoa-bot]

Path: cluster/apps/monitoring/loki/helm-release.yaml%0AVersion: 5.41.4 -> 6.0.0%0A%0A```diff%0A@@ -1,4 +1,40 @@%0A ---%0A+# Source: loki/templates/chunks-cache/poddisruptionbudget-chunks-cache.yaml%0A+apiVersion: policy/v1beta1%0A+kind: PodDisruptionBudget%0A+metadata:%0A+ name: loki-memcached-chunks-cache%0A+ namespace: default%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: memcached-chunks-cache%0A+spec:%0A+ selector:%0A+ matchLabels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: memcached-chunks-cache%0A+ maxUnavailable: 1%0A+---%0A+# Source: loki/templates/results-cache/poddisruptionbudget-results-cache.yaml%0A+apiVersion: policy/v1beta1%0A+kind: PodDisruptionBudget%0A+metadata:%0A+ name: loki-memcached-results-cache%0A+ namespace: default%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: memcached-results-cache%0A+spec:%0A+ selector:%0A+ matchLabels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: memcached-results-cache%0A+ maxUnavailable: 1%0A+---%0A # Source: loki/templates/loki-canary/serviceaccount.yaml%0A apiVersion: v1%0A kind: ServiceAccount%0A@@ -39,8 +75,23 @@%0A analytics:%0A reporting_enabled: false%0A auth_enabled: false%0A+ chunk_store_config:%0A+ chunk_cache_config:%0A+ background:%0A+ writeback_buffer: 500000%0A+ writeback_goroutines: 1%0A+ writeback_size_limit: 500MB%0A+ default_validity: 0s%0A+ memcached:%0A+ batch_size: 4%0A+ parallelism: 5%0A+ memcached_client:%0A+ addresses: dnssrvnoa+_memcached-client._tcp.loki-chunks-cache.default.svc%0A+ consistent_hash: true%0A+ max_idle_conns: 72%0A+ timeout: 2000ms%0A common:%0A- compactor_address: 'loki-backend'%0A+ compactor_address: 'http://loki-backend:3100'%0A path_prefix: /var/loki%0A replication_factor: 1%0A ring:%0A@@ -63,11 +114,12 @@%0A shared_store: s3%0A working_directory: /var/loki/boltdb-shipper-compactor%0A frontend:%0A- scheduler_address: query-scheduler-discovery.default.svc.cluster.local.:9095%0A+ scheduler_address: ""%0A+ tail_proxy_url: http://loki-querier.default.svc.cluster.local:3100%0A frontend_worker:%0A- scheduler_address: query-scheduler-discovery.default.svc.cluster.local.:9095%0A+ scheduler_address: ""%0A index_gateway:%0A- mode: ring%0A+ mode: simple%0A ingester:%0A chunk_block_size: 262144%0A max_chunk_age: 1h%0A@@ -77,6 +129,7 @@%0A ingestion_burst_size_mb: 16%0A ingestion_rate_mb: 8%0A max_cache_freshness_per_query: 10m%0A+ query_timeout: 300s%0A reject_old_samples: true%0A reject_old_samples_max_age: 168h%0A retention_period: 14d%0A@@ -86,6 +139,19 @@%0A - loki-memberlist%0A query_range:%0A align_queries_with_step: true%0A+ cache_results: true%0A+ results_cache:%0A+ cache:%0A+ background:%0A+ writeback_buffer: 500000%0A+ writeback_goroutines: 1%0A+ writeback_size_limit: 500MB%0A+ default_validity: 12h%0A+ memcached_client:%0A+ addresses: dnssrvnoa+_memcached-client._tcp.loki-results-cache.default.svc%0A+ consistent_hash: true%0A+ timeout: 500ms%0A+ update_interval: 1m%0A ruler:%0A alertmanager_url: http://kube-prometheus-stack-alertmanager.monitoring:9093%0A enable_alertmanager_v2: true%0A@@ -110,12 +176,20 @@%0A server:%0A grpc_listen_port: 9095%0A http_listen_port: 3100%0A+ http_server_read_timeout: 600s%0A+ http_server_write_timeout: 600s%0A log_level: info%0A storage_config:%0A+ boltdb_shipper:%0A+ index_gateway_client:%0A+ server_address: dns+loki-backend-headless.default.svc.cluster.local:9095%0A hedging:%0A at: 250ms%0A max_per_second: 20%0A up_to: 3%0A+ tsdb_shipper:%0A+ index_gateway_client:%0A+ server_address: dns+loki-backend-headless.default.svc.cluster.local:9095%0A tracing:%0A enabled: false%0A ---%0A@@ -131,7 +205,7 @@%0A app.kubernetes.io/managed-by: Helm%0A app.kubernetes.io/component: gateway%0A data:%0A- nginx.conf: "worker_processes 5; ## Default: 1\nerror_log /dev/stderr;\npid /tmp/nginx.pid;\nworker_rlimit_nofile 8192;\n\nevents {\n worker_connections 4096; ## Default: 1024\n}\n\nhttp {\n client_body_temp_path /tmp/client_temp;\n proxy_temp_path /tmp/proxy_temp_path;\n fastcgi_temp_path /tmp/fastcgi_temp;\n uwsgi_temp_path /tmp/uwsgi_temp;\n scgi_temp_path /tmp/scgi_temp;\n\n client_max_body_size 4M;\n\n proxy_read_timeout 600; ## 10 minutes\n proxy_send_timeout 600;\n proxy_connect_timeout 600;\n\n proxy_http_version 1.1;\n\n default_type application/octet-stream;\n log_format main '$remote_addr - $remote_user [$time_local] $status '\n '"$request" $body_bytes_sent "$http_referer" '\n '"$http_user_agent" "$http_x_forwarded_for"';\n access_log /dev/stderr main;\n\n sendfile on;\n tcp_nopush on;\n resolver kube-dns.kube-system.svc.cluster.local.;\n \n\n server {\n listen 8080;\n listen [::]:8080;\n\n location = / {\n return 200 'OK';\n auth_basic off;\n }\n\n\n # Distributor\n location = /api/prom/push {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/push {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /distributor/ring {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n # Ingester\n location = /flush {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /ingester/ {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /ingester {\n internal; # to suppress 301\n }\n\n # Ring\n location = /ring {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n # MemberListKV\n location = /memberlist {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n\n # Ruler\n location = /ruler/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /api/prom/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /api/prom/rules/ {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /loki/api/v1/rules/ {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /prometheus/api/v1/alerts {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /prometheus/api/v1/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # Compactor\n location = /compactor/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/delete {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/cache/generation_numbers {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # IndexGateway\n location = /indexgateway/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # QueryScheduler\n location = /scheduler/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # Config\n location = /config {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n\n # QueryFrontend, Querier\n location = /api/prom/tail {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n proxy_set_header Upgrade $http_upgrade;\n proxy_set_header Connection "upgrade";\n }\n location = /loki/api/v1/tail {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n proxy_set_header Upgrade $http_upgrade;\n proxy_set_header Connection "upgrade";\n }\n location ^~ /api/prom/ {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n }\n location = /api/prom {\n internal; # to suppress 301\n }\n location ^~ /loki/api/v1/ {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1 {\n internal; # to suppress 301\n }\n }\n}\n"%0A+ nginx.conf: "worker_processes 5; ## Default: 1\nerror_log /dev/stderr;\npid /tmp/nginx.pid;\nworker_rlimit_nofile 8192;\n\nevents {\n worker_connections 4096; ## Default: 1024\n}\n\nhttp {\n client_body_temp_path /tmp/client_temp;\n proxy_temp_path /tmp/proxy_temp_path;\n fastcgi_temp_path /tmp/fastcgi_temp;\n uwsgi_temp_path /tmp/uwsgi_temp;\n scgi_temp_path /tmp/scgi_temp;\n\n client_max_body_size 4M;\n\n proxy_read_timeout 600; ## 10 minutes\n proxy_send_timeout 600;\n proxy_connect_timeout 600;\n\n proxy_http_version 1.1;\n\n default_type application/octet-stream;\n log_format main '$remote_addr - $remote_user [$time_local] $status '\n '"$request" $body_bytes_sent "$http_referer" '\n '"$http_user_agent" "$http_x_forwarded_for"';\n access_log /dev/stderr main;\n\n sendfile on;\n tcp_nopush on;\n resolver kube-dns.kube-system.svc.cluster.local.;\n \n\n server {\n listen 8080;\n listen [::]:8080;\n\n location = / {\n return 200 'OK';\n auth_basic off;\n }\n\n ########################################################\n # Configure backend targets# Distributor\n location = /api/prom/push {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/push {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /distributor/ring {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n # Ingester\n location = /flush {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /ingester/ {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n location = /ingester {\n internal; # to suppress 301\n }\n\n # Ring\n location = /ring {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n # MemberListKV\n location = /memberlist {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n # Ruler\n location = /ruler/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /api/prom/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /api/prom/rules/ {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location ^~ /loki/api/v1/rules/ {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /prometheus/api/v1/alerts {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /prometheus/api/v1/rules {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # Compactor\n location = /compactor/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/delete {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1/cache/generation_numbers {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # IndexGateway\n location = /indexgateway/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # QueryScheduler\n location = /scheduler/ring {\n proxy_pass http://loki-backend.default.svc.cluster.local:3100$request_uri;\n }\n\n # Config\n location = /config {\n proxy_pass http://loki-write.default.svc.cluster.local:3100$request_uri;\n }\n\n\n # QueryFrontend, Querier\n location = /api/prom/tail {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n proxy_set_header Upgrade $http_upgrade;\n proxy_set_header Connection "upgrade";\n }\n location = /loki/api/v1/tail {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n proxy_set_header Upgrade $http_upgrade;\n proxy_set_header Connection "upgrade";\n }\n location ^~ /api/prom/ {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n }\n location = /api/prom {\n internal; # to suppress 301\n }\n location ^~ /loki/api/v1/ {\n proxy_pass http://loki-read.default.svc.cluster.local:3100$request_uri;\n }\n location = /loki/api/v1 {\n internal; # to suppress 301\n }\n }\n}\n"%0A ---%0A # Source: loki/templates/monitoring/dashboards/configmap-1.yaml%0A apiVersion: v1%0A@@ -152,7 +226,7 @@%0A "loki-deletion.json": |%0A {"annotations":{"list":[]},"editable":true,"gnetId":null,"graphTooltip":0,"hideControls":false,"links":[{"asDropdown":true,"icon":"external link","includeVars":true,"keepTime":true,"tags":["loki"],"targetBlank":false,"title":"Loki Dashboards","type":"dashboards"}],"refresh":"10s","rows":[{"collapse":false,"height":"100px","panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"format":"none","id":1,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":6,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(loki_compactor_pending_delete_requests_count{cluster="$cluster", namespace="$namespace"})","format":"time_series","instant":true,"intervalFactor":2,"refId":"A"}],"thresholds":"70,80","timeFrom":null,"timeShift":null,"title":"Number of Pending Requests","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"singlestat","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"format":"dtdurations","id":2,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":6,"stack":false,"steppedLine":false,"targets":[{"expr":"max(loki_compactor_oldest_pending_delete_request_age_seconds{cluster="$cluster", namespace="$namespace"})","format":"time_series","instant":true,"intervalFactor":2,"refId":"A"}],"thresholds":"70,80","timeFrom":null,"timeShift":null,"title":"Oldest Pending Request Age","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"singlestat","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]}],"repeat":null,"repeatIteration":null,"repeatRowId":null,"showTitle":false,"title":"Headlines","titleSize":"h6"},{"collapse":false,"height":"250px","panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"id":3,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":6,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(increase(loki_compactor_delete_requests_received_total{cluster="$cluster", namespace="$namespace"}[1d]))","format":"time_series","intervalFactor":2,"legendFormat":"received","legendLink":null,"step":10}],"thresholds":[],"timeFrom":null,"timeShift":null,"title":"Delete Requests Received / Day","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"id":4,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":6,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(increase(loki_compactor_delete_requests_processed_total{cluster="$cluster", namespace="$namespace"}[1d]))","format":"time_series","intervalFactor":2,"legendFormat":"processed","legendLink":null,"step":10}],"thresholds":[],"timeFrom":null,"timeShift":null,"title":"Delete Requests Processed / Day","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]}],"repeat":null,"repeatIteration":null,"repeatRowId":null,"showTitle":true,"title":"Churn","titleSize":"h6"},{"collapse":false,"height":"250px","panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"id":5,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":12,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(increase(loki_compactor_load_pending_requests_attempts_total{status="fail", cluster="$cluster", namespace="$namespace"}[1h]))","format":"time_series","intervalFactor":2,"legendFormat":"failures","legendLink":null,"step":10}],"thresholds":[],"timeFrom":null,"timeShift":null,"title":"Failures in Loading Delete Requests / Hour","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]}],"repeat":null,"repeatIteration":null,"repeatRowId":null,"showTitle":true,"title":"Failures","titleSize":"h6"},{"collapse":false,"height":"250px","panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"id":6,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":true,"total":false,"values":false},"lines":true,"linewidth":1,"links":[],"nullPointMode":"null as zero","percentage":false,"pointradius":5,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"span":12,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(loki_compactor_deleted_lines{cluster="$cluster",job="$namespace/(loki|enterprise-logs)-read"}[$__rate_interval])) by (user)","format":"time_series","intervalFactor":2,"legendFormat":"{{user}}","legendLink":null,"step":10}],"thresholds":[],"timeFrom":null,"timeShift":null,"title":"Lines Deleted / Sec","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":0,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}]}],"repeat":null,"repeatIteration":null,"repeatRowId":null,"showTitle":true,"title":"Deleted lines","titleSize":"h6"}],"schemaVersion":14,"style":"dark","tags":["loki"],"templating":{"list":[{"current":{"text":"default","value":"default"},"hide":0,"label":"Data Source","name":"datasource","options":[],"query":"prometheus","refresh":1,"regex":"","type":"datasource"},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"cluster","multi":false,"name":"cluster","options":[],"query":"label_values(loki_build_info, cluster)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"namespace","multi":false,"name":"namespace","options":[],"query":"label_values(loki_build_info{cluster="$cluster"}, namespace)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false}]},"time":{"from":"now-1h","to":"now"},"timepicker":{"refresh_intervals":["5s","10s","30s","1m","5m","15m","30m","1h","2h","1d"],"time_options":["5m","15m","1h","6h","12h","24h","2d","7d","30d"]},"timezone":"utc","title":"Loki / Deletion","uid":"deletion","version":0}%0A "loki-logs.json": |%0A- {"annotations":{"list":[]},"editable":true,"gnetId":null,"graphTooltip":0,"hideControls":false,"id":8,"iteration":1583185057230,"links":[{"asDropdown":true,"icon":"external link","includeVars":true,"keepTime":true,"tags":["loki"],"targetBlank":false,"title":"Loki Dashboards","type":"dashboards"}],"panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":0,"y":0},"hiddenSeries":false,"id":35,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(go_goroutines{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod"})","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"goroutines","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":3,"y":0},"hiddenSeries":false,"id":41,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(go_gc_duration_seconds{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod"}) by (quantile)","legendFormat":"{{quantile}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"gc duration","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":6,"y":0},"hiddenSeries":false,"id":36,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_cpu_usage_seconds_total{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod", container="$container"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"cpu","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":9,"y":0},"hiddenSeries":false,"id":40,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(container_memory_working_set_bytes{cluster="$cluster", namespace="$namespace", pod=~"$deployment.", pod="$pod", container="$container"})","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"working set","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":12,"y":0},"hiddenSeries":false,"id":38,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_network_transmit_bytes_total{cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"tx","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":15,"y":0},"hiddenSeries":false,"id":39,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_network_receive_bytes_total{cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"rx","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"decbytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":18,"y":0},"hiddenSeries":false,"id":37,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"increase(kube_pod_container_status_last_terminated_reason{cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod", container="$container"}[30m]) \u003e 0","legendFormat":"{{reason}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"restarts","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":21,"y":0},"hiddenSeries":false,"id":42,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(promtail_custom_bad_words_total{cluster="$cluster", exported_namespace="$namespace", exported_pod="$deployment.", exported_pod="$pod", container="$container"}[5m])) by (level)","legendFormat":"{{level}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"bad words","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$logs","fill":1,"fillGradient":0,"gridPos":{"h":7,"w":24,"x":0,"y":4},"hiddenSeries":false,"id":31,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[{"alias":"warn","color":"#FF780A"},{"alias":"error","color":"#E02F44"},{"alias":"info","color":"#56A64B"},{"alias":"debug","color":"#3274D9"}],"spaceLength":10,"stack":true,"steppedLine":false,"targets":[{"expr":"sum(rate({cluster="$cluster", namespace="$namespace", pod=~"$deployment.", pod="$pod", container="$container" } |logfmt| level="$level" |= "$filter" [5m])) by (level)","intervalFactor":3,"legendFormat":"{{level}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"Log Rate","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"graph","xaxis":{"buckets":null,"mode":"time","name":null,"show":false,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}],"yaxis":{"align":false,"alignLevel":null}},{"datasource":"$logs","gridPos":{"h":19,"w":24,"x":0,"y":6},"id":29,"maxDataPoints":"","options":{"showLabels":false,"showTime":true,"sortOrder":"Descending","wrapLogMessage":true},"targets":[{"expr":"{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod", container="$container"} | logfmt | level="$level" |= "$filter"","refId":"A"}],"timeFrom":null,"timeShift":null,"title":"Logs","type":"logs"}],"refresh":"10s","rows":[],"schemaVersion":14,"style":"dark","tags":["loki"],"templating":{"list":[{"current":{"text":"default","value":"default"},"hide":0,"label":"Data Source","name":"datasource","options":[],"query":"prometheus","refresh":1,"regex":"","type":"datasource"},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"cluster","multi":false,"name":"cluster","options":[],"query":"label_values(loki_build_info, cluster)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"namespace","multi":false,"name":"namespace","options":[],"query":"label_values(loki_build_info{cluster="$cluster"}, namespace)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"hide":0,"label":null,"name":"logs","options":[],"query":"loki","refresh":1,"regex":"","type":"datasource"},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"deployment","options":[],"query":"label_values(kube_deployment_created{cluster="$cluster", namespace="$namespace"}, deployment)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"pod","options":[],"query":"label_values(kube_pod_container_info{cluster="$cluster", namespace="$namespace", pod=~"$deployment."}, pod)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"container","options":[],"query":"label_values(kube_pod_container_info{cluster="$cluster", namespace="$namespace", pod="$pod", pod="$deployment."}, container)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{"selected":true,"text":"","value":""},"hide":0,"includeAll":false,"label":"","multi":true,"name":"level","options":[{"selected":false,"text":"debug","value":"debug"},{"selected":false,"text":"info","value":"info"},{"selected":false,"text":"warn","value":"warn"},{"selected":false,"text":"error","value":"error"}],"query":"debug,info,warn,error","refresh":0,"type":"custom"},{"current":{"selected":false,"text":"","value":""},"label":"LogQL Filter","name":"filter","query":"","type":"textbox"}]},"time":{"from":"now-1h","to":"now"},"timepicker":{"refresh_intervals":["5s","10s","30s","1m","5m","15m","30m","1h","2h","1d"],"time_options":["5m","15m","1h","6h","12h","24h","2d","7d","30d"]},"timezone":"utc","title":"Loki / Logs","uid":"logs","version":0}%0A+ {"annotations":{"list":[]},"editable":true,"gnetId":null,"graphTooltip":0,"hideControls":false,"id":8,"iteration":1583185057230,"links":[{"asDropdown":true,"icon":"external link","includeVars":true,"keepTime":true,"tags":["loki"],"targetBlank":false,"title":"Loki Dashboards","type":"dashboards"}],"panels":[{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":0,"y":0},"hiddenSeries":false,"id":35,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(go_goroutines{cluster="$cluster", namespace="$namespace", pod=~"$deployment.", pod="$pod"})","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"goroutines","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":3,"y":0},"hiddenSeries":false,"id":41,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(go_gc_duration_seconds{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod"}) by (quantile)","legendFormat":"{{quantile}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"gc duration","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":6,"y":0},"hiddenSeries":false,"id":36,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_cpu_usage_seconds_total{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod", container="$container"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"cpu","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":9,"y":0},"hiddenSeries":false,"id":40,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(container_memory_working_set_bytes{cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod", container="$container"})","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"working set","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":12,"y":0},"hiddenSeries":false,"id":38,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_network_transmit_bytes_total{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"tx","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":15,"y":0},"hiddenSeries":false,"id":39,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(container_network_receive_bytes_total{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod"}[5m]))","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"rx","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"decbytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":18,"y":0},"hiddenSeries":false,"id":37,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"increase(kube_pod_container_status_last_terminated_reason{cluster="$cluster", namespace="$namespace", pod="$deployment.", pod="$pod", container="$container"}[30m]) \u003e 0","legendFormat":"{{reason}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"restarts","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$datasource","fill":1,"fillGradient":0,"gridPos":{"h":4,"w":3,"x":21,"y":0},"hiddenSeries":false,"id":42,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[],"spaceLength":10,"stack":false,"steppedLine":false,"targets":[{"expr":"sum(rate(promtail_custom_bad_words_total{cluster="$cluster", exported_namespace="$namespace", exported_pod=~"$deployment.", exported_pod="$pod", container="$container"}[5m])) by (level)","legendFormat":"{{level}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"bad words","tooltip":{"shared":true,"sort":0,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":true,"values":[]},"yaxes":[{"format":"bytes","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true}],"yaxis":{"align":false,"alignLevel":null}},{"aliasColors":{},"bars":false,"dashLength":10,"dashes":false,"datasource":"$logs","fill":1,"fillGradient":0,"gridPos":{"h":7,"w":24,"x":0,"y":4},"hiddenSeries":false,"id":31,"legend":{"avg":false,"current":false,"max":false,"min":false,"show":false,"total":false,"values":false},"lines":true,"linewidth":1,"nullPointMode":"null","options":{"dataLinks":[]},"percentage":false,"pointradius":2,"points":false,"renderer":"flot","seriesOverrides":[{"alias":"warn","color":"#FF780A"},{"alias":"error","color":"#E02F44"},{"alias":"info","color":"#56A64B"},{"alias":"debug","color":"#3274D9"}],"spaceLength":10,"stack":true,"steppedLine":false,"targets":[{"expr":"sum(rate({cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod", container="$container" } |logfmt| level="$level" |= "$filter" [5m])) by (level)","intervalFactor":3,"legendFormat":"{{level}}","refId":"A"}],"thresholds":[],"timeFrom":null,"timeRegions":[],"timeShift":null,"title":"Log Rate","tooltip":{"shared":true,"sort":2,"value_type":"individual"},"type":"timeseries","xaxis":{"buckets":null,"mode":"time","name":null,"show":false,"values":[]},"yaxes":[{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":true},{"format":"short","label":null,"logBase":1,"max":null,"min":null,"show":false}],"yaxis":{"align":false,"alignLevel":null}},{"datasource":"$logs","gridPos":{"h":19,"w":24,"x":0,"y":6},"id":29,"maxDataPoints":"","options":{"showLabels":false,"showTime":true,"sortOrder":"Descending","wrapLogMessage":true},"targets":[{"expr":"{cluster="$cluster", namespace="$namespace", pod="$deployment.*", pod="$pod", container="$container"} | logfmt | level="$level" |= "$filter"","refId":"A"}],"timeFrom":null,"timeShift":null,"title":"Logs","type":"logs"}],"refresh":"10s","rows":[],"schemaVersion":14,"style":"dark","tags":["loki"],"templating":{"list":[{"current":{"text":"default","value":"default"},"hide":0,"label":"Data Source","name":"datasource","options":[],"query":"prometheus","refresh":1,"regex":"","type":"datasource"},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"cluster","multi":false,"name":"cluster","options":[],"query":"label_values(loki_build_info, cluster)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{"text":"prod","value":"prod"},"datasource":"$datasource","hide":0,"includeAll":false,"label":"namespace","multi":false,"name":"namespace","options":[],"query":"label_values(loki_build_info{cluster="$cluster"}, namespace)","refresh":1,"regex":"","sort":2,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"hide":0,"label":null,"name":"logs","options":[],"query":"loki","refresh":1,"regex":"","type":"datasource"},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"deployment","options":[],"query":"label_values(kube_deployment_created{cluster="$cluster", namespace="$namespace"}, deployment)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"pod","options":[],"query":"label_values(kube_pod_container_info{cluster="$cluster", namespace="$namespace", pod="$deployment."}, pod)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{},"datasource":"$datasource","hide":0,"includeAll":false,"label":null,"multi":false,"name":"container","options":[],"query":"label_values(kube_pod_container_info{cluster="$cluster", namespace="$namespace", pod="$pod", pod="$deployment."}, container)","refresh":0,"regex":"","sort":1,"tagValuesQuery":"","tags":[],"tagsQuery":"","type":"query","useTags":false},{"allValue":null,"current":{"selected":true,"text":"","value":""},"hide":0,"includeAll":false,"label":"","multi":true,"name":"level","options":[{"selected":false,"text":"debug","value":"debug"},{"selected":false,"text":"info","value":"info"},{"selected":false,"text":"warn","value":"warn"},{"selected":false,"text":"error","value":"error"}],"query":"debug,info,warn,error","refresh":0,"type":"custom"},{"current":{"selected":false,"text":"","value":""},"label":"LogQL Filter","name":"filter","query":"","type":"textbox"}]},"time":{"from":"now-1h","to":"now"},"timepicker":{"refresh_intervals":["5s","10s","30s","1m","5m","15m","30m","1h","2h","1d"],"time_options":["5m","15m","1h","6h","12h","24h","2d","7d","30d"]},"timezone":"utc","title":"Loki / Logs","uid":"logs","version":0}%0A "loki-mixin-recording-rules.json": |%0A {"annotations":{"list":[{"builtIn":1,"datasource":"-- Grafana --","enable":true,"hide":true,"iconColor":"rgba(0, 211, 255, 1)","name":"Annotations \u0026 Alerts","target":{"limit":100,"matchAny":false,"tags":[],"type":"dashboard"},"type":"dashboard"},{"datasource":"${datasource}","enable":false,"expr":"sum by (tenant) (changes(loki_ruler_wal_prometheus_tsdb_wal_truncations_total{tenant="${tenant}"}[$__rate_interval]))","iconColor":"red","name":"WAL Truncations","target":{"queryType":"Azure Monitor","refId":"Anno"},"titleFormat":"{{tenant}}"}]},"editable":true,"fiscalYearStartMonth":0,"gnetId":null,"graphTooltip":0,"iteration":1635347545534,"links":[],"liveNow":false,"panels":[{"datasource":"${datasource}","fieldConfig":{"defaults":{"color":{"mode":"thresholds"},"mappings":[],"noValue":"0","thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":1}]}},"overrides":[]},"gridPos":{"h":10,"w":2,"x":0,"y":0},"id":2,"options":{"colorMode":"value","graphMode":"area","justifyMode":"auto","orientation":"auto","reduceOptions":{"calcs":["lastNotNull"],"fields":"","values":false},"textMode":"auto"},"pluginVersion":"8.3.0-38205pre","targets":[{"datasource":"${datasource}","exemplar":false,"expr":"sum(loki_ruler_wal_appender_ready) by (pod, tenant) == 0","instant":true,"interval":"","legendFormat":"","refId":"A"}],"title":"Appenders Not Ready","type":"stat"},{"datasource":"${datasource}","description":"","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]}},"overrides":[]},"gridPos":{"h":10,"w":11,"x":2,"y":0},"id":4,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"sum(rate(loki_ruler_wal_samples_appended_total{tenant="${tenant}"}[$__rate_interval])) by (tenant) \u003e 0","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"Samples Appended to WAL per Second","type":"timeseries"},{"datasource":"${datasource}","description":"Series are unique combinations of labels","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]}},"overrides":[]},"gridPos":{"h":10,"w":11,"x":13,"y":0},"id":5,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"sum(rate(loki_ruler_wal_storage_created_series_total{tenant="${tenant}"}[$__rate_interval])) by (tenant) \u003e 0","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"Series Created per Second","type":"timeseries"},{"datasource":"${datasource}","description":"Difference between highest timestamp appended to WAL and highest timestamp successfully written to remote storage","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]}},"overrides":[]},"gridPos":{"h":10,"w":12,"x":0,"y":10},"id":6,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"loki_ruler_wal_prometheus_remote_storage_highest_timestamp_in_seconds{tenant="${tenant}"}\n- on (tenant)\n (\n loki_ruler_wal_prometheus_remote_storage_queue_highest_sent_timestamp_seconds{tenant="${tenant}"}\n or vector(0)\n )","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"Write Behind","type":"timeseries"},{"datasource":"${datasource}","description":"","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]}},"overrides":[]},"gridPos":{"h":10,"w":12,"x":12,"y":10},"id":7,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"sum(rate(loki_ruler_wal_prometheus_remote_storage_samples_total{tenant="${tenant}"}[$__rate_interval])) by (tenant) \u003e 0","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"Samples Sent per Second","type":"timeseries"},{"datasource":"${datasource}","description":"\n","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]},"unit":"bytes"},"overrides":[]},"gridPos":{"h":10,"w":12,"x":0,"y":20},"id":8,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"sum by (tenant) (loki_ruler_wal_disk_size{tenant="${tenant}"})","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"WAL Disk Size","type":"timeseries"},{"datasource":"${datasource}","description":"Some number of pending samples is expected, but if remote-write is failing this value will remain high","fieldConfig":{"defaults":{"color":{"mode":"palette-classic"},"custom":{"axisLabel":"","axisPlacement":"auto","barAlignment":0,"drawStyle":"line","fillOpacity":0,"gradientMode":"none","hideFrom":{"legend":false,"tooltip":false,"viz":false},"lineInterpolation":"linear","lineWidth":1,"pointSize":5,"scaleDistribution":{"type":"linear"},"showPoints":"auto","spanNulls":false,"stacking":{"group":"A","mode":"none"},"thresholdsStyle":{"mode":"off"}},"mappings":[],"thresholds":{"mode":"absolute","steps":[{"color":"green","value":null},{"color":"red","value":80}]}},"overrides":[]},"gridPos":{"h":10,"w":12,"x":12,"y":20},"id":9,"options":{"legend":{"calcs":[],"displayMode":"list","placement":"bottom"},"tooltip":{"mode":"single"}},"targets":[{"datasource":"${datasource}","exemplar":true,"expr":"max(loki_ruler_wal_prometheus_remote_storage_samples_pending{tenant="${tenant}"}) by (tenant,pod) \u003e 0","interval":"","legendFormat":"{{tenant}}","refId":"A"}],"title":"Pending Samples","type":"timeseries"}],"schemaVersion":31,"style":"dark","tags":[],"templating":{"list":[{"description":null,"error":null,"hide":0,"includeAll":false,"label":"Datasource","multi":false,"name":"datasource","options":[],"query":"prometheus","queryValue":"","refresh":1,"regex":"","skipUrlSync":false,"type":"datasource"},{"allValue":null,"datasource":"${datasource}","definition":"label_values(loki_ruler_wal_samples_appended_total, tenant)","description":null,"error":null,"hide":0,"includeAll":true,"label":"Tenant","multi":true,"name":"tenant","options":[],"query":{"query":"label_values(loki_ruler_wal_samples_appended_total, tenant)","refId":"StandardVariableQuery"},"refresh":2,"regex":"","skipUrlSync":false,"sort":0,"type":"query"}]},"time":{"from":"now-6h","to":"now"},"timepicker":{},"timezone":"","title":"Recording Rules","uid":"2xKA_ZK7k","version":9,"weekStart":""}%0A "loki-operational.json": |%0A@@ -234,6 +308,7 @@%0A kind: Service%0A metadata:%0A name: query-scheduler-discovery%0A+ namespace: default%0A labels:%0A app.kubernetes.io/name: loki%0A app.kubernetes.io/instance: loki%0A@@ -315,6 +390,33 @@%0A app.kubernetes.io/instance: loki%0A app.kubernetes.io/component: backend%0A ---%0A+# Source: loki/templates/chunks-cache/service-chunks-cache-headless.yaml%0A+apiVersion: v1%0A+kind: Service%0A+metadata:%0A+ name: loki-chunks-cache%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/managed-by: Helm%0A+ app.kubernetes.io/component: "memcached-chunks-cache"%0A+ annotations: {}%0A+ namespace: "default"%0A+spec:%0A+ type: ClusterIP%0A+ clusterIP: None%0A+ ports:%0A+ - name: memcached-client%0A+ port: 11211%0A+ targetPort: 11211%0A+ - name: http-metrics%0A+ port: 9150%0A+ targetPort: 9150%0A+ selector:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: "memcached-chunks-cache"%0A+---%0A # Source: loki/templates/gateway/service-gateway.yaml%0A apiVersion: v1%0A kind: Service%0A@@ -330,9 +432,9 @@%0A spec:%0A type: ClusterIP%0A ports:%0A- - name: http%0A+ - name: http-metrics%0A port: 80%0A- targetPort: http%0A+ targetPort: http-metrics%0A protocol: TCP%0A selector:%0A app.kubernetes.io/name: loki%0A@@ -422,6 +524,33 @@%0A app.kubernetes.io/instance: loki%0A app.kubernetes.io/component: read%0A ---%0A+# Source: loki/templates/results-cache/service-results-cache-headless.yaml%0A+apiVersion: v1%0A+kind: Service%0A+metadata:%0A+ name: loki-results-cache%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/managed-by: Helm%0A+ app.kubernetes.io/component: "memcached-results-cache"%0A+ annotations: {}%0A+ namespace: "default"%0A+spec:%0A+ type: ClusterIP%0A+ clusterIP: None%0A+ ports:%0A+ - name: memcached-client%0A+ port: 11211%0A+ targetPort: 11211%0A+ - name: http-metrics%0A+ port: 9150%0A+ targetPort: 9150%0A+ selector:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: "memcached-results-cache"%0A+---%0A # Source: loki/templates/service-memberlist.yaml%0A apiVersion: v1%0A kind: Service%0A@@ -540,7 +669,7 @@%0A runAsUser: 10001%0A containers:%0A - name: loki-canary%0A- image: docker.io/grafana/loki-canary:2.9.3%0A+ image: docker.io/grafana/loki-canary:3.0.0%0A imagePullPolicy: IfNotPresent%0A args:%0A - -addr=loki-gateway.default.svc.cluster.local.:80%0A@@ -548,12 +677,14 @@%0A - -labelvalue=$(POD_NAME)%0A - -user=self-monitoring%0A - -tenant-id=self-monitoring%0A+ - -push=true%0A securityContext:%0A allowPrivilegeEscalation: false%0A capabilities:%0A drop:%0A - ALL%0A readOnlyRootFilesystem: true%0A+ volumeMounts:%0A ports:%0A - name: http-metrics%0A containerPort: 3500%0A@@ -569,8 +700,9 @@%0A port: http-metrics%0A initialDelaySeconds: 15%0A timeoutSeconds: 1%0A+ volumes:%0A ---%0A-# Source: loki/templates/gateway/deployment-gateway.yaml%0A+# Source: loki/templates/gateway/deployment-gateway-nginx.yaml%0A apiVersion: apps/v1%0A kind: Deployment%0A metadata:%0A@@ -594,7 +726,7 @@%0A template:%0A metadata:%0A annotations:%0A- checksum/config: 7aa8db510d2cc395764b3c4e3cb7d046783b85df2affbb451afdbea1e71f3ef3%0A+ checksum/config: 69f3ae943db59758bb531cc9d90ce2c1e4b6e07371a4ff61dc106e9c92611d72%0A labels:%0A app.kubernetes.io/name: loki%0A app.kubernetes.io/instance: loki%0A@@ -613,13 +745,13 @@%0A image: docker.io/nginxinc/nginx-unprivileged:1.24-alpine%0A imagePullPolicy: IfNotPresent%0A ports:%0A- - name: http%0A+ - name: http-metrics%0A containerPort: 8080%0A protocol: TCP%0A readinessProbe:%0A httpGet:%0A path: /%0A- port: http%0A+ port: http-metrics%0A initialDelaySeconds: 15%0A timeoutSeconds: 1%0A securityContext:%0A@@ -641,8 +773,6 @@%0A requiredDuringSchedulingIgnoredDuringExecution:%0A - labelSelector:%0A matchLabels:%0A- app.kubernetes.io/name: loki%0A- app.kubernetes.io/instance: loki%0A app.kubernetes.io/component: gateway%0A topologyKey: kubernetes.io/hostname%0A volumes:%0A@@ -681,7 +811,7 @@%0A template:%0A metadata:%0A annotations:%0A- checksum/config: 6e4397acdf3fa71d0d6e655634173d21f87fd6b48cfac873b7e8b8af887bcb3b%0A+ checksum/config: be73b038872768594ab12f69c51a3e152ff8c3456cf4f4801ebe2e75bc3af024%0A labels:%0A app.kubernetes.io/part-of: memberlist%0A app.kubernetes.io/name: loki%0A@@ -698,7 +828,7 @@%0A terminationGracePeriodSeconds: 30%0A containers:%0A - name: loki%0A- image: docker.io/grafana/loki:2.9.3%0A+ image: docker.io/grafana/loki:3.0.0%0A imagePullPolicy: IfNotPresent%0A args:%0A - -config.file=/etc/loki/config/config.yaml%0A@@ -742,8 +872,6 @@%0A requiredDuringSchedulingIgnoredDuringExecution:%0A - labelSelector:%0A matchLabels:%0A- app.kubernetes.io/name: loki%0A- app.kubernetes.io/instance: loki%0A app.kubernetes.io/component: read%0A topologyKey: kubernetes.io/hostname%0A volumes:%0A@@ -789,7 +917,7 @@%0A template:%0A metadata:%0A annotations:%0A- checksum/config: 6e4397acdf3fa71d0d6e655634173d21f87fd6b48cfac873b7e8b8af887bcb3b%0A+ checksum/config: be73b038872768594ab12f69c51a3e152ff8c3456cf4f4801ebe2e75bc3af024%0A labels:%0A app.kubernetes.io/name: loki%0A app.kubernetes.io/instance: loki%0A@@ -827,7 +955,7 @@%0A - name: sc-rules-volume%0A mountPath: "/rules"%0A - name: loki%0A- image: docker.io/grafana/loki:2.9.3%0A+ image: docker.io/grafana/loki:3.0.0%0A imagePullPolicy: IfNotPresent%0A args:%0A - -config.file=/etc/loki/config/config.yaml%0A@@ -872,8 +1000,6 @@%0A requiredDuringSchedulingIgnoredDuringExecution:%0A - labelSelector:%0A matchLabels:%0A- app.kubernetes.io/name: loki%0A- app.kubernetes.io/instance: loki%0A app.kubernetes.io/component: backend%0A topologyKey: kubernetes.io/hostname%0A volumes:%0A@@ -902,6 +1028,184 @@%0A requests:%0A storage: "10Gi"%0A ---%0A+# Source: loki/templates/chunks-cache/statefulset-chunks-cache.yaml%0A+apiVersion: apps/v1%0A+kind: StatefulSet%0A+metadata:%0A+ name: loki-chunks-cache%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/managed-by: Helm%0A+ app.kubernetes.io/component: "memcached-chunks-cache"%0A+ name: "memcached-chunks-cache"%0A+ annotations: {}%0A+ namespace: "default"%0A+spec:%0A+ podManagementPolicy: Parallel%0A+ replicas: 1%0A+ selector:%0A+ matchLabels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: "memcached-chunks-cache"%0A+ name: "memcached-chunks-cache"%0A+ updateStrategy:%0A+ type: RollingUpdate%0A+ serviceName: loki-chunks-cache%0A+ template:%0A+ metadata:%0A+ labels:%0A+ app.kubernetes.io/name: loki%0A+ app.kubernetes.io/instance: loki%0A+ app.kubernetes.io/component: "memcached-chunks-cache"%...[Comment body truncated]

[wyoa-bot]

🦙 MegaLinter status: ✅ SUCCESS

Descriptor	Linter	Files	Fixed	Errors	Elapsed time
✅ YAML	yamllint	1		0	0.2s

See detailed report in MegaLinter reports
Set VALIDATE_ALL_CODEBASE: true in mega-linter.yml to validate all sources, not only the diff

MegaLinter is graciously provided by