victoriametrics-monitoring02 #40

Merged
torjus merged 3 commits from victoriametrics-monitoring02 into master 2026-02-16 23:56:04 +00:00
Owner

Summary

  • Set up VictoriaMetrics, vmalert, and Alertmanager on monitoring02 as Phase 2 of the monitoring migration, running in parallel with monitoring01's Prometheus
  • Add Caddy reverse proxies for VictoriaMetrics and vmalert with TLS termination via internal ACME CA
  • Grant monitoring02 Vault access to the apiary bearer token for external metrics scraping

Changes

  • services/victoriametrics/default.nix - New VictoriaMetrics service with all scrape configs, vmalert with blackhole notifier, and Alertmanager
  • services/grafana/default.nix - Add VictoriaMetrics as default datasource, rename Prometheus datasource, refactor Caddy to virtualHosts
  • hosts/monitoring02/default.nix - Import new services
  • hosts/monitoring02/configuration.nix - Add DNS CNAMEs for metrics and vmalert
  • terraform/vault/approle.tf - Add apiary-token path to monitoring02 AppRole policy
## Summary - Set up VictoriaMetrics, vmalert, and Alertmanager on monitoring02 as Phase 2 of the monitoring migration, running in parallel with monitoring01's Prometheus - Add Caddy reverse proxies for VictoriaMetrics and vmalert with TLS termination via internal ACME CA - Grant monitoring02 Vault access to the apiary bearer token for external metrics scraping ## Changes - `services/victoriametrics/default.nix` - New VictoriaMetrics service with all scrape configs, vmalert with blackhole notifier, and Alertmanager - `services/grafana/default.nix` - Add VictoriaMetrics as default datasource, rename Prometheus datasource, refactor Caddy to virtualHosts - `hosts/monitoring02/default.nix` - Import new services - `hosts/monitoring02/configuration.nix` - Add DNS CNAMEs for metrics and vmalert - `terraform/vault/approle.tf` - Add apiary-token path to monitoring02 AppRole policy
torjus added 3 commits 2026-02-16 23:55:59 +00:00
Set up the core metrics stack on monitoring02 as Phase 2 of the
monitoring migration. VictoriaMetrics replaces Prometheus with
identical scrape configs (22 jobs including auto-generated targets).

- VictoriaMetrics with 3-month retention and all scrape configs
- vmalert evaluating existing rules.yml (notifier disabled)
- Alertmanager with same routing config (no alerts during parallel op)
- Grafana datasources updated: local VictoriaMetrics as default
- Static user override for credential file access (OpenBao, Apiary)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Add metrics.home.2rjus.net and vmalert.home.2rjus.net CNAMEs with
Caddy TLS termination via internal ACME CA.

Refactors Grafana's Caddy config from configFile to globalConfig +
virtualHosts so both modules can contribute routes to the same
Caddy instance.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
terraform: grant monitoring02 access to apiary-token secret
Some checks failed
Run nix flake check / flake-check (push) Failing after 3m59s
Run nix flake check / flake-check (pull_request) Failing after 4m20s
a013e80f1a
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
torjus merged commit 471f536f1f into master 2026-02-16 23:56:04 +00:00
torjus deleted branch victoriametrics-monitoring02 2026-02-16 23:56:04 +00:00
Sign in to join this conversation.
No Reviewers
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: torjus/nixos-servers#40