mirror of
https://github.com/ryan4yin/nix-config.git
synced 2026-11-13 12:13:36 +01:00
The data dir is the module's own DynamicUser StateDirectory (already /var/lib/victoriametrics -> private/victoriametrics on youko), so the victoriametrics-data group, its tmpfiles rule and SupplementaryGroups did nothing. stateDir was set to its default. Assisted-by: Claude Code (claude-opus-5-5)
Monitoring & Alerting
Alert Rules & Recording Rules
- awesome-prometheus-alerts
- Collection of Prometheus alerting rules.
- victoria-metrics-k8s-stack/files/rules
- Alert Rules & Recording Rules used by kube-prometheus-stack.
Backup Freshness
modules/nixos/base/restic-backup.nix writes restic_backup_last_success_timestamp_seconds to
node_exporter's textfile collector after a successful run. alert_rules/restic-backup.yml alerts
when it is older than two days (the schedule is daily) or absent entirely.
TODO
- Dead-man switch:
Watchdoginalert_rules/general.ymlalways fires (vector(1)) but is routed to thenullreceiver inalert.nix, so a dead alerting pipeline looks identical to a healthy one. Route it to an external heartbeat service (healthchecks.io, Uptime Kuma, PagerDuty DeadMansSnitch) that notifies when the heartbeat stops, or run an out-of-band probe against Alertmanager.