41 Commits

Author SHA1 Message Date
jenkins
db446c9244 monitoring(ai): alert before Claude quota auth expires 2026-08-25 19:16:01 -03:00
jenkins
1f893fba27 monitoring(testing): retain scalar branch labels 2026-08-07 20:07:51 -03:00
jenkins
55d8831f8c monitoring(testing): keep quality rollups current 2026-08-07 20:02:13 -03:00
jenkins
2b0fdd1a03 feat(monitoring): make Hermes triage email mean something
Every human_required escalation already files an issue in the failing
service's own repository, and mailing on each one made the inbox the loudest
and least informative output of the system. Replace the blanket alert with
two narrow ones: a repair that ran and failed, which is the only case where
the automation acted and left things no better, and an escalation still
untouched after six hours.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-06 00:26:34 -03:00
jenkins
f4e2da317c feat(hermes-triage): human-required alert rule + Ariadne autotriage config
- vmalert: hermes-triage.yaml alert group (HermesTriageHumanRequired on
  ariadne_hermes_triage_incident{status="human_required"}, 1m interval),
  wire Alertmanager notifier into vmalert-atlas-availability
- Ariadne deployment: hermes autotriage env (observe mode: autotriage on,
  autoremediation OFF), 1m schedule, allowlist hermes-triage-demo only,
  HERMES_API_KEY from optional hermes-api-server-key Secret
2026-08-05 16:51:48 -03:00
jenkins
ba4b871a62 monitoring: publish availability outside query pool 2026-08-04 21:40:24 -03:00
jenkins
af10f7aadc monitoring: add daily availability rollups 2026-08-04 21:24:47 -03:00
jenkins
83696d46d2 monitoring: use request success for availability 2026-08-04 21:12:31 -03:00
jenkins
6b1d6388db monitoring: measure gateway availability 2026-08-04 21:02:19 -03:00
jenkins
026db898fc monitoring: preserve serving availability history 2026-08-04 18:39:36 -03:00
jenkins
5fabd1a84b monitoring: avoid unstable volume hosts 2026-08-04 18:06:43 -03:00
jenkins
7c6e7f9736 monitoring: reload vmalert rules automatically 2026-08-04 12:24:38 -03:00
jenkins
e354f3f83a monitoring: prevent query pool starvation 2026-08-04 12:22:23 -03:00
jenkins
6d5da627c5 monitoring(testing): backfill category health rollups 2026-05-20 14:39:07 -03:00
jenkins
c12cf6e776 monitoring(testing): attach branch labels to run rollups 2026-05-20 12:54:12 -03:00
jenkins
eb1838e29f monitoring(testing): memoize dashboard freshness panels 2026-05-20 12:45:50 -03:00
jenkins
5eef469eb7 monitoring(testing): record check health timelines 2026-05-20 12:14:49 -03:00
jenkins
1372ea7581 monitoring(testing): memoize slow dashboard panels 2026-05-20 11:52:25 -03:00
jenkins
2d6a1b5eaa monitoring(testing): surface current gate health 2026-05-20 11:01:28 -03:00
jenkins
4a3c083d80 monitoring(testing): roll up current test case state 2026-05-19 11:09:29 -03:00
jenkins
aa83a45db3 monitoring(testing): filter test category rollups 2026-05-18 19:32:17 -03:00
jenkins
196e4a5b9d monitoring(vmalert): roll test pass-rate rule update 2026-05-17 15:32:24 -03:00
jenkins
bfc587ef78 monitoring(testing): count failed test cases in pass-rate rollup 2026-05-17 15:27:21 -03:00
jenkins
31eda1893a monitoring: attach build branch to quality rollups 2026-05-16 18:22:16 -03:00
jenkins
2d601644f9 monitoring: make current gate rollup use latest checks 2026-05-16 18:07:21 -03:00
jenkins
8bc8443de3 monitoring: refresh quality rollups every minute 2026-05-16 18:00:52 -03:00
jenkins
399889cd1c monitoring: keep quality check status without branch labels 2026-05-16 17:49:37 -03:00
jenkins
2146decf72 monitoring: reload vmalert quality rules 2026-05-16 17:29:52 -03:00
jenkins
fab0000c9c monitoring: add typhon and category test telemetry 2026-05-16 15:38:26 -03:00
jenkins
69b2da9763 monitoring: add lesavka category test telemetry 2026-05-16 12:07:57 -03:00
jenkins
b5af3c92f4 monitoring: clarify testing and gitops dashboards 2026-05-15 22:07:41 -03:00
jenkins
e29a22e9c7 monitoring(testing): use lane timelines for test health 2026-05-15 21:05:13 -03:00
jenkins
7600a39bec monitoring: clarify testing dashboard health trends 2026-05-15 19:52:46 -03:00
jenkins
017f4cc5ea monitoring: tune testing dashboard and gate rollups 2026-05-15 14:26:06 -03:00
jenkins
44994a9510 monitoring: ignore availability scrape gaps 2026-05-10 16:38:05 -03:00
jenkins
ff21dc6d73 monitoring: count post-start availability gaps 2026-05-10 16:21:47 -03:00
jenkins
d7e3b425dd monitoring: fill pre-telemetry availability 2026-05-10 16:13:13 -03:00
jenkins
dff4df6cc6 monitoring: restart vmalert on rule changes 2026-05-10 15:50:50 -03:00
jenkins
0f0ef08429 monitoring: schedule availability rollup deterministically 2026-05-10 15:49:32 -03:00
jenkins
85174ff195 monitoring: fix vmalert remote write endpoint 2026-05-10 15:47:34 -03:00
jenkins
91605dab5a monitoring: precompute atlas availability rollup 2026-05-10 15:40:12 -03:00