252 Commits

Author SHA1 Message Date
c3555d59f7 monitoring: fix GPU share attribution 2026-01-28 19:08:53 -03:00
28af553498 monitoring: de-dupe ariadne schedule alert 2026-01-28 18:45:15 -03:00
b66c7de5fd monitoring: avoid ariadne alert title conflict 2026-01-28 14:02:12 -03:00
3d4e5bdde1 monitoring: disable legacy cron alert 2026-01-28 13:58:28 -03:00
f37baf2447 monitoring: restart grafana to reload alerts 2026-01-28 13:53:33 -03:00
ad3d8d75c9 monitoring: reuse maint-cron uid for ariadne alert 2026-01-28 13:52:12 -03:00
4ecfdcef7c monitoring: restart grafana for ariadne alerts 2026-01-28 13:49:41 -03:00
eab2ce50b1 monitoring: alert on ariadne schedules 2026-01-28 13:47:54 -03:00
36bb695c15 monitoring: fix grafana pod annotation indent 2026-01-28 12:37:42 -03:00
1a9651914e monitoring: restart grafana after alert fix 2026-01-28 12:32:56 -03:00
d55bc98bbe monitoring: fix postmark alert metrics 2026-01-28 12:31:33 -03:00
bc59270202 chore: organize one-off jobs 2026-01-28 01:48:32 -03:00
35d5d5a1a3 monitoring: fix grafana alert exec state 2026-01-27 23:34:11 -03:00
a49fa6dd33 monitoring: restart grafana for alerting reload 2026-01-27 23:29:46 -03:00
9a978c5e72 monitoring: tune cpu and maintenance alerts 2026-01-27 23:23:42 -03:00
32884e0b7e monitoring: fix grafana smtp from address 2026-01-27 22:28:37 -03:00
7b43e8654f monitoring: send grafana alerts via postmark 2026-01-27 22:00:19 -03:00
a255c60aed monitoring: fix gpu idle label 2026-01-27 21:46:58 -03:00
b4f5fbeb2b monitoring: unify gpu namespace usage 2026-01-27 21:43:37 -03:00
577e2a158d monitoring: keep idle label in gpu share 2026-01-27 18:44:58 -03:00
86cd5194ea monitoring: fix gpu idle share 2026-01-27 17:51:13 -03:00
c0073b08cc monitoring: fix tegrastats regexes 2026-01-27 16:44:00 -03:00
0a64708b3d monitoring: expose jetson scrape line length 2026-01-27 16:38:09 -03:00
aacfc8f28c monitoring: read tegrastats per scrape 2026-01-27 16:34:31 -03:00
3b20290561 monitoring: read jetson stats on demand 2026-01-27 16:27:45 -03:00
eb809524b5 monitoring: refresh jetson stats on scrape 2026-01-27 16:23:23 -03:00
0fbbbf39e9 monitoring: fix jetson gpu metrics 2026-01-27 16:19:54 -03:00
d5478e272e monitoring: restart jetson exporter 2026-01-26 22:51:41 -03:00
5393585f3e monitoring: fix jetson metrics newlines 2026-01-26 22:50:33 -03:00
995050f544 monitoring: unify jetson gpu metrics 2026-01-26 22:26:24 -03:00
6a5c9fb0e6 monitoring: map dcgm to shared gpu resources 2026-01-26 20:58:06 -03:00
f7d4425740 ariadne: reduce comms noise, fix gpu labels 2026-01-26 20:54:33 -03:00
993702afee monitoring: alert on VM outage 2026-01-23 11:51:28 -03:00
8b8766b0f0 monitoring: add postgres metrics and update overview 2026-01-22 18:23:26 -03:00
307d1bf7a6 ops: restore portal/ariadne and add postgres panels 2026-01-22 15:23:23 -03:00
e0308b89fd monitoring: enforce sorted job lists 2026-01-21 15:12:53 -03:00
9db260e482 monitoring: tighten jobs/overview ordering 2026-01-21 15:01:02 -03:00
2fd87aea45 monitoring: refine jobs/overview panels 2026-01-21 14:31:11 -03:00
fc87432fdf monitoring: refresh jobs dashboards 2026-01-21 13:37:36 -03:00
4699ffbf2c monitoring: reschedule grafana user dedupe 2026-01-21 12:31:54 -03:00
190caf1729 monitoring: harden grafana user dedupe 2026-01-21 12:30:08 -03:00
d89d441486 monitoring: fix grafana user dedupe job 2026-01-21 12:25:53 -03:00
e8859e605a monitoring: prepopulate vault for dedupe job 2026-01-21 12:18:57 -03:00
10704a22d6 monitoring: wire vault sa for dedupe job 2026-01-21 12:16:26 -03:00
2f37a47869 monitoring: use python dedupe job 2026-01-21 12:15:03 -03:00
af789c0d0b monitoring: dedupe grafana user via api 2026-01-21 12:11:28 -03:00
d963001104 monitoring: add grafana user dedupe job 2026-01-21 12:08:23 -03:00
5fe70b1471 grafana: allow email-based oauth user lookup 2026-01-21 11:45:11 -03:00
aaeb933625 monitoring: refresh testing dashboard 2026-01-21 11:29:48 -03:00
c804ec040c glue: centralize sync tasks in ariadne 2026-01-21 02:57:40 -03:00