docs: record the in-process repair timings and the classification-bleed fix
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
parent
b9b1634833
commit
1e67bab40a
@ -1017,6 +1017,14 @@ armed 20:58:10 -> build red 20:59:59 -> repair Job 21:01:14
|
|||||||
second run: red 21:43:55 -> repair 21:44:39 -> green 21:50:45 -> resolved 21:51:08
|
second run: red 21:43:55 -> repair 21:44:39 -> green 21:50:45 -> resolved 21:51:08
|
||||||
```
|
```
|
||||||
|
|
||||||
|
After converting the fixture repair from a spawned Kubernetes Job to an
|
||||||
|
in-process API call (Ariadne 0.1.0-402), the automated leg roughly halved:
|
||||||
|
|
||||||
|
```text
|
||||||
|
build red 02:20:03 -> fixture healthy 02:20:28 (25s)
|
||||||
|
-> rebuild triggered 02:20:41 -> green and resolved 02:21:07 (1m04s)
|
||||||
|
```
|
||||||
|
|
||||||
Code proposal: red build 22:34:59 -> pull request open 22:35:32 (33s).
|
Code proposal: red build 22:34:59 -> pull request open 22:35:32 (33s).
|
||||||
Hermes diagnosis latency across all runs: 15-21s.
|
Hermes diagnosis latency across all runs: 15-21s.
|
||||||
|
|
||||||
@ -1041,6 +1049,15 @@ Real homegrown service diagnoses (no action allowlisted, all escalated):
|
|||||||
job went green, the alert self-cleared through supersession.
|
job went green, the alert self-cleared through supersession.
|
||||||
- `soteria` returned `unknown` at 0.58 — below the 0.85 threshold and with
|
- `soteria` returned `unknown` at 0.58 — below the 0.85 threshold and with
|
||||||
no matching action, so two independent gates blocked it.
|
no matching action, so two independent gates blocked it.
|
||||||
|
- `bstein-dev-home/446` was classified `known_demo_fixture_failure` at 0.99,
|
||||||
|
even though build 445 of the same job had been classified correctly as
|
||||||
|
`sonarqube_node_runtime_missing`. The evidence gate refused it again, so
|
||||||
|
nothing ran, but the intermittency is the point: the same evidence produced
|
||||||
|
a demo-only classification on one run and the right one on another. The
|
||||||
|
triage prompt now interpolates the job under analysis and forbids the demo
|
||||||
|
classification and `repair_demo_fixture` on any job other than
|
||||||
|
`hermes-triage-demo` (Ariadne 0.1.0-403), removing the judgement call
|
||||||
|
rather than asking the model to make it correctly every time.
|
||||||
|
|
||||||
## Deviations from the plan
|
## Deviations from the plan
|
||||||
|
|
||||||
|
|||||||
@ -1017,6 +1017,14 @@ armed 20:58:10 -> build red 20:59:59 -> repair Job 21:01:14
|
|||||||
second run: red 21:43:55 -> repair 21:44:39 -> green 21:50:45 -> resolved 21:51:08
|
second run: red 21:43:55 -> repair 21:44:39 -> green 21:50:45 -> resolved 21:51:08
|
||||||
```
|
```
|
||||||
|
|
||||||
|
After converting the fixture repair from a spawned Kubernetes Job to an
|
||||||
|
in-process API call (Ariadne 0.1.0-402), the automated leg roughly halved:
|
||||||
|
|
||||||
|
```text
|
||||||
|
build red 02:20:03 -> fixture healthy 02:20:28 (25s)
|
||||||
|
-> rebuild triggered 02:20:41 -> green and resolved 02:21:07 (1m04s)
|
||||||
|
```
|
||||||
|
|
||||||
Code proposal: red build 22:34:59 -> pull request open 22:35:32 (33s).
|
Code proposal: red build 22:34:59 -> pull request open 22:35:32 (33s).
|
||||||
Hermes diagnosis latency across all runs: 15-21s.
|
Hermes diagnosis latency across all runs: 15-21s.
|
||||||
|
|
||||||
@ -1041,6 +1049,15 @@ Real homegrown service diagnoses (no action allowlisted, all escalated):
|
|||||||
job went green, the alert self-cleared through supersession.
|
job went green, the alert self-cleared through supersession.
|
||||||
- `soteria` returned `unknown` at 0.58 — below the 0.85 threshold and with
|
- `soteria` returned `unknown` at 0.58 — below the 0.85 threshold and with
|
||||||
no matching action, so two independent gates blocked it.
|
no matching action, so two independent gates blocked it.
|
||||||
|
- `bstein-dev-home/446` was classified `known_demo_fixture_failure` at 0.99,
|
||||||
|
even though build 445 of the same job had been classified correctly as
|
||||||
|
`sonarqube_node_runtime_missing`. The evidence gate refused it again, so
|
||||||
|
nothing ran, but the intermittency is the point: the same evidence produced
|
||||||
|
a demo-only classification on one run and the right one on another. The
|
||||||
|
triage prompt now interpolates the job under analysis and forbids the demo
|
||||||
|
classification and `repair_demo_fixture` on any job other than
|
||||||
|
`hermes-triage-demo` (Ariadne 0.1.0-403), removing the judgement call
|
||||||
|
rather than asking the model to make it correctly every time.
|
||||||
|
|
||||||
## Deviations from the plan
|
## Deviations from the plan
|
||||||
|
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user