cassandra-alpha/feedback
2
0
Issues 8 Activity

Commander game failed to launch #5

New Issue
Closed
opened 2026-06-28 14:15:20 +00:00 by veles-dev · 1 comment
veles-dev commented 2026-06-28 14:15:20 +00:00
Member
Copy Link

What happened

Run group ashen-vault-run never produced any observable games in the UI. Kubernetes shows sim job pod created and completed.image.png image.png

What should have happened

Games (at least one) should have populated in the run group. N

Category

  • kind: bridge-runtime / ops
  • severity: obvious

Context

Logs:

 D     ~/Development/veles-content/strategies/duel-commander   main  k logs -n veles veles-sim-ashen-vault-run-4510fa3f3d-hj4dk                                                    ✔  󱃾 default  11:10:16
{
  "ai_calls": {
    "by_cached_policy_kind": {},
    "by_cached_policy_reuse_mode": {},
    "by_chosen_priority_option_kind": {},
    "by_decision_source": {
      "subprocess": 1
    },
    "by_fallback_failure_kind": {},
    "by_fallback_failure_model": {},
    "by_model": {},
    "by_model_usage": {
      "unknown": {
        "cached_input_tokens": 0,
        "input_tokens": 0,
        "output_tokens": 0,
        "reasoning_tokens": 0,
        "total_calls": 1,
        "total_tokens": 0,
        "usage_rows": 0
      }
    },
    "by_priority_option_kind": {},
    "by_priority_subtype": {},
    "by_prompt_bucket": {
      "starting_player": 1
    },
    "by_prompt_bucket_usage": {
      "starting_player": {
        "cached_input_tokens": 0,
        "input_tokens": 0,
        "output_tokens": 0,
        "reasoning_tokens": 0,
        "total_calls": 1,
        "total_tokens": 0,
        "usage_rows": 0
      }
    },
    "by_prompt_type": {
      "starting_player": 1
    },
    "cached_input_tokens": 0,
    "capacity_note": "Codex CLI does not expose remaining quota to Veles yet.",
    "capacity_state": "capacity_unknown",
    "error_calls": 1,
    "failures": {
      "rate_or_usage": 1
    },
    "input_tokens": 0,
    "ok_calls": 0,
    "output_tokens": 0,
    "reasoning_tokens": 0,
    "sidecar_files": [
      "/data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.ai_calls.jsonl"
    ],
    "telemetry_schema_version": 4,
    "total_calls": 1,
    "total_elapsed_seconds": 7.234,
    "total_tokens": 0,
    "usage_rows": 0
  },
  "reflections": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.reflections.json",
  "report": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.md",
  "result_stats": {
    "by_matchup": {
      "commander_pod": {
        "error": 1,
        "winner:none": 1
      }
    },
    "completed_games": 0,
    "decision_limited_games": 0,
    "failed_games": 1,
    "status_counts": {
      "error": 1
    },
    "total_games": 1,
    "winner_counts": {
      "none": 1
    }
  },
  "results": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.json",
  "summary": [
    {
      "decisions": 0,
      "error": "decision command exited 2: {\"error\": \"gpt-5.4-nano:low: OpenAI API HTTP 429: {\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n    \\\"type\\\": \\\"insufficient_quota\\\",\\n    \\\"param\\\": null,\\n    \\\"code\\\": \\\"insufficient_quota\\\"\\n  }\\n}; gpt-5.4-mini:medium: OpenAI API HTTP 429: {\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n    \\\"type\\\": \\\"insufficient_quota\\\",\\n    \\\"param\\\": null,\\n    \\\"code\\\": \\\"insufficient_quota\\\"\\n  }\\n}; gpt-5.4:low: OpenAI API HTTP 429: {\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n    \\\"type\\\": \\\"insufficient_quota\\\",\\n    \\\"param\\\": null,\\n    \\\"code\\\": \\\"insufficient_quota\\\"\\n  }\\n}\"}",
      "game_id": "1",
      "live_replay_command": "http://127.0.0.1:8796/table?path=%2Fdata%2Fveles-artifacts%2Flogs%2Fdashboard%2Fashen-vault-run%2Fcommander_pod_g1_655239057%2Fgame.jsonl",
      "log_path": "/data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.jsonl",
      "planned": {
        "boarding_stage": "game_1_pre_board",
        "game_number": 1,
        "matchup": "commander_pod",
        "opponent_deck": "commander_blech_loafing_pest__1",
        "opponent_strategy_label": "Blech, Loafing Pest",
        "opponent_strategy_version": "v1",
        "player_deck": "commander_fire_lord_azula__1",
        "player_strategy_label": "Fire Lord Azula",
        "player_strategy_version": "v1",
        "seats": [
          {
            "deck": "commander_fire_lord_azula__1",
            "player_id": "player_1",
            "seat_label": "A1",
            "strategy_choice": "commander_fire_lord_azula:1",
            "strategy_label": "Fire Lord Azula",
            "strategy_version": "v1"
          },
          {
            "deck": "commander_blech_loafing_pest__1",
            "player_id": "player_2",
            "seat_label": "B2",
            "strategy_choice": "commander_blech_loafing_pest:1",
            "strategy_label": "Blech, Loafing Pest",
            "strategy_version": "v1"
          },
          {
            "deck": "commander_duskana_the_rage_mother__1",
            "player_id": "player_3",
            "seat_label": "C3",
            "strategy_choice": "commander_duskana_the_rage_mother:1",
            "strategy_label": "Duskana, the Rage Mother",
            "strategy_version": "v1"
          },
          {
            "deck": "commander_vivi_ornitier__1",
            "player_id": "player_4",
            "seat_label": "D4",
            "strategy_choice": "commander_vivi_ornitier:1",
            "strategy_label": "Vivi Ornitier",
            "strategy_version": "v1"
          }
        ],
        "seed": 655239057,
        "set_game_count": 1,
        "set_id": "commander_pod_set_1"
      },
      "replay_command": "PYTHONPATH=src python3 -m veles.replay /data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.jsonl",
      "sideboarding": [],
      "status": "error",
      "summary": null,
      "viewer_command": "http://127.0.0.1:8796/table?path=%2Fdata%2Fveles-artifacts%2Flogs%2Fdashboard%2Fashen-vault-run%2Fcommander_pod_g1_655239057%2Fgame.jsonl",
      "warnings": [
        "EXPERIMENTAL subprocess agents",
        "GAME 1 PRE-BOARD: no sideboarding applied",
        "starting-player, mulligan, London mulligan bottoms, priority, small target sets, discard sets, unless-type discard, cleanup discard, scry/surveil up to two, single mode choices, single- and multi-card effect/zone choices, small library ordering, color/type/number choices, optional cost and optional payment confirmations, replacement/prevention confirmations, reveal choices, delve, colored convoke/improvise shard selections, cost-card choices, multi-permanent sacrifice/destroy, basic combat prompts, combat order, combat damage assignment, shield division, copy retargeting, stack-target choices, and deterministic graveyard/exile move ordering are bridged; exact mana-source/payment is bridged with bounded legal source-subset choices, including fixture multi-mana sources, large combat/shield allocations expose bounded template choices, and complex search/filtering may still use Forge AI defaults unless fail-closed stops first",
        "FAIL-CLOSED strategic controller hooks enabled"
      ],
      "winner": null
    }
  ]
}
## What happened Run group `ashen-vault-run` never produced any observable games in the UI. Kubernetes shows sim job pod created and completed.<img width="1440" alt="image.png" src="attachments/aa69efb0-7703-4094-88ce-a722521a5a12"> <img width="1440" alt="image.png" src="attachments/fdb4a8d5-90eb-44f5-8078-997af9355417"> ## What should have happened Games (at least one) should have populated in the run group. N ## Category - kind: bridge-runtime / ops - severity: obvious ## Context - Page URL: https://veles.bstein.dev/runs?run_group=ashen-vault-run - Route: runs - Path: /runs?run_group=ashen-vault-run - Backend version: 0.4.2 - Frontend version: 0.4.2 - Sim version: 0.4.2 Logs: ``` D     ~/Development/veles-content/strategies/duel-commander   main  k logs -n veles veles-sim-ashen-vault-run-4510fa3f3d-hj4dk  ✔  󱃾 default  11:10:16 { "ai_calls": { "by_cached_policy_kind": {}, "by_cached_policy_reuse_mode": {}, "by_chosen_priority_option_kind": {}, "by_decision_source": { "subprocess": 1 }, "by_fallback_failure_kind": {}, "by_fallback_failure_model": {}, "by_model": {}, "by_model_usage": { "unknown": { "cached_input_tokens": 0, "input_tokens": 0, "output_tokens": 0, "reasoning_tokens": 0, "total_calls": 1, "total_tokens": 0, "usage_rows": 0 } }, "by_priority_option_kind": {}, "by_priority_subtype": {}, "by_prompt_bucket": { "starting_player": 1 }, "by_prompt_bucket_usage": { "starting_player": { "cached_input_tokens": 0, "input_tokens": 0, "output_tokens": 0, "reasoning_tokens": 0, "total_calls": 1, "total_tokens": 0, "usage_rows": 0 } }, "by_prompt_type": { "starting_player": 1 }, "cached_input_tokens": 0, "capacity_note": "Codex CLI does not expose remaining quota to Veles yet.", "capacity_state": "capacity_unknown", "error_calls": 1, "failures": { "rate_or_usage": 1 }, "input_tokens": 0, "ok_calls": 0, "output_tokens": 0, "reasoning_tokens": 0, "sidecar_files": [ "/data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.ai_calls.jsonl" ], "telemetry_schema_version": 4, "total_calls": 1, "total_elapsed_seconds": 7.234, "total_tokens": 0, "usage_rows": 0 }, "reflections": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.reflections.json", "report": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.md", "result_stats": { "by_matchup": { "commander_pod": { "error": 1, "winner:none": 1 } }, "completed_games": 0, "decision_limited_games": 0, "failed_games": 1, "status_counts": { "error": 1 }, "total_games": 1, "winner_counts": { "none": 1 } }, "results": "/data/veles-artifacts/reports/dashboard/ashen-vault-run.json", "summary": [ { "decisions": 0, "error": "decision command exited 2: {\"error\": \"gpt-5.4-nano:low: OpenAI API HTTP 429: {\\n \\\"error\\\": {\\n \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n \\\"type\\\": \\\"insufficient_quota\\\",\\n \\\"param\\\": null,\\n \\\"code\\\": \\\"insufficient_quota\\\"\\n }\\n}; gpt-5.4-mini:medium: OpenAI API HTTP 429: {\\n \\\"error\\\": {\\n \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n \\\"type\\\": \\\"insufficient_quota\\\",\\n \\\"param\\\": null,\\n \\\"code\\\": \\\"insufficient_quota\\\"\\n }\\n}; gpt-5.4:low: OpenAI API HTTP 429: {\\n \\\"error\\\": {\\n \\\"message\\\": \\\"You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.\\\",\\n \\\"type\\\": \\\"insufficient_quota\\\",\\n \\\"param\\\": null,\\n \\\"code\\\": \\\"insufficient_quota\\\"\\n }\\n}\"}", "game_id": "1", "live_replay_command": "http://127.0.0.1:8796/table?path=%2Fdata%2Fveles-artifacts%2Flogs%2Fdashboard%2Fashen-vault-run%2Fcommander_pod_g1_655239057%2Fgame.jsonl", "log_path": "/data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.jsonl", "planned": { "boarding_stage": "game_1_pre_board", "game_number": 1, "matchup": "commander_pod", "opponent_deck": "commander_blech_loafing_pest__1", "opponent_strategy_label": "Blech, Loafing Pest", "opponent_strategy_version": "v1", "player_deck": "commander_fire_lord_azula__1", "player_strategy_label": "Fire Lord Azula", "player_strategy_version": "v1", "seats": [ { "deck": "commander_fire_lord_azula__1", "player_id": "player_1", "seat_label": "A1", "strategy_choice": "commander_fire_lord_azula:1", "strategy_label": "Fire Lord Azula", "strategy_version": "v1" }, { "deck": "commander_blech_loafing_pest__1", "player_id": "player_2", "seat_label": "B2", "strategy_choice": "commander_blech_loafing_pest:1", "strategy_label": "Blech, Loafing Pest", "strategy_version": "v1" }, { "deck": "commander_duskana_the_rage_mother__1", "player_id": "player_3", "seat_label": "C3", "strategy_choice": "commander_duskana_the_rage_mother:1", "strategy_label": "Duskana, the Rage Mother", "strategy_version": "v1" }, { "deck": "commander_vivi_ornitier__1", "player_id": "player_4", "seat_label": "D4", "strategy_choice": "commander_vivi_ornitier:1", "strategy_label": "Vivi Ornitier", "strategy_version": "v1" } ], "seed": 655239057, "set_game_count": 1, "set_id": "commander_pod_set_1" }, "replay_command": "PYTHONPATH=src python3 -m veles.replay /data/veles-artifacts/logs/dashboard/ashen-vault-run/commander_pod_g1_655239057/game.jsonl", "sideboarding": [], "status": "error", "summary": null, "viewer_command": "http://127.0.0.1:8796/table?path=%2Fdata%2Fveles-artifacts%2Flogs%2Fdashboard%2Fashen-vault-run%2Fcommander_pod_g1_655239057%2Fgame.jsonl", "warnings": [ "EXPERIMENTAL subprocess agents", "GAME 1 PRE-BOARD: no sideboarding applied", "starting-player, mulligan, London mulligan bottoms, priority, small target sets, discard sets, unless-type discard, cleanup discard, scry/surveil up to two, single mode choices, single- and multi-card effect/zone choices, small library ordering, color/type/number choices, optional cost and optional payment confirmations, replacement/prevention confirmations, reveal choices, delve, colored convoke/improvise shard selections, cost-card choices, multi-permanent sacrifice/destroy, basic combat prompts, combat order, combat damage assignment, shield division, copy retargeting, stack-target choices, and deterministic graveyard/exile move ordering are bridged; exact mana-source/payment is bridged with bounded legal source-subset choices, including fixture multi-mana sources, large combat/shield allocations expose bounded template choices, and complex search/filtering may still use Forge AI defaults unless fail-closed stops first", "FAIL-CLOSED strategic controller hooks enabled" ], "winner": null } ] } ```
image.png
372 KiB
image.png
301 KiB
veles-dev added the
kind/ops
format/commander
pilot/adept
severity/obvious
 labels 2026-06-28 14:15:20 +00:00
veles-dev commented 2026-06-28 18:30:12 +00:00
Author
Member
Copy Link

Fixed in deployed Veles 0.4.3/0.4.4. CLI fallback is live for eligible users when OpenAI API calls fail, and 0.4.4 includes the run/strategy display cleanup from the same release lane.

Fixed in deployed Veles 0.4.3/0.4.4. CLI fallback is live for eligible users when OpenAI API calls fail, and 0.4.4 includes the run/strategy display cleanup from the same release lane.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
battery-0.5.21
Cassandra edge-case evaluation finding
bridge
Cassandra edge-case evaluation finding
commander-timing-stack
Cassandra edge-case evaluation finding
draw-go-vs-storm
Cassandra edge-case evaluation finding
dredge-vs-lantern
Cassandra edge-case evaluation finding
format/commander
Commander-specific issue.
format/duel-commander
Duel Commander-specific issue.
kind/bridge
Forge bridge/runtime ownership gap.
kind/metadata
Card metadata, image, or content import issue.
kind/misplay
Pilot quality issue or bad strategic/tactical choice.
kind/ops
Deployment, auth, capacity, or operational issue.
kind/ui
Replay, Lab, Runs, or visual review issue.
manual-review
Cassandra edge-case evaluation finding
misplay
Cassandra edge-case evaluation finding
pilot/adept
Observed at adept pilot skill.
pilot/proficient
Observed at proficient pilot skill.
pilot/veteran
Observed at veteran pilot skill.
rules
Cassandra edge-case evaluation finding
severity/debatable
Misplay should be absent at adept and above.
severity/defensible
Borderline line; veteran+ should avoid if identifiable.
severity/obvious
Misplay should not happen at proficient.
No Label
format/commander
kind/ops
pilot/adept
severity/obvious
Milestone
No items
No Milestone
Assignees
Clear assignees
bstein veles-dev
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: cassandra-alpha/feedback#5
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?