Skip to content

Give the suite time to finish so its failures can be counted - #1380

Merged
trissim merged 4 commits into
mainfrom
claude-board/suite-can-finish
Oct 31, 2026
Merged

trissim merged 4 commits into
mainfrom
claude-board/suite-can-finish

Conversation

@trissim

@trissim trissim commented Oct 31, 2026 •

Copy link
Copy Markdown

Suite fixes for #1375, in numbers: last run hit its 60-minute limit at 87%, 629 results, 117 failed, 7006 worker seconds. A whole run has never completed on any branch.

The 165-second hang

Helpers inherit the child pytest's pipes, and BoundedRun reads until they close. A test whose app close failed reported in about 13 s, then held its worker for the full 165 s. pytest_unconfigure in the child now stops its own helpers.
Before: test_a_renamed_thread_keeps_its_hidden_session 165 s. After: 18 s, still failing for its real reason (NoMatches: SessionThreadSidebar). Control: 4 of 4 pass. 7 tests hit this, 1156 of 7006 worker seconds.

CI

suite gets 60 minutes and prints its 40 slowest. This is a stopgap: a 60-minute suite is the defect.

Slowest tests (from log timestamps, because the cancelled run never printed durations)

  • 165 s, the hang above: 4 in test_hidden_session_retirement, 2 in test_saved_history_coverage, 1 in test_initial_prompt_handoff.
  • Failures: 3193 of 7006 worker seconds. Fixing them is the biggest remaining saving. 117 failed and 13% unrun.
  • Everything else averages about 11 s, since each test gets its own interpreter.

Owner of the next step: claude-board.

🤖 Generated with Claude Code

The suite needs about 44 minutes on 2 workers (#1375) and was cut off at
30, around 70%, on every branch. No run has ever reported the last 30%.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Copilot AI balanced review requested due to automatic review settings October 31, 2026 00:31

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing.

trissim and others added 3 commits October 30, 2026 20:31
A 60-minute limit lets the suite report; it does not make it fast. These
timings name what to fix next.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Helpers inherit the child pytest's pipes and BoundedRun reads until they
close, so a test whose app close failed reported in 13 s and then held its
worker for the full 165 s. The child now stops its own helpers as it exits.
7 tests hit this on the last run, 1156 of 7006 worker seconds.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@trissim
trissim merged commit 693cdac into main Oct 31, 2026
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants