Repository navigation
docs(jules): narrow the lane to verifiable work and cut Claude's share - #12453
Open
MarkusNeusinger wants to merge 6 commits into
Open
MarkusNeusinger wants to merge 6 commits into
MarkusNeusinger wants to merge 6 commits into
Conversation
Three test rounds (2026-10-27 to 10-29): watcher events dominated Claude's cost, sessions asked despite interactive=false, and behaviour-preserving refactors mostly failed. The skill now limits Jules to mechanically verifiable work, watches with --changes-only/--allow, forbids confirmation questions and string-sliced edits in prompts, budgets stuck sessions, adds a REST fallback for messages, and records how to prove unchanged UI behaviour. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…fixed Gemini Flash pre-PR check: a GitHub hiccup could end the watch before the PR was checked, single-dash flags were taken as session IDs, the skill's grep dropped the PR lines, the REST fallback used an unset $D, and stopping a preview server by port lacked the kill. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Contributor
There was a problem hiding this comment.
🟡 Changes recommended
Active critical and moderate findings remain in the watcher’s error-status handling, option parsing, and synchronized routing documentation, so the change is not ready for approval.
3 open issues
What changed in this PR
This PR narrows Jules assignments to mechanically verifiable work, routes larger behavior-preserving refactors to Gemini, and reduces monitoring overhead through watcher, prompt, fallback, and verification updates.
Changes:
- Updates Jules/Gemini routing guidance, guardrails, and operational documentation.
- Adds quieter session monitoring, path allowlists, stricter argument handling, and PR validation.
- Documents branch conventions, fallback messaging, and unchanged-behavior verification procedures.
- Final review findings remain unresolved: credential exposure in the REST fallback (moderate, 1 vote), lost watcher exit status (critical, 2 votes), option-value parsing accepting unknown flags (moderate, 3 votes), and an outdated synchronized routing guide (moderate, 2 votes).
| File | Description |
|---|---|
CLAUDE.md |
Updates agent-selection guidance to restrict Jules to mechanically verifiable work. |
changelog.d/jules-skill-round3.md |
Documents the Jules lane, watcher updates, and verification results. |
.claude/skills/jules-task/SKILL.md |
Defines Jules task boundaries, monitoring, prompts, fallback handling, and review procedures. |
.claude/skills/jules-task/scripts/watch-sessions.py |
Adds quiet monitoring, path allowlists, argument parsing, and PR validation. |
.claude/skills/gemini-task/SKILL.md |
Routes larger behavior-preserving refactors to Gemini. |
.claude/guardrails.md |
Aligns delegation rationale and cost guidance with the revised Jules/Gemini boundaries. |
Review effort: Lite
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
… code behind grep Copilot review of #12453. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.


Summary
/gemini-task, because only three of nine page-split variants kept their page unchanged and steering all nine took many Claude turns.CLAUDE.md,.claude/guardrails.mdand thegemini-taskskill follow (owner's agreement of 2026-10-29).watch-sessions.pygains--changes-onlyand repeatable--allow <prefix>(flags scratch files such asfix_*.pyorget_lines.sh), settles only after its PR checks ran, and rejects unknown flags. Prompts now forbid confirmation questions and string-sliced code edits; stuck sessions get a budget (one nudge, about 60 minutes in the provisioning queue); a REST fallback covers the MCP send failures.<base>-<session id>, and workflow triggers come from the pushed commit, so branches cut before a CI change keep old triggers.Plan
N/A
Test plan
tests/unit/test_agent_instructions.py: 36 passedruff checkandruff format --checkonwatch-sessions.py--allowflaggedget_lines.shon refactor(app): split PalettePage into hooks and sections #12451,--changes-onlystayed quiet for running sessions,-hand unknown flags exit 2:sendMessagefallback from the skill returned HTTP 200uv run python -m tools.changelog check --base origin/main$D, settle before PR check, grep dropping PR lines, single-dash flags, missing kill)