[github-actions]

Monthly refresh of the vendored vocabulary. Read the numbers before merging.

Held out, after

split: 14727 train, 3901 held out (by path, not by row)
positive-class weights: destructive=6.1  sandbox_escape=3.7  credential_access=2.7  network=5.7  external_side_effect=9.0  safe=1.2

headline score on the holdout (max risky label, threshold 0.50):
  false alarms   168/2255 ordinary calls  (7.5%)
  missed          88/1646 risky calls     (5.3%)
  every false alarm:
    0.98  run shell command=rm -f dkms.conf
    0.98  run shell command=shred -u dkms.conf || rm -v dkms.conf
    0.98  run shell command=shred -u dkms.conf
    0.98  run shell command=strings web/bundles && rm dkms.conf || rm -v yarn-error.lo
    0.98  run shell command=rm dkms.conf; sed -n '1,40p' scripts/build.sh; tail -F dev

Held out, before

split: 14727 train, 3901 held out (by path, not by row)
positive-class weights: destructive=6.1  sandbox_escape=3.7  credential_access=2.7  network=5.7  external_side_effect=9.0  safe=1.2

headline score on the holdout (max risky label, threshold 0.50):
  false alarms   168/2255 ordinary calls  (7.5%)
  missed          88/1646 risky calls     (5.3%)
  every false alarm:
    0.98  run shell command=rm -f dkms.conf
    0.98  run shell command=shred -u dkms.conf || rm -v dkms.conf
    0.98  run shell command=shred -u dkms.conf
    0.98  run shell command=strings web/bundles && rm dkms.conf || rm -v yarn-error.lo
    0.98  run shell command=rm dkms.conf; sed -n '1,40p' scripts/build.sh; tail -F dev

The job refuses to open a PR at all if precision or recall dropped by more
than 0.05 on any label, so this is a proposal that already cleared that bar —
not a guarantee that the model got better.

[claude]

⚠️ Code review skipped — your organization has no extra usage available to pay for this review.

If your organization's extra usage balance is empty, an organization admin can add extra usage credits at claude.ai/admin-settings/usage. If its monthly spend limit was reached, an admin can raise it on the same page. If neither applies, contact Anthropic support.

Once extra usage is available, someone with write access to this repository can comment @claude review on this pull request to trigger a review.