docs: clarify Kubernetes OOM and scheduling failures - #771
Draft
warp-agent-staging[bot] wants to merge 6 commits into
Draft
warp-agent-staging[bot] wants to merge 6 commits into
warp-agent-staging[bot] wants to merge 6 commits into
Conversation
Co-Authored-By: Oz <oz-agent@warp.dev>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
Contributor
Author
|
This PR was generated with Warp. Comment |
Co-Authored-By: Oz <oz-agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
warp-agent-staging
Bot
changed the base branch from
main
to
docs/self-hosted-kubernetes-troubleshooting
September 20, 2026 17:28
Co-Authored-By: Oz <oz-agent@warp.dev>
Co-Authored-By: Oz <oz-agent@warp.dev>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.



Summary
Clarifies how operators diagnose and remediate self-hosted Kubernetes task failures without confusing worker-daemon resources, task-container OOMs, and scheduler capacity failures. Closes #769.
Dependency
This PR is stacked on #770 (
docs/self-hosted-kubernetes-troubleshootingate568ac4251d1411d25271edf0724fb4701a03d96, based onmain). Its GitHub base is that branch, and the #770 head is an ancestor of this branch. Merge #770 before this PR; restack if #770's head changes.Changes
platform/self-hosting/troubleshooting.mdxFailedScheduling,OOMKilled, eviction, and exit code143.SIGTERMand an OOM report, and between failures before scheduling and failures in a running container.platform/self-hosting/managed-kubernetes.mdxpod_templateand workload-specific runner instance shapes, including task-only shape precedence and the generated-init-container limitation.Publishable sizing guidance
100mCPU and128Mimemory defaults are requests for the worker daemon Deployment; the chart sets no daemon limits by default.pod_templateresources or an explicit runner instance shape. Cluster policies can still inject defaults.taskcontainer's CPU and memory requests equal to its limits for that run and overrides matchingpod_templatevalues. Apod_templatecan size operator-defined containers but does not alter worker-generated setup or materialization init containers.Intentional omissions
Content design plan
OOMKilledor exit143, and does not distinguish daemon resources from task resources.Source evidence
warpdotdev/oz-agent-worker@530bbe934a632910dfe8818ab7b4c6027a3473ef:internal/worker/kubernetes.go,internal/types/messages.go,internal/metrics/metrics.go, Helmvalues.yaml, and Kubernetes tests for resource merging, termination classification, scheduling, and cleanup.warp-server@2916aa67b511e8ef1f556766aa3d2dfe42a42f74: runner instance-shape resolution and self-hosted assignment inrunner_instance_shape.go,workers/common/task_utils.go, andworkers/selfhosted/websocket.go.e568ac4251d1411d25271edf0724fb4701a03d96for current public terminology, configuration names, and page ownership.Verification
npm run build- passed.python3 .agents/skills/check_for_broken_links/check_links.py --internal-only- passed; 4,244 internal links checked, 0 broken.python3 .agents/skills/style_lint/style_lint.py --changed- passed; 5 branch-changed files scanned, 0 issues.python3 .agents/skills/doc_quality_policy/check_compression_contract.py- passed fortroubleshooting.mdxand the three parent-PR pages.managed-kubernetes.mdxis 2,010 words, above the 1,500-word feature-doc budget. The 1,941-word baseline is inherited from docs: Improve self-hosted Kubernetes troubleshooting #770; this PR keeps its focused resource guidance next to the canonicalpod_templateand instance-shape behavior.git diff --check- passed.trunk checkwas not run.Unverified claims
None — all new behavior, configuration, default, and metric claims were verified against current source.
Documentation risk
Risk: engineering-review-required
Rationale: Adds technical claims about self-hosted Kubernetes task resources, runner shapes, and failure classification.
Source files consulted: oz-agent-worker@530bbe934a632910dfe8818ab7b4c6027a3473ef: internal/worker/kubernetes.go and charts/oz-agent-worker/values.yaml; warp-server@2916aa67b511e8ef1f556766aa3d2dfe42a42f74: logic/ai/ambient_agents/workers/common/task_utils.go and logic/ai/ambient_agents/workers/selfhosted/websocket.go
Docs override: none
Co-Authored-By: Oz oz-agent@warp.dev