Skip to content

Use spawn context for ProcessPoolExecutor in basic crawler tests #2273

Closed
#2276
Closed
Use spawn context for ProcessPoolExecutor in basic crawler tests#2273
#2276
Assignees
vdusek
Labels
debtCode quality improvement or decrease of technical debt.t-toolingIssues with this label are in the ownership of the tooling team.

Description

@vdusek
vdusek
opened on Oct 5, 2026

ProcessPoolExecutor() in tests/unit/crawlers/_basic/test_basic_crawler.py uses the default fork start method. On Linux with Python 3.12 and 3.13 this emits:

DeprecationWarning: This process is multi-threaded, use of fork() may lead to deadlocks in the child.

Pass mp_context=get_context('spawn'). Python 3.14 already defaults to forkserver.

✍️ Drafted by Claude Code

Activity

  1. vdusek
    added
    t-toolingIssues with this label are in the ownership of the tooling team.
    debtCode quality improvement or decrease of technical debt.
    on Oct 5, 2026
  2. vdusek
    added a commit that references this issue on Oct 5, 2026

    test: use spawn context for ProcessPoolExecutor in basic crawler tests (

    f15e8f7
  3. vdusek
    self-assigned this
    on Oct 5, 2026
  4. apify-service-account
    closed this as completedon Oct 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

debtCode quality improvement or decrease of technical debt.t-toolingIssues with this label are in the ownership of the tooling team.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions