Skip to content

feat: add automatic direct convolution selection - #2134

Merged
leejet merged 1 commit into
masterfrom
feat/conv-direct-auto
Oct 13, 2026
Merged

leejet merged 1 commit into
masterfrom
feat/conv-direct-auto

Conversation

@leejet

@leejet leejet commented Oct 13, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • Add --conv-direct on|off|auto and conv_direct_mode with per-module overrides for diffusion, VAE, and ControlNet.
  • Automatically enable supported implicit GEMM paths using capability probes without benchmarking. Cache 2D/3D decisions per backend and log selection reasons.
  • Deprecate the legacy convolution flags while preserving compatibility, and document the new behavior.

Related Issue / Discussion

N/A

Additional Information

N/A

Checklist

Summary by CodeRabbit

  • New Features
    • Added a --conv-direct on|off|auto setting, with optional per-module overrides for diffusion, VAE, and ControlNet.
    • In auto mode, direct convolution is enabled only when the runtime backend supports it. Mixed backend support is reported, and legacy convolution flags are honored when the new setting is unset.
  • Documentation
    • Updated backend and CLI guides with the new setting, defaults, supported modules, and backend behavior.
  • Compatibility
    • Legacy convolution flags remain available but now produce deprecation warnings.

@coderabbitai

coderabbitai Bot commented Oct 13, 2026

Copy link
Copy Markdown

Review in Change Stack →

Note

Currently processing new changes in this PR. This may take a few minutes, please wait...

⚙️ Run configuration
  • Configuration used: Repository UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 751ebaa4-e885-4475-bf28-6a31165607d0
📥 Commits

Reviewing files that changed from the base of the PR and between d763dae and 1b4c27f.

📒 Files selected for processing (15)
  • docs/backend.md
  • docs/backend_probe.md
  • examples/cli/README.md
  • examples/common/common.cpp
  • examples/common/common.h
  • include/stable-diffusion.h
  • src/core/ggml_extend_backend.cpp
  • src/core/ggml_extend_backend.h
  • src/core/probe/conv_direct.cpp
  • src/core/probe/conv_direct.h
  • src/model_manager.cpp
  • src/pipeline/diffusion_engine.cpp
  • src/pipeline/diffusion_engine.h
  • src/pipeline/model_builders.cpp
  • src/stable-diffusion.cpp
 ___________________________
< Clippy has nothing on me. >
 ---------------------------
  \
   \   \
        \ /\
        ( )
      .( o ).
✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant