Repository navigation
Conversation
apache-beam 2.54.0-2.61.0 (the window apache-flink needs for its cimport'd Cython bindings) all pin pyarrow<17.0.0; our registry only carried 25.0.1/26.0.0. 16.1.0 shares the existing bundled-Arrow-C++ build (env-var driven, same as 25.0.1/26.0.0); the build matrix drops cp313/cp314/cp314t for this version since it predates cp313's release by ~5 months and upstream itself never shipped past cp312 for it.
luhenry
marked this pull request as draft
October 15, 2026 12:13
ARROW_DEPENDENCY_SOURCE=BUNDLED builds gflags via ExternalProject_Add using its vendored cmake_minimum_required(VERSION 2.8.12), below CMake 4's removed-compatibility floor of 3.5. The riscv64 image's pipx-installed cmake is >= 4, so the gflags_ep configure step hard-errors before any other bundled dependency gets a chance to build. Export CMAKE_POLICY_VERSION_MINIMUM=3.5 for the whole build: CMake reads it from the environment with the same effect as the -D cache flag, so it reaches every nested cmake invocation ExternalProject_Add makes without needing to patch Arrow's own CMakeLists.txt.
Arrow 16.1.0 pins Abseil 20211102.0 for its BUNDLED absl_ep. That release's absl/strings/internal/str_format/extension.h forward-declares `enum class FormatConversionChar : uint8_t` and `enum class FormatConversionCharSet : uint64_t` without including <cstdint>, relying on libstdc++ headers to pull it in transitively. Since GCC 13, libstdc++ no longer does, and manylinux_2_39_riscv64 ships GCC 14, so both declarations fail and str_format's extension.cc and float_conversion.cc cascade into "FormatConversionCharSet was not declared" / "no member named conversion_char". Abseil added the include upstream in later LTS releases; 25.0.1/26.0.0 pin 20250127.0 and never hit it. Pass -DCMAKE_CXX_FLAGS="-include cstdint": Arrow copies CMAKE_CXX_FLAGS into EP_CXX_FLAGS, which every bundled ExternalProject receives through EP_COMMON_CMAKE_ARGS, so absl_ep (and gRPC/ORC built on top of it) get the header without patching Arrow or Abseil. Same remedy as build-aimrocks.yml uses for the same libstdc++ change.
pyarrow 16.1.0's setup.py does `import pkg_resources` at module scope (and uses pkg_resources.resource_filename in build_ext). setuptools 82.0.0 removed pkg_resources, and the unpinned preinstall resolved to 84.2.1, so `build --no-isolation` died in get_requires_for_build_wheel with ModuleNotFoundError. Cap at <82 (81.0.0 still ships it), as asyncpg does (gotcha 29).
16.1.0's setup.py sets use_scm_version's write_to to os.path.join(setup_dir, 'pyarrow/_generated_version.py') with an abspath'd setup_dir. setuptools_scm 10.1 added _sanitize_relative_path to its build_py hook and rejects that with "Version file path must be relative"; 9.2.2 accepts an absolute write_to under root by design.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
pyarrow16.1.0Builds Arrow C++ and the Cython-based pyarrow bindings. Upstream publishes no riscv64 wheel for this version.
Mirrors the existing
build-pyarrow.yml(bundled Arrow C++, env-var driven, same as 25.0.1/26.0.0).Differs from upstream
Matrix: cp312 only - 16.1.0 predates cp313's release by ~5 months and upstream itself never shipped past cp312 for it.
Testing
License: OK
Built on cp312.