Skip to content

isal riscv64 support #1069

Open
Open

Description

@luhenry

Package name (on PyPI)

isal

Source repository

https://github.com/pycompression/python-isal

Version(s) requested

No response

Why is this needed?

riscv64 wheel build added in #1047

Additional context

No response

Activity

  1. linked a pull request that will close this issueisal: add build-isal.yml for riscv64 wheels #1047on Sep 6, 2026
  2. moved this from Todo to Available in RISE PyPI in Python Wheels - riseproject-dev/python-wheelson Nov 16, 2026
  3. riseproject-dev commented on Nov 20, 2026

    @riseproject-dev
    Contributor

    Upstreaming investigation result

    python-isal (PyPI: isal, latest 1.9.1) ships wheels for x86_64/aarch64 manylinux and musllinux, macOS and Windows but no riscv64. Upstream has never discussed riscv64 (no issue or PR among all 337 issues/PRs). The wheels are built with cibuildwheel in .github/workflows/ci.yml; aarch64 is built on ubuntu-latest through QEMU as a matrix include row. A bounded patch following that precedent (a riscv64 include row, QEMU platform condition, README platform markers, changelog) is feasible; the bundled ISA-L 2.32.1 builds via Makefile.unx, which falls back to portable C for riscv64 (no RVV/Zbc assembly). Recommendation: develop, configuration_integration, keeping the diff small because the single maintainer rejects large PRs and is wary of release-process complexity and untested wheels.

    Proposed direction

    • Decision: develop
    • Rationale: A concrete, bounded configuration patch exists: add a riscv64 include row to the build_wheels matrix of .github/workflows/ci.yml following the aarch64 precedent (shared ubuntu-latest host plus QEMU via docker/setup-qemu-action, cibuildwheel CIBW_ARCHS_LINUX), extend the QEMU step condition/platforms, list riscv64 in the README platform markers like scikit-learn riscv64 support #268 did for arm64, and add a CHANGELOG entry. RISE's downstream build proved the unmodified sources build and pass upstream tests on riscv64 (PR 1047). No upstream objection to riscv64 exists, ISA-L 2.32.1 declares riscv64 support (portable C path via Makefile.unx). Risks: single maintainer sensitive to PR size, release complexity and untested wheels; QEMU build is slow (aarch64 takes 32 min) and gates the PyPI upload; the PR must be minimal.
    • Admission class: configuration_integration
    • Allowed paths: .github/workflows/ci.yml; CHANGELOG.rst; README.rst
    • Release coverage: PyPI isal 1.9.1 (2026-11-03/04): manylinux2014+2_28 x86_64 and aarch64, musllinux_1_2 x86_64/aarch64, macOS x86_64/arm64, win_amd64, sdist; no riscv64.
    • Build backend native dependencies: setuptools>=77 + setuptools-scm>=9.2 (custom build_ext in setup.py); statically builds the intel/isa-l git submodule (7c3479e, v2.32.1) with make -f Makefile.unx; nasm only on x86; no other native libs.
    • Release graph: ci.yml on push of tags: lint/package-checks/test-static/test-dynamic/test-arch/test-sanitizers gate make_sdist and build_wheels (cibuildwheel: ubuntu x86_64, ubuntu aarch64 via QEMU, macOS x2, Windows); upload_to_pypi downloads cibw-* artifacts and publishes with trusted publishing (environment pypi, tags only, test PyPI for tags containing '-').
    • Architecture precedent: Shared-host topology: all Linux architectures run on ubuntu-latest, aarch64 is an include row in the build matrix (cibw_archs_linux aarch64, QEMU platforms arm64). Recommend adding a riscv64 include row with before_all 'true' and extending the QEMU condition and platforms to riscv64. Do not use ubuntu-24.04-riscv: upstream has no native-per-architecture runner rows and no documented incompatibility with QEMU (cibuildwheel supports manylinux/musllinux riscv64 images).
    • Fork guards: None in ci.yml (no github.repository conditions); only tag/branch conditions and environment 'pypi' trusted publishing.
    • Contribution rules: README: make a PR or issue; PR template requires CHANGELOG.rst entry and docs; no CLA/DCO; develop is the PR base; maintainer favours small, well-tested diffs.
    • Existing riscv64 work: None in python-isal issues/PRs. ISA-L ships initial riscv64 support (2.32.0) and open RVV PRs/issues. Downstream: RISE build-isal.yml (PR 1047, 1.8.0) and Debian/Ubuntu/ALT riscv64 packages.
    • Target matrix: cibuildwheel cp3xx-manylinux_riscv64 for the CPython versions already built (3.11-3.15, 3.14t/3.15t as enabled upstream) and PyPy if cibuildwheel provides images; musllinux riscv64 optional and may be dropped to limit build time.
    • Risks: QEMU riscv64 emulation is slower than aarch64 (32 min) and may time out or segfault like past aarch64 attempts (Upgrade soundfile to v0.14.0 #158); build_wheels failure blocks upload_to_pypi for all platforms; maintainer rejects bulky PRs (multiprocess riscv64 support #318) and unverified wheels (Upgrade soundfile to v0.14.0 #158); ISA-L riscv64 path in Makefile.unx is portable C only; RVV/Zbc optimization needs ISA-L make.inc change (out of scope); test selection excludes test_compress_decompress in wheel tests

    Dependency and ecosystem evidence

    Graph resolves pycompression/python-isal and shows Debian/Ubuntu resolute already builds python3-isal 1.8.0 for riscv64, dynamically linked against libisal2 2.31.1 (riscv64 exists) plus libc6 and python3. This agrees with riscv64 viability of the C extension. It does not model the wheel build graph: the checkout's build backend is setuptools with setuptools-scm >=9.2, the ISA-L git submodule statically built by make, nasm for x86 only; those edges are absent. Reverse dependencies (xopen, aiohttp-fast-zlib, asammdf) are present only for amd64/arm64 in the graph, which is an omission or genuine lag for riscv64, not evidence either way. Debian links libisal2 dynamically while the PyPI wheel bundles ISA-L statically (graph/wheel difference).

    No matching ecosystem report was available; the dossier records the search evidence.

    Research coverage

    Relevant prior work

    • accepted: Arm64 support requested; resolved by adding aarch64 via cibuildwheel and QEMU as suggested by a contributor. Template for a new Linux architecture.
    • accepted: Adds aarch64 support. Merged without review by the maintainer.
    • accepted: Splits aarch64 wheel building into its own matrix row; the single review thread concerned sdist building.
    • closed_unmerged: Dummy PR to publish with older aarch64 images after segfaults under QEMU; maintainer would not ship wheels that fail tests and does not have aarch64 hardware; resolved later by itself.
    • accepted: Free-threaded wheel PR merged after maintainer insisted on tests and reduced scope to 3.14t.
    • accepted: Contributor fixed macOS arm64 so ISA-L assembly is built by passing host_cpu/arch to Makefile.unx; maintainer thanked and merged, has no Mac.
    • accepted: macOS arm64 wheels contained only base C; fixed by scikit-learn riscv64 support #268. Shows the same Makefile.unx limitation applies to unrecognised architectures such as riscv64.
    • accepted: 1.9.0 missing Windows wheels due to cancelled build job; maintainer split build and upload and wants all builds to succeed before release.
    • open: Maintainer wants stable ABI to cut the 73 artifacts per release.
    • open: Stable-ABI PR rejected outright by maintainer as too complex; still open.
    • accepted: ISA-L riscv question: initially unsupported; support declared in 2.32.
    • accepted: ISA-L maintainer open to RISC-V CI if contributors set it up.
    • accepted: Downstream RISE riscv64 isal 1.8.0 build merged; passes upstream tests on cp312.

    Verified native Result: work 1d9f680c5f251f477707a33cd899ea70453280e7d91c0100e80df54930063f9d, claim c_20b95f347dc9407e09eab39758567e248b76b89e560d078b1762111b06f8d6bd_1, artifact 14591276408.
    This is investigation evidence, not an upstream approval or publication decision.

  4. riseproject-dev commented on Nov 20, 2026

    @riseproject-dev
    Contributor

    Upstreaming r1 · provisioning/idle — Verified the investigation dossier and admitted automatic development. Workflow run

    Possible next commands
    /upstreaming pause revision=1 reason="..."
    /upstreaming park revision=1 reason="..."
    /upstreaming abandon revision=1 reason="..."
    
  5. riseproject-dev commented on Nov 20, 2026

    @riseproject-dev
    Contributor

    Upstreaming r2 · development/idle — Provisioned and verified the contribution fork and exact riscv64 base. Workflow run

    Possible next commands
    /upstreaming pause revision=2 reason="..."
    /upstreaming park revision=2 reason="..."
    /upstreaming abandon revision=2 reason="..."
    
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions