Skip to content

ARM Raspbian 3.x fails to build _testcapi extension: undefined symbol: __atomic_fetch_or_8 #109054

Closed
Closed
ARM Raspbian 3.x fails to build _testcapi extension: undefined symbol: __atomic_fetch_or_8#109054

Description

@vstinner
vstinner
opened on Sep 7, 2023

I supposed that the build error is related to Modules/_testcapi/pyatomic.c and Include/cpython/pyatomic.h.

"Raspbian is a free operating system based on Debian optimized for the Raspberry Pi hardware."

Buildbot worker says: "Raspberry Pi 4 B running Raspbian (Bullseye 11.x)."

test.pythoninfo:

  • CC.version: gcc (Raspbian 10.2.1-6+rpi1) 10.2.1 20210110
  • platform.architecture: 32bit ELF
  • platform.libc_ver: glibc 2.31
  • platform.platform: Linux-6.1.21-v8+-aarch64-with-glibc2.31
  • sysconfig[PY_CFLAGS]: -fno-strict-overflow -DNDEBUG -g -O3 -Wall -UNDEBUG
  • sysconfig[PY_CFLAGS_NODIST]: -std=c11 -Werror=implicit-function-declaration -fvisibility=hidden -I./Include/internal
  • sysconfig[PY_STDMODULE_CFLAGS]: -fno-strict-overflow -DNDEBUG -g -O3 -Wall -UNDEBUG -std=c11 -Werror=implicit-function-declaration -fvisibility=hidden -I./Include/internal -I. -I./Include

Logs:

gcc -pthread -shared      Modules/_testcapimodule.o Modules/_testcapi/vectorcall.o Modules/_testcapi/vectorcall_limited.o Modules/_testcapi/heaptype.o Modules/_testcapi/abstract.o Modules/_testcapi/unicode.o Modules/_testcapi/dict.o Modules/_testcapi/getargs.o Modules/_testcapi/datetime.o Modules/_testcapi/docstring.o Modules/_testcapi/mem.o Modules/_testcapi/watchers.o Modules/_testcapi/long.o Modules/_testcapi/float.o Modules/_testcapi/structmember.o Modules/_testcapi/exceptions.o Modules/_testcapi/code.o Modules/_testcapi/buffer.o Modules/_testcapi/pyatomic.o Modules/_testcapi/pyos.o Modules/_testcapi/immortal.o Modules/_testcapi/heaptype_relative.o Modules/_testcapi/gc.o   -o Modules/_testcapi.cpython-313-arm-linux-gnueabihf.so
[ERROR] _testcapi failed to import: /var/lib/buildbot/workers/3.x.gps-raspbian.nondebug/build/build/lib.linux-aarch64-3.13/_testcapi.cpython-313-arm-linux-gnueabihf.so: undefined symbol: __atomic_fetch_or_8
The necessary bits to build these optional modules were not found:
_tkinter              _uuid                                    
To find the necessary bits, look in configure.ac and config.log.

Following modules built successfully but were removed because they could not be imported:
_testcapi                                                      

Checked 107 modules (31 built-in, 72 shared, 1 n/a on linux-aarch64, 0 disabled, 2 missing, 1 failed on import)

logs: https://buildbot.python.org/all/#/builders/424/builds/4849

cc @colesbury @gpshead

Linked PRs

Activity

  1. vstinner commented on Sep 7, 2023

    @vstinner
    vstinner
    on Sep 7, 2023
    MemberAuthor

    Maybe Python should be linked to -latomic. Old GCC discussions:

  2. vstinner commented on Sep 7, 2023

    @vstinner
    vstinner
    on Sep 7, 2023
    MemberAuthor

    Another example:

  3. vstinner commented on Sep 7, 2023

    @vstinner
    vstinner
    on Sep 7, 2023
    MemberAuthor

    I confirm that this regression comes from the commit 2bd960b.

  4. colesbury commented on Sep 7, 2023

    @colesbury
    colesbury
    on Sep 7, 2023
    Contributor

    I'm on vacation this week, but I'll have some time to look at this this evening.

  5. vstinner commented on Sep 7, 2023

    @vstinner
    vstinner
    on Sep 7, 2023
    MemberAuthor

    I never heard about Raspbian before. I was curious about it, so I added platform.freedesktop_os_release() to test.pythoninfo :-)

    platform.freedesktop_os_release[ID]: raspbian
platform.freedesktop_os_release[NAME]: Raspbian GNU/Linux
platform.freedesktop_os_release[VERSION]: 11 (bullseye)
platform.freedesktop_os_release[VERSION_CODENAME]: bullseye
platform.freedesktop_os_release[VERSION_ID]: 11
  6. vstinner
    added 7 commits that reference this issue on Sep 7, 2023

    pythongh-109054: configure adds libatomic if needed

    b353cff

    pythongh-109054: configure checks if libatomic is needed

    bcc1931

    pythongh-109054: configure checks if libatomic is needed

    9dbbfc1

    pythongh-109054: configure checks if libatomic is needed

    6f791de

    pythongh-109054: configure checks if libatomic is needed

    75d5328

    pythongh-109054: configure checks if libatomic is needed

    4a14807

    pythongh-109054: configure checks if libatomic is needed

    dc9754a

  7. colesbury commented on Sep 8, 2023

    @colesbury
    colesbury
    on Sep 8, 2023
    Contributor

    From @vstinner's comments and playing with https://gcc.godbolt.org/, it looks like the 8 byte (64-bit) use library support with the default compiler options on this platform. GCC doesn't need the library support if you target -march=armv7-a (the ARMv7-A and ARMv7-R profiles support the ldrexd "double-word" exclusive load).

    Some random other things that I learned, but are probably not important:

    • Raspbian is now called Raspberry Pi OS
    • The Raspberry Pi Model B's have used a 64-bit CPUs (armv8-a) since ~2016, but the Raspbian/Raspberry Pi OS was 32-bit only until 2022 and it seems like 32-bit OS is still the most commonly used
  8. vstinner
    added 2 commits that reference this issue on Sep 8, 2023

    pythongh-109054: configure checks if libatomic is needed

    1a97732

    pythongh-109054: configure checks if libatomic is needed

    e241894

  9. 19 remaining items

  10. vstinner
    closed this as completedon Sep 8, 2023
  11. vstinner
    added 12 commits that reference this issue on Sep 10, 2023

    pythongh-109054: Don't use libatomic on cross-compilation

    bed957b

    pythongh-109054: Don't use libatomic on cross-compilation

    0a69b27

    pythongh-109054: Document configue options

    9b3fc31

    pythongh-109054: Document configue variables

    3485011

    gh-109054: Don't use libatomic on cross-compilation (#109211)

    71b6e26

    pythongh-109054: Document configue variables

    57ba1da

    pythongh-109054: Document configue variables

    f0ce11d

    pythongh-109054: Document configue variables

    2796022

    pythongh-109054: Document configue variables

    9780c71

    pythongh-109054: Document configue variables

    4993499

    pythongh-109054: Document configue variables

    8ce10b5

    gh-109054: Document configure variables (#109224)

    d41d2e6
  12. csm10495
    added a commit that references this issue on Sep 28, 2023

    pythongh-109054: Document configure variables (python#109224)

    e2f97a8
  13. Glyphack
    added a commit that references this issue on Sep 2, 2024

    pythongh-109054: Document configure variables (python#109224)

    d0b8934
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions