test_concurrent_futures.test_deadlock fails with env changed: sys.stderr was modified on s390x RHEL8 Refleaks 3.x #109832

Activity

1. vstinner

   added

   testsTests in the Lib/test dirTests in the Lib/test dir

   on Sep 25, 2023
2. vstinner commented on Sep 25, 2023

   

   vstinner

   on Sep 25, 2023

   MemberAuthor

   More actions

   I suppose that sys.stderr was modified by test_error_at_task_unpickle() or by test_error_during_result_unpickle_in_result_handler().

   I tried to reproduce the failure with:

   ./python -m test test_concurrent_futures.test_deadlock -m test_error_at_task_unpickle -m test_error_during_result_unpickle_in_result_handler --fail-env-changed  -R 3:3 -v --forever
   

   I suppose that the bug only triggers if the system load is high.
3. vstinner commented on Sep 25, 2023

   

   vstinner

   on Sep 25, 2023

   MemberAuthor

   More actions

   I reproduced the issue after 4 min 48 sec.

   Terminal 1:

   $ ./python -m test test_concurrent_futures.test_deadlock -m test_error_at_task_unpickle -m test_error_during_result_unpickle_in_result_handler --fail-env-changed  -R 3:3 -v --forever 
   (...)
   0:04:26 load avg: 13.97 [ 14] test_concurrent_futures.test_deadlock
   (...)
   
   Warning -- sys.stderr was modified by test_concurrent_futures.test_deadlock
   Warning --   Before: <_io.TextIOWrapper name='<stderr>' mode='w' encoding='utf-8'>
   Warning --   After:  <_io.StringIO object at 0x7fd38e74aea0> 
   
   == Tests result: ENV CHANGED ==
   
   All 13 tests OK.
   
   1 test altered the execution environment:
       test_concurrent_futures.test_deadlock
   
   Total duration: 4 min 48 sec
   Total tests: run=84 (filtered)
   Total test files: run=14 (filtered) env_changed=1
   Result: ENV CHANGED
   

   Terminal 2:

   ./python -m test -j10 -r
   
4. vstinner commented on Sep 26, 2023

   

   vstinner

   on Sep 26, 2023

   MemberAuthor

   More actions

   Error on GHA macOS: https://github.com/python/cpython/actions/runs/6306288599/job/17121190375?pr=109871

   0:13:56 load avg: 9.33 [458/463/1] test.test_concurrent_futures.test_deadlock failed (env changed) -- running (1): test_decimal (45.1 sec)
   (...)
   Warning -- sys.stderr was modified by test.test_concurrent_futures.test_deadlock
   Warning --   Before: <_io.StringIO object at 0x10e3d3860>
   Warning --   After:  <_io.StringIO object at 0x10efe2c30>
   
5. vstinner

   added 4 commits that reference this issue on Sep 26, 2023

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr

   ...

   a09ebc0

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr

   ...

   9a687c0

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr

   ...

   236ac3d

   gh-109832: concurrent.futures test_deadlock restores sys.stderr (#109887

   ...

   2897142
6. miss-islington

   added 2 commits that reference this issue on Sep 26, 2023

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr (…

   ...

   8148868

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr (…

   ...

   1e17c2d
7. vstinner

   added a commit that references this issue on Sep 26, 2023

   [3.11] gh-109832: concurrent.futures test_deadlock restores sys.stderr (

   ...

   bda6949
8. csm10495

   added a commit that references this issue on Sep 28, 2023

   pythongh-109832: concurrent.futures test_deadlock restores sys.stderr (…

   ...

   a9ed4b2
9. vstinner

   closed this as completedon Sep 29, 2023
10. Yhg1s

    added a commit that references this issue on Oct 2, 2023

    [3.12] gh-109832: concurrent.futures test_deadlock restores sys.stderr (

    ...

    84f9da9
11. Glyphack

    added a commit that references this issue on Sep 2, 2024

    pythongh-109832: concurrent.futures test_deadlock restores sys.stderr (…

    ...

    334a7bb