Repository navigation
Add --single-process option to regrtest to always run tests sequentially (ignore -jN option) #119727
Description
The Python release process runs tests sequentially. It catchs some issues which are ignored silently when running tests in parallel.
I propose adding --sequentially option to regrtest to always run tests sequentially. It can be used to ignore any -jN option and also to re-run failed tests sequentially.
Activity
pythongh-119727: Add --sequentially option to regrtest
pythongh-119727: Add --sequentially option to regrtest
vstinner commentedon May 29, 2024
My motivation for this change is also a desire to change the regrtest default to -j0: run tests in parallel using the number of CPU.
serhiy-storchaka commentedon May 29, 2024
This is an opposite of
--multiprocess. Why not call it--singleprocess?You can run tests with
-j1, it will be sequentially, but in different processes.vstinner commentedon May 30, 2024
IMO "sequentially" is the right name.
--multiprocessmeans in fact "running tests in parallel". Using multipe processes is just an implementation details. It could be threads or something else. The opposite of parallel is sequential. IMO it's too late to rename the--multiprocessoption.Note: there is already a
--singleoption.--singleprocesssounds too close.serhiy-storchaka commentedon May 30, 2024
I will not insist.
The
--multiprocessoption has two effects: it runs the tests in parallel and runs every test is a separate process. It could be possible to run the tests in parallel using the process pull, but this is not how it is implemented now, and I do not think there is a benefit to implement such option. Currently there are three options:-j1.-jN.gh-119727: Add --single-process option to regrtest (#119728)
[-]Add `--sequentially` option to regrtest to always run tests sequentially (ignore `-jN` option)[/-][+]Add `--single-process` option to regrtest to always run tests sequentially (ignore `-jN` option)[/+]pythongh-119727: Add --single-process option to regrtest (python#119728)
pythongh-119727: Add --single-process option to regrtest (python#119728)
pythongh-119727: Run tests in parallel by default
pythongh-119727: Run tests in parallel by default
pythongh-119727: Run tests in parallel by default
vstinner commentedon Jun 13, 2024
Implemented by change 4e8aa32.
pythongh-119727: Add --single-process option to regrtest (python#119728)
pythongh-119727: Add --single-process option to regrtest (python#119728)
pythongh-119727: Add --single-process option to regrtest (python#119728)
[3.13] gh-119727: Add --single-process option to regrtest (#119728) (#…
[3.12] pythongh-119727: Add --single-process option to regrtest (pyth…
[3.12] gh-119727: Add --single-process option to regrtest (GH-119728) (…