Skip to content

Clear per-thread free-list concurrently from GC #114016

Open
Open
Clear per-thread free-list concurrently from GC#114016
Labels
topic-free-threading

Description

@corona10
corona10
opened on Jan 13, 2024

From #111968, we now manage free lists as per-thread resources.
But the overhead of this implementation is that gc should traverse the resources of all threads that belong to the interpreter.

Since the clearing multiple per thread resources can be split by multiple thread tasks, it will be beneficial to reduce GC time.

ref: #113584 (comment)
source code:

cpython/Python/gc_free_threading.c

Lines 21 to 27 in dac1da2

HEAD_LOCK(&_PyRuntime);
_PyThreadStateImpl *tstate = (_PyThreadStateImpl *)interp->threads.head;
while (tstate != NULL) {
_Py_ClearFreeLists(&tstate->freelist_state, 0);
tstate = (_PyThreadStateImpl *)tstate->base.next;
}
HEAD_UNLOCK(&_PyRuntime);

cc @colesbury

Activity

  1. corona10
    added
    topic-free-threading
    on Jan 13, 2024
  2. corona10
    changed the title [-]Clear per-thread free-list in concurrently from gc.[/-] [+]Clear per-thread free-list concurrently from GC[/+] on Jan 13, 2024

  3. rruuaanng commented on Oct 23, 2024

    @rruuaanng
    rruuaanng
    on Oct 23, 2024
    Contributor

    I have submitted the best solution for this problem and also improved the interpreter's lock management for this operation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    topic-free-threading

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions