GH-97973: Return all necessary information from the tokenizer - #97975

GH-97973: Return all necessary information from the tokenizer#97975

lysnikolaou wants to merge 7 commits into

python:mainpython/cpython:mainfrom

lysnikolaou:tokenizer-return-tokenlysnikolaou/cpython:tokenizer-return-tokenCopy head branch name to clipboard