Carl Friedrich Bolz-Tereick pushed to branch branch/py3.9 at PyPy / pypy
Commits: eb51d3ba by Carl Friedrich Bolz-Tereick at 2021-11-02T15:33:27+01:00 experimental branch that tries to integrate the new peg parser --HG-- branch : py3.9-peg-parser - - - - - 60265833 by Carl Friedrich Bolz-Tereick at 2021-11-02T19:17:50+01:00 factor slightly differently to allow reuse --HG-- branch : py3.9-peg-parser - - - - - 047f135c by Carl Friedrich Bolz-Tereick at 2021-11-04T13:08:13+01:00 better repr for Tokens --HG-- branch : py3.9-peg-parser - - - - - f1a72025 by Carl Friedrich Bolz-Tereick at 2021-11-04T13:08:43+01:00 define and use 3.9 future flags --HG-- branch : py3.9-peg-parser - - - - - fae0c559 by Carl Friedrich Bolz-Tereick at 2021-11-04T13:09:29+01:00 follow CPython's errors --HG-- branch : py3.9-peg-parser - - - - - 5565f360 by Carl Friedrich Bolz-Tereick at 2021-11-04T13:27:31+01:00 better position --HG-- branch : py3.9-peg-parser - - - - - a9381a39 by Carl Friedrich Bolz-Tereick at 2021-11-04T13:38:42+01:00 don't call the parser --HG-- branch : py3.9-peg-parser - - - - - f5eb57c7 by Carl Friedrich Bolz-Tereick at 2021-11-05T14:07:01+01:00 first step at an rpython PEG parser. Passes some tests from test_astbuilder, test_pyparse and test_compiler. The grammar and program to generate it are here for now: https://github.com/cfbolz/pegen/tree/rpython-hacked-version --HG-- branch : py3.9-peg-parser - - - - - b7975250 by Carl Friedrich Bolz-Tereick at 2021-11-06T12:31:13+01:00 fix tests and implementation, missing 0-based to 1-based conversion when raising SyntaxErrors from the ast builder --HG-- branch : py3.9-peg-parser - - - - - 94642691 by Carl Friedrich Bolz-Tereick at 2021-11-06T17:12:24+01:00 lots of progress, but mostly still broken --HG-- branch : py3.9-peg-parser - - - - - 8ff55bcd by Carl Friedrich Bolz-Tereick at 2021-11-07T16:54:08+01:00 more random progress --HG-- branch : py3.9-peg-parser - - - - - ec4e1e8b by Carl Friedrich Bolz-Tereick at 2021-11-07T18:28:40+01:00 move out all the python code into a regular non-generated python file --HG-- branch : py3.9-peg-parser - - - - - d7eff768 by Carl Friedrich Bolz-Tereick at 2021-11-07T18:58:12+01:00 vendor pegen --HG-- branch : py3.9-peg-parser - - - - - 640db2b3 by Carl Friedrich Bolz-Tereick at 2021-11-07T18:59:59+01:00 add LICENSE from pegen --HG-- branch : py3.9-peg-parser - - - - - 531966f4 by Carl Friedrich Bolz-Tereick at 2021-11-07T19:02:00+01:00 add the rpython generator and the grammar --HG-- branch : py3.9-peg-parser - - - - - 30208aa2 by Carl Friedrich Bolz-Tereick at 2021-11-07T19:02:20+01:00 fix rpython --HG-- branch : py3.9-peg-parser - - - - - b7711f02 by Carl Friedrich Bolz-Tereick at 2021-11-07T19:02:31+01:00 regenerate with the new code --HG-- branch : py3.9-peg-parser - - - - - 7a6d4f48 by Carl Friedrich Bolz-Tereick at 2021-11-07T22:39:21+01:00 make way less inefficient --HG-- branch : py3.9-peg-parser - - - - - 7848009a by Carl Friedrich Bolz-Tereick at 2021-11-08T20:43:08+01:00 progress on supporting "single" mode --HG-- branch : py3.9-peg-parser - - - - - 2bfe8809 by Carl Friedrich Bolz-Tereick at 2021-11-08T21:18:23+01:00 - fix some single tests that can't work that way any more - fix firstlineno in the presence of different (correct!) lineno on function ast nodes --HG-- branch : py3.9-peg-parser - - - - - 962473b0 by Carl Friedrich Bolz-Tereick at 2021-11-08T21:55:22+01:00 fix broken test and also improve the error position --HG-- branch : py3.9-peg-parser - - - - - 22c3518b by Carl Friedrich Bolz-Tereick at 2021-11-08T22:07:51+01:00 fixes --HG-- branch : py3.9-peg-parser - - - - - e81d39fe by Carl Friedrich Bolz-Tereick at 2021-11-09T11:24:09+01:00 some fixes, stdlib now parses --HG-- branch : py3.9-peg-parser - - - - - 44482185 by Carl Friedrich Bolz-Tereick at 2021-11-09T12:36:34+01:00 start removing the AST builder --HG-- branch : py3.9-peg-parser - - - - - 50b3688b by Carl Friedrich Bolz-Tereick at 2021-11-09T13:35:38+01:00 support revdb meta vars --HG-- branch : py3.9-peg-parser - - - - - d0f523db by Carl Friedrich Bolz-Tereick at 2021-11-09T14:42:59+01:00 delete the ast builder! ding dong etc --HG-- branch : py3.9-peg-parser - - - - - 71daf3fe by Carl Friedrich Bolz-Tereick at 2021-11-09T18:31:38+01:00 disable compile method in parser module --HG-- branch : py3.9-peg-parser - - - - - b7af7264 by Carl Friedrich Bolz-Tereick at 2021-11-09T21:24:54+01:00 remove more astbuilder code --HG-- branch : py3.9-peg-parser - - - - - 3f760ad6 by Carl Friedrich Bolz-Tereick at 2021-11-09T21:41:46+01:00 fix --HG-- branch : py3.9-peg-parser - - - - - 05523e1f by Carl Friedrich Bolz-Tereick at 2021-11-09T21:51:23+01:00 bpo-40847: lonely lineconts are ignored --HG-- branch : py3.9-peg-parser - - - - - 584d087e by Carl Friedrich Bolz-Tereick at 2021-11-09T21:59:31+01:00 improve error message for \ in the middle of a line --HG-- branch : py3.9-peg-parser - - - - - f5104661 by Carl Friedrich Bolz-Tereick at 2021-11-09T22:13:56+01:00 gah --HG-- branch : py3.9-peg-parser - - - - - 31c2b3fc by Carl Friedrich Bolz-Tereick at 2021-11-10T10:58:16+01:00 this works now --HG-- branch : py3.9-peg-parser - - - - - c75a5112 by Carl Friedrich Bolz-Tereick at 2021-11-10T11:06:11+01:00 we disabled the old parser --HG-- branch : py3.9-peg-parser - - - - - d3a386d9 by Carl Friedrich Bolz-Tereick at 2021-11-10T11:08:49+01:00 complain earlier about revdbmetavars (not just in codegen) --HG-- branch : py3.9-peg-parser - - - - - ce3e96e9 by Carl Friedrich Bolz-Tereick at 2021-11-10T12:16:12+01:00 fix --HG-- branch : py3.9-peg-parser - - - - - 38cb24d1 by Carl Friedrich Bolz-Tereick at 2021-11-10T13:06:02+01:00 a comment --HG-- branch : py3.9-peg-parser - - - - - 7c413c35 by Carl Friedrich Bolz-Tereick at 2021-11-10T15:11:02+01:00 merge py3.8 --HG-- branch : py3.9-peg-parser - - - - - 35055e69 by Carl Friedrich Bolz-Tereick at 2021-11-11T12:50:49+01:00 stop mutating ASTs in the parser, it's not safe due to memoization --HG-- branch : py3.9-peg-parser - - - - - aedb4d1f by Carl Friedrich Bolz-Tereick at 2021-11-11T16:02:21+01:00 fix translation, test deletion --HG-- branch : py3.9-peg-parser - - - - - 690acdb3 by Carl Friedrich Bolz-Tereick at 2021-11-11T19:12:51+01:00 unify all those places --HG-- branch : py3.9-peg-parser - - - - - 55b0e649 by Carl Friedrich Bolz-Tereick at 2021-11-11T19:13:12+01:00 add end_lineno and end_col_offset to the ast types that have them as default value None --HG-- branch : py3.9-peg-parser - - - - - e1415c99 by Carl Friedrich Bolz-Tereick at 2021-11-11T20:55:12+01:00 - make sure all the things stored into the w_objects when converting asts are not None - support optional string fields on asts correctly - make several ast tests convert the asts to objects to see whether that crashes --HG-- branch : py3.9-peg-parser - - - - - b134ef82 by Carl Friedrich Bolz-Tereick at 2021-11-12T14:29:39+01:00 - add docstrings to ast nodes - deal properly with optional fields of ast classes: add them as None to the type, and only convert them if they are given --HG-- branch : py3.9-peg-parser - - - - - 349839cd by Carl Friedrich Bolz-Tereick at 2021-11-12T16:14:48+01:00 test and fix: got the precedence of the ternary operator wrong --HG-- branch : py3.9-peg-parser - - - - - 3c47c782 by Carl Friedrich Bolz-Tereick at 2021-11-12T18:30:23+01:00 this is now no longer necessary --HG-- branch : py3.9-peg-parser - - - - - a4672506 by Carl Friedrich Bolz-Tereick at 2021-11-12T18:30:51+01:00 properly pass and compare python version --HG-- branch : py3.9-peg-parser - - - - - 8a364da9 by Carl Friedrich Bolz-Tereick at 2021-11-12T21:54:11+01:00 get the assignment/deletion target errors right --HG-- branch : py3.9-peg-parser - - - - - fac9ddf0 by Carl Friedrich Bolz-Tereick at 2021-11-13T11:17:21+01:00 tokenizer errors around binary and octal numbers --HG-- branch : py3.9-peg-parser - - - - - b681586a by Carl Friedrich Bolz-Tereick at 2021-11-14T15:35:34+01:00 kill astbuilder class! --HG-- branch : py3.9-peg-parser - - - - - 0b1e794e by Carl Friedrich Bolz-Tereick at 2021-11-14T16:34:49+01:00 fix a number of small bugs and problems --HG-- branch : py3.9-peg-parser - - - - - 439f4b35 by Carl Friedrich Bolz-Tereick at 2021-11-14T16:42:32+01:00 fix regression --HG-- branch : py3.9-peg-parser - - - - - dac85bc8 by Carl Friedrich Bolz-Tereick at 2021-11-14T19:47:07+01:00 make extra newline after compount_stmt on the shell optional. this means the following works again: >>>> def f(): print(6) >>>> --HG-- branch : py3.9-peg-parser - - - - - 5aa622d5 by Carl Friedrich Bolz-Tereick at 2021-11-14T19:59:39+01:00 fix a problem with generic aliases' __eq__ --HG-- branch : py3.9-peg-parser - - - - - d0064d65 by Carl Friedrich Bolz-Tereick at 2021-11-15T07:36:04+01:00 stop using all the complicated space call machinery to parse numbers --HG-- branch : py3.9-peg-parser - - - - - fe120f89 by Carl Friedrich Bolz-Tereick at 2021-11-15T09:23:48+01:00 merge py3.9-peg-parser switch to using CPython's PEG parsing approach. remove the old astcompiler. the old parser remains in place for 3.9 in the parser module and will be removed in 3.10 --HG-- branch : py3.9 - - - - - 6 changed files: - _pytest/cacheprovider.py - extra_tests/test_generic_alias.py - lib-python/3/test/support/__init__.py - lib-python/3/test/test_type_comments.py - lib_pypy/_pypy_generic_alias.py - pypy/interpreter/astcompiler/ast.py View it on Heptapod: https://foss.heptapod.net/pypy/pypy/-/compare/96cc12e855864e8dfc4652633a0a0378b79ac7c7...fe120f89bf07e64a41de62b224e4a3d80e0fe0d4 -- View it on Heptapod: https://foss.heptapod.net/pypy/pypy/-/compare/96cc12e855864e8dfc4652633a0a0378b79ac7c7...fe120f89bf07e64a41de62b224e4a3d80e0fe0d4 You're receiving this email because of your account on foss.heptapod.net.
_______________________________________________ pypy-commit mailing list pypy-commit@python.org https://mail.python.org/mailman/listinfo/pypy-commit
