cpython

Commit Graph

Author	SHA1	Message	Date
Pablo Galindo	5fc4f8ae68	Fix trailing whitespace in keyword.py (GH-20881)	6 years ago
Pablo Galindo	78319e373d	Include soft keywords in keyword.py (GH-20877)	6 years ago
Pablo Galindo	756180b4bf	bpo-40939: Clean and adapt the peg_generator directory after deleting the old parser (GH-20822)	6 years ago
Pablo Galindo	1ed83adb0e	bpo-40939: Remove the old parser (GH-20768) This commit removes the old parser, the deprecated parser module, the old parser compatibility flags and environment variables and all associated support code and documentation.	6 years ago
Lysandros Nikolaou	9727694f08	bpo-40939: Generate keyword.py using the new parser (GH-20800)	6 years ago
Lysandros Nikolaou	ba6fd87e41	Refactor scripts in Tools/peg_generator/scripts (GH-20401)	6 years ago
Pablo Galindo	404b23b85b	Fix lookahead of soft keywords in the PEG parser (GH-20436) Automerge-Triggered-By: @gvanrossum	6 years ago
Guido van Rossum	b45af1a569	Add soft keywords (GH-20370) These are like keywords but they only work in context; they are not reserved except when there is an exact match. This would enable things like match statements without reserving `match` (which would be bad for the `re.match()` function and probably lots of other places). Automerge-Triggered-By: @gvanrossum	6 years ago
Ammar Askar	a2bbedc8b1	Fix peg_generator compiler warnings under MSVC (GH-20405)	6 years ago
Lysandros Nikolaou	9645930b5b	bpo-40688: Use the correct parser in the peg_generator scripts (GH-20235) The scripts in `Tools/peg_generator/scripts` mostly assume that `ast.parse` and `compile` use the old parser, since this was the state of things, while we were developing them. They need to be updated to always use the correct parser. `_peg_parser` is being extended to support both parsing and compiling with both parsers.	6 years ago
Pablo Galindo	deb4355a37	bpo-40750: Do not expand the new parser debug flags if Py_BUILD_CORE is not defined (GH-20393)	6 years ago
Pablo Galindo	800a35c623	bpo-40750: Support -d flag in the new parser (GH-20340)	6 years ago
Batuhan Taskaya	cba5031510	bpo-40334: Support suppressing of multiple optional variables in Pegen (GH-20367)	6 years ago
Pablo Galindo	b831129123	Fix debug output in PEG parser generator (GH-20308)	6 years ago
Pablo Galindo	d10fef35c6	Fix typing problems reported by mypy in pegen (GH-20297)	6 years ago
Batuhan Taskaya	f50516e6a9	bpo-40334: Correctly generate C parser when assigned var is None (GH-20296) When there are 2 negative lookaheads in the same rule, let's say `!"(" blabla "," !")"`, there will the 2 `FunctionCall`'s where assigned value is None. Currently when the `add_var` is called the first one will be ignored but when the second lookahead's var is sent to dedupe it will be returned as `None_1` and this won't be ignored by the declaration generator in the `visit_Alt`. This patch adds an explicit check to `add_var` to distinguish whether if there is a variable or not.	6 years ago
Pablo Galindo	3764069f3b	bpo-40669: Use requirements.pip when installing PEG dependencies (GH-20194)	6 years ago
Lysandros Nikolaou	dc31800f86	bpo-40669: Install PEG benchmarking dependencies in a venv (GH-20183) Create a `make venv` target, that creates a virtual environment and installs the dependency in that venv. `make time` and all the related targets are changed to use the virtual environment python. Automerge-Triggered-By: @pablogsal	6 years ago
Lysandros Nikolaou	7b7a21bc4f	bpo-40661: Fix segfault when parsing invalid input (GH-20165) Fix segfaults when parsing very complex invalid input, like `import äˆ ð£„¯ð¢·žð±‹á”€ð””ð‘©±å®ä±¬ð©¾\nð—¶½`. Co-authored-by: Guido van Rossum <guido@python.org> Co-authored-by: Pablo Galindo <pablogsal@gmail.com>	6 years ago
Lysandros Nikolaou	2c8cd06afe	bpo-40334: Improvements to error-handling code in the PEG parser (GH-20003) The following improvements are implemented in this commit: - `p->error_indicator` is set, in case malloc or realloc fail. - Avoid memory leaks in the case that realloc fails. - Call `PyErr_NoMemory()` instead of `PyErr_Format()`, because it requires no memory. Co-authored-by: Pablo Galindo <Pablogsal@gmail.com>	6 years ago
Pablo Galindo	ac7a92cc0a	bpo-40334: Avoid collisions between parser variables and grammar variables (GH-19987) This is for the C generator: - Disallow rule and variable names starting with `_` - Rename most local variable names generated by the parser to start with `_` Exceptions: - Renaming `p` to `_p` will be a separate PR - There are still some names that might clash, e.g. - anything starting with `Py` - C reserved words (`if` etc.) - Macros like `EXTRA` and `CHECK`	6 years ago
Pablo Galindo	db9163ceef	bpo-40555: Check for p->error_indicator in loop rules after the main loop is done (GH-19986)	6 years ago
Pablo Galindo	470aac4d8e	bpo-40334: Generate comments in the parser code to improve debugging (GH-19966)	6 years ago
Anthony Shaw	c95e691c90	Clean up unused imports for the peg generator module (GH-19891)	6 years ago
Pablo Galindo	d2baff4301	bpo-40334: regenerate metaparser as part of regen-all (GH-19854)	6 years ago
Pablo Galindo	9dbaa8d9f0	Fix some scripts in the peg generator folder (GH-19853)	6 years ago
Pablo Galindo	7ba08ff7b4	bpo-40334: use the TOKENS file when checking dangling rules (GH-19849)	6 years ago
Pablo Galindo	6bd99d5f00	Fix the Tools/peg_generator/scripts/benchmark.py script (GH-19848)	6 years ago
Pablo Galindo	b796b3fb48	bpo-40334: Simplify type handling in the PEG c_generator (GH-19818)	6 years ago
Pablo Galindo	4db245ee9d	bpo-40334: refactor and cleanup for the PEG generators (GH-19775)	6 years ago
Pablo Galindo	5b9f4988c9	bpo-40334: Refactor peg_generator to receive a Tokens file when building c code (GH-19745)	6 years ago
Pablo Galindo	2b74c835a7	bpo-40334: Support CO_FUTURE_BARRY_AS_BDFL in the new parser (GH-19721) This commit also allows to pass flags to the new parser in all interfaces and fixes a bug in the parser generator that was causing to inline rules with actions, making them disappear.	6 years ago
Lysandros Nikolaou	24ffe705c3	bpo-40334: Rewrite test_c_parser to avoid memory leaks (GH-19694) Previously every test was building an extension module and loading it into sys.modules. The tearDown function was thus not able to clean up correctly, resulting in memory leaks. With this commit, every test function now builds the extension module and runs the actual test code in a new process (using assert_python_ok), so that sys.modules stays intact and no memory gets leaked.	6 years ago
Pablo Galindo	50f28dea32	bpo-40334: Allow to run make regen-pegen without distutils (GH-19684)	6 years ago
Pablo Galindo	9e6a1312c1	bpo-40370: Use the same compile and link args as the interpreter used in test_peg_generator (GH-19674)	6 years ago
Pablo Galindo	1df5a9e88c	bpo-40334: Fix build errors and warnings in test_peg_generator (GH-19672)	6 years ago
Pablo Galindo	0b7829e089	Compile extensions in test_peg_generator with C99 (GH-19668)	6 years ago
Pablo Galindo	c5fc156852	bpo-40334: PEP 617 implementation: New PEG parser for CPython (GH-19503) Co-authored-by: Guido van Rossum <guido@python.org> Co-authored-by: Lysandros Nikolaou <lisandrosnik@gmail.com>	6 years ago

38 Commits (de4304dad8e035dbbb57d653e685312eead816df)