[issue38112] Compileall improvements

[STINNER Victor]

STINNER Victor  added the comment:


New changeset adc72bb2f9a5d8b548ee04405e19a184e5699e8d by Lumír 'Frenzy' Balhar 
in branch 'master':
bpo-38112: Document that compileall.compile_[dir,file] also accept multiple opt 
levels (GH-20174)
https://github.com/python/cpython/commit/adc72bb2f9a5d8b548ee04405e19a184e5699e8d


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Lumír Balhar]

Change by Lumír Balhar :


--
nosy: +frenzy
nosy_count: 4.0 -> 5.0
pull_requests: +19475
pull_request: https://github.com/python/cpython/pull/20174

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Gregory P. Smith]

Gregory P. Smith  added the comment:

https://bugs.python.org/issue39769 may be of interest.  compileall's ddir= does 
not behave properly in recursive subdirectories, it did the right thing in 2.7 
which is similar to a combination of compile_dir(dir, prependdir=ddir, 
stripdir=dir) after this issue's feature.

--
nosy: +gregory.p.smith

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[STINNER Victor]

STINNER Victor  added the comment:

Should be fixed by:

New changeset eb1dda2b56f67f09352c303588c28880c471ae87 by Petr Viktorin (Victor 
Stinner) in branch 'master':
bpo-38470: Fix test_compileall.test_compile_dir_maxlevels() (GH-16789)
https://github.com/python/cpython/commit/eb1dda2b56f67f09352c303588c28880c471ae87

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:

The AMD64 Windows7 SP1 3.x buildbot has been failing for a while since commit 
4267c989e7fc6cd528e8a1d04a07fac5cca85ec7, please take a look at 
https://bugs.python.org/issue38470.

--
nosy: +pablogsal

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[STINNER Victor]

STINNER Victor  added the comment:

FYI test_compileall.test_compile_dir_maxlevels() also fails on AMD64 FreeBSD 
CURRENT Shared 3.x:
https://buildbot.python.org/all/#builders/168/builds/1529

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Petr Viktorin]

Change by Petr Viktorin :


--
pull_requests: +15999
pull_request: https://github.com/python/cpython/pull/16419

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Petr Viktorin]

Petr Viktorin  added the comment:


New changeset 4267c989e7fc6cd528e8a1d04a07fac5cca85ec7 by Petr Viktorin in 
branch 'master':
bpo-38112: compileall: Skip long path path on Windows if the path can't be 
created (GH-16414)
https://github.com/python/cpython/commit/4267c989e7fc6cd528e8a1d04a07fac5cca85ec7


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Petr Viktorin]

Petr Viktorin  added the comment:

Thanks!
The buildbot complained in the pull request a while ago; I commented there that 
I'm looking into it.

I'd appreciate a review for the fix; I don't have a good way to test it other 
than offer it to the buildbots.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Petr Viktorin]

Change by Petr Viktorin :


--
pull_requests: +15994
pull_request: https://github.com/python/cpython/pull/16414

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[STINNER Victor]

STINNER Victor  added the comment:

Similar errors on AMD64 Windows10 3.x:
https://buildbot.python.org/all/#/builders/3/builds/3567

pythoninfo:

sys.windowsversion: sys.getwindowsversion(major=10, minor=0, build=17134, 
platform=2, service_pack='')
windows.RtlAreLongPathsEnabled: False

--

And AMD64 Windows7 SP1 3.x:
https://buildbot.python.org/all/#/builders/40/builds/3180

pythoninfo:

sys.windowsversion: sys.getwindowsversion(major=6, minor=1, build=7601, 
platform=2, service_pack='Service Pack 1')
windows.RtlAreLongPathsEnabled: 

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[STINNER Victor]

STINNER Victor  added the comment:

test_compileall failed on AMD64 Windows8.1 Non-Debug 3.x:
https://buildbot.python.org/all/#/builders/12/builds/3257

Example:

ERROR: test_compile_dir_pathlike 
(test.test_compileall.CompileallTestsWithSourceEpoch)
--
Traceback (most recent call last):
  File 
"D:\buildarea\3.x.ware-win81-release.nondebug\build\lib\test\test_compileall.py",
 line 48, in setUp
os.makedirs(self.long_path)
  File "D:\buildarea\3.x.ware-win81-release.nondebug\build\lib\os.py", line 
211, in makedirs
makedirs(head, exist_ok=exist_ok)
  File "D:\buildarea\3.x.ware-win81-release.nondebug\build\lib\os.py", line 
211, in makedirs
makedirs(head, exist_ok=exist_ok)
  File "D:\buildarea\3.x.ware-win81-release.nondebug\build\lib\os.py", line 
211, in makedirs
makedirs(head, exist_ok=exist_ok)
  [Previous line repeated 18 more times]
  File "D:\buildarea\3.x.ware-win81-release.nondebug\build\lib\os.py", line 
221, in makedirs
mkdir(name, mode)
FileNotFoundError: [WinError 206] The filename or extension is too long: 
'D:\\temp\\tmpcgsk1z3q\\long\\1\\2\\3\\4\\5\\6\\7\\8\\9\\10\\11\\12\\13\\14\\15\\16\\17\\18\\19\\20\\21\\22\\23\\24\\25\\26\\27\\28\\29\\30\\31\\32\\33\\34\\35\\36\\37\\38\\39\\40\\41\\42\\43\\44\\45\\46\\47\\48\\49\\50\\51\\52\\53\\54\\55\\56\\57\\58\\59\\60\\61\\62\\63\\64\\65\\66\\67\\68\\69\\70\\71\\72\\73\\74\\75\\76\\77\\78'

Failures:

ERROR: test_compile_dir_pathlike 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_file_pathlike 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_file_pathlike_ddir 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_files (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_missing_multiprocessing 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_one_worker 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_path (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_pool_called 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_workers_cpu_count 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_workers_non_positive 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_ignore_symlink_destination 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_magic_number (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_mtime (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_multiple_optimization_levels 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_no_pycache_in_non_package 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_optimize (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_prepend_only (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_strip_and_prepend 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_strip_only (test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_strip_prepend_and_ddir 
(test.test_compileall.CompileallTestsWithSourceEpoch)
ERROR: test_compile_dir_pathlike 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_file_pathlike 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_file_pathlike_ddir 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_files 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_missing_multiprocessing 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_one_worker 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_path 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_pool_called 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_workers_cpu_count 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_compile_workers_non_positive 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_ignore_symlink_destination 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_magic_number 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_mtime (test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_multiple_optimization_levels 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_no_pycache_in_non_package 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_optimize (test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_prepend_only 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_strip_and_prepend 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_strip_only (test.test_compileall.CompileallTestsWithoutSourceEpoch)
ERROR: test_strip_prepend_and_ddir 
(test.test_compileall.CompileallTestsWithoutSourceEpoch)

[issue38112] Compileall improvements

[Petr Viktorin]

Petr Viktorin  added the comment:


New changeset 8e7bb991de7c88583bc6663d8bbc541054ca8dc4 by Petr Viktorin (Lumír 
'Frenzy' Balhar) in branch 'master':
bpo-38112: Compileall improvements (GH-16012)
https://github.com/python/cpython/commit/8e7bb991de7c88583bc6663d8bbc541054ca8dc4


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Lumír Balhar]

Change by Lumír Balhar :


--
keywords: +patch
pull_requests: +15638
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/16012

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue38112] Compileall improvements

[Petr Viktorin]

New submission from Petr Viktorin :

Hello,
In Fedora, we've long used a Bash script to compile modules to bytecode, as the 
compileall module was historically unsuitable.
Recently, Lumír re-wrote our enhancements to compileall, and published the 
result as compileall2 on PyPI. We'd like to get the improvements back into the 
standard library so everyone can benefit.
The improvements are:

- Raise the default recursion limit 
- Control of the path baked into the *.pyc file (`-s` to strip a prefix; `-p` 
to prepend a new one) to support different build/install locations.
- Compiling for multiple optimization levels at once (by specifying -o multiple 
times)

A PR should follow shortly.

--
components: Installation
messages: 351887
nosy: petr.viktorin
priority: normal
severity: normal
status: open
title: Compileall improvements

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com