Re: [Python-Dev] Remaining decisions on PEP 471 -- os.scandir()

2014-07-20 Thread Antoine Pitrou
Le 20/07/2014 17:34, Ben Hoyt a écrit : Have you tried modifying importlib's _bootstrap.py to use scandir() instead of listdir() + stat()? No, I haven't -- I'm not familiar with that code. What does _bootstrap.py do -- does it do a lot of listdir calls and stat-ing of many files? Quite a bit,

Re: [Python-Dev] Remaining decisions on PEP 471 -- os.scandir()

2014-07-20 Thread Brett Cannon
Oh yes. :) The file Antoine is referring to is the implementation of import. On Sun, Jul 20, 2014, 17:34 Ben Hoyt wrote: > > Have you tried modifying importlib's _bootstrap.py to use scandir() > instead > > of listdir() + stat()? > > No, I haven't -- I'm not familiar with that code. What does >

Re: [Python-Dev] Remaining decisions on PEP 471 -- os.scandir()

2014-07-20 Thread Ben Hoyt
> Have you tried modifying importlib's _bootstrap.py to use scandir() instead > of listdir() + stat()? No, I haven't -- I'm not familiar with that code. What does _bootstrap.py do -- does it do a lot of listdir calls and stat-ing of many files? -Ben ___

Re: [Python-Dev] Remaining decisions on PEP 471 -- os.scandir()

2014-07-20 Thread Antoine Pitrou
Hi, > Thanks Victor, Nick, Ethan, and others for continued discussion on the scandir PEP 471 (most recent thread starts at https://mail.python.org/pipermail/python-dev/2014-July/135377.html). Have you tried modifying importlib's _bootstrap.py to use scandir() instead of listdir() + stat()?

[Python-Dev] subprocess research - max limit for piped output

2014-07-20 Thread anatoly techtonik
I am trying to figure out what is maximum size for piped input in subprocess.check_output() I've got limitation of about 500Mb after which Python exits with MemoryError without any additional details. I have only 2.76Gb memory used out of 8Gb, so what limit do I hit? 1. subprocess output read bu