[issue26545] os.walk is limited by python's recursion limit

[Sergey Chvalyuk]

Sergey Chvalyuk added the comment:

There is another limitation with os.walk
it also cannot go very deep inside tree because of scandir can throw 
OSError(36, 'File name too long')

I have wrote tests for both cases:

https://gist.github.com/grubberr/3367f1d605e292103b576a17a46ef3c3

tested on linux only

on MacOS it throw 'File name too long' for 1-st test too
set sys.settrecursionlimit to lower values

--
nosy: +Sergey Chvalyuk

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26545] os.walk is limited by python's recursion limit

[Elena Oat]

Elena Oat added the comment:

I've actually tried to test the recursion limit on my Mac OS X. It seems that I 
cannot create any subdirectories after around 500 subdir depth. I guess it's 
related to the allowed path length (<1024 chars?).

--
nosy: +Elena.Oat

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26545] os.walk is limited by python's recursion limit

[Raymond Hettinger]

Raymond Hettinger added the comment:

I think the code should be left as-is (we've used some variation of recursion 
for walking a very long time with no reported real-world problems).  Perhaps a 
documentation note can be added to the effect that the there is a recursion 
limit and that it can be changed by the user if needed.

--
assignee:  -> docs@python
components: +Documentation -Library (Lib)
nosy: +docs@python, rhettinger
priority: normal -> low

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26545] os.walk is limited by python's recursion limit

[Thomas Waldmann]

Thomas Waldmann added the comment:

Note: similar issues can be seen in other stdlib recursive filesystem-related 
functions also.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26545] os.walk is limited by python's recursion limit

[Thomas Waldmann]

New submission from Thomas Waldmann:

os.walk calls itself recursively and that limits the directory depth it can 
"walk" into.

On Linux, one can create directory hierarchies deeper than that.

For some more details see there:

https://github.com/borgbackup/borg/issues/380

--
components: Library (Lib)
messages: 261626
nosy: Thomas.Waldmann
priority: normal
severity: normal
status: open
title: os.walk is limited by python's recursion limit
versions: Python 3.5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com