On Wed, Sep 21, 2022 at 11:03 AM Barry <ba...@barrys-emacs.org> wrote:
> > On 21 Sep 2022, at 14:58, Jean-Paul Calderone <exar...@twistedmatrix.com> > wrote: > > > Hello, > > I was reviewing some third-party code today and noticed many bugs in it > that arise from FilePath's caching behavior. > > I found https://github.com/twisted/twisted/issues/3161 (only after I > wrote up https://github.com/twisted/twisted/issues/11676 though). > > The cache behavior is long-standing but I think it needs to go. It > represents a dangerous and subtle trap for anyone who tries to use > FilePath, which I would *like *to be everyone - but that would be an > easier sell without traps like this one. > > > There is talk I the ticket about os.listdir being a problem. Isn’t one > option > to use os.scandir that includes some of the stat info for free? > > Barry > Neat. I didn't know about os.scandir (and it looks like it didn't exist at the time of that discussion). Based on the comments on the ticket about Windows behavior, it does look like this would get you closer to feature parity there (I'm not sure exactly what you get on Windows and unfortunately the msdn links glyph left are now 404s and don't give any hint about what APIs he was talking about). If we just took advantage of os.scandir and updated the current implementation then you could probably have `FilePath.children` return a list of `FilePath` instances that already have their metadata cache populated so they would avoid doing even one stat(). However, something else we could do is introduce a new API like `FilePath.children` that returns both the metadata and the path object side-by-side. This would fit with the idea of removing the caching from `FilePath` altogether while still letting you avoid all of the stat() calls in the case where you're traversing the contents of a directory - both on Windows and POSIX. Thanks for pointing that out! Jean-Paul
_______________________________________________ Twisted mailing list -- twisted@python.org To unsubscribe send an email to twisted-le...@python.org https://mail.python.org/mailman3/lists/twisted.python.org/ Message archived at https://mail.python.org/archives/list/twisted@python.org/message/VJ43IRLX47KC3V2B5K2MT2GFTWLGV4EP/ Code of Conduct: https://twisted.org/conduct
