Hi Jeremy, In this case I don't think there is an easy answer here.
You may have some luck with adjusting the max runtime of the processor but without checking the the processors implementation I couldn't know for certain if that would have any effect. Edward On Mon, 9 Mar 2020, 06:34 Jeremy Pemberton-Pigott, <[email protected]> wrote: > Hi, > > I need to list a sub-set (few 100,000) of files in a folder with millions > of files (to do some historical processing). What's the best way I can do > that? ListFiles is taking way too long and seems to try to dump the entire > list to the flow when I test it on a smaller folder list. It would be good > if the listing emitted files in smaller chunks so that the flow can start > working on them. > > Regards, > > Jeremy >
