Ryan - dont know the code specifics behind FetchSFTP off-hand but i
can confirm there are users at that range for it.

Thanks

On Tue, Oct 31, 2017 at 11:38 AM, Ryan Ward <[email protected]> wrote:
> I've found that on a single node getSFTP is able to pull more files off a
> remote server than Fetch in a cluster. I noticed Fetch doesn't have a max
> selects so it is requiring way more connections (one per file?) and
> concurrent threads to keep up.
>
> Was wondering if anyone is using List/Fetch at scale? In the multi TB's a
> day range?
>
> Thanks,
> Ryan

Reply via email to