Dawnpool commented on issue #40365: URL: https://github.com/apache/airflow/issues/40365#issuecomment-2227981610
Hi @marcindulak I am not sure what most people do to recursively obtain the list of all files in a directory, but I was considering writing a recursive function using depth-first search for that in this operator code. As you mentioned, adding the MSLD command would be very useful. I found that the `describe_directory` function in [SFTPHook](https://airflow.apache.org/docs/apache-airflow-providers-sftp/3.0.0/_api/airflow/providers/sftp/hooks/sftp/index.html#airflow.providers.sftp.hooks.sftp.SFTPHook.describe_directory) actually uses the MLSD command. However, from my research, only FTP supports MLSD, not SFTP, so, I am not sure if I would be able to use it. Thank you for your opinion, and please let me know if you have any further suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
