DanielLeens commented on issue #11306: URL: https://github.com/apache/seatunnel/issues/11306#issuecomment-4902159651
Thanks @goutamadwant, assigning this to you sounds good. Your proposed split makes sense: PR #11312 can continue with the `sync_mode=update` discovery / target comparison optimization, while this issue should stay focused on the submit-time blocking before `jobId` is returned, especially because the same delay is visible in `full` mode. For the first pass, please keep the scope narrow around the SftpFile source preparation path and make the behavior measurable. Timing logs or tests around large remote file enumeration would be very helpful here, so @Echo18322276280 can validate the fix with the sanitized production-shaped config and logs later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
