rhyphenkumar commented on issue #9339: URL: https://github.com/apache/seatunnel/issues/9339#issuecomment-2897193098
> > > If user don't need exactly-once (or downstream can handle data duplicate), and the rename phase cost long time, maybe the write temp phase can be ignore. > > > > > > [@liunaijie](https://github.com/liunaijie) is there any config or option to bypass it? > > As for as I know, now there is no config to do this, need code change. @liunaijie can files renaming be done on executors in parallel instead of driver ? This will drastically reduce the time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
