vrozov commented on PR #49654: URL: https://github.com/apache/spark/pull/49654#issuecomment-2640513821
> Though I don't like to make any behavior change as it is not justified that this will help any arbitrary setup. Could you please add the sink option in FileStreamSink, like "qualifyRelativePathInDriver", with default "false"? I don't see why this is necessary and how it will help as the proposal is not to change the behavior that is incorrect. As the change impacts only relative plan and does not impact cases when absolute plan is specified adding extra option will only add confusion, IMO. > While I strongly suspect this is purely based on the setup of the cluster, I'm open for the change to make FileStreamSink work with brew setup. No, it is not specific to the cluster setup. Please try to run the code provided in the JIRA in your cluster setup. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
