gaborgsomogyi commented on issue #23764: [SPARK-26825][SS] Fix temp checkpoint creation in cluster mode when default filesystem is not local. URL: https://github.com/apache/spark/pull/23764#issuecomment-466342198 Before the PR I've checked the possibilities but couldn't come up something which can be added as UT. What I was trying is to set default FS to something which is not `file` (for instance `hdfs`) and then check the resolved checkpoint path not changes the schema. This approach fails inside the resolve process. To resolve this somehow the filesystem has to be mocked where I didn't find solution. If you have some idea feel free because testing manually is brittle for long term.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
