HyukjinKwon commented on pull request #32983: URL: https://github.com/apache/spark/pull/32983#issuecomment-864492077
I think it's all good as long as it keeps the behaviour as same as before. My only concern is the reason why the specific patch was reverted in Hadoop. From reading the Hadoop JIRA, > This doesn't seems to handle the case where the nameservice of both source & target filesystem is same, but they point to different clusters. So, it gives a false alarm in that case. It seems like we didn't simply ignore when the paths were same, and seems like it broke something (that was found during tests apparently). If this case is not realistic in the production, I think it should be good to goo with this fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
