dongjoon-hyun edited a comment on pull request #30135: URL: https://github.com/apache/spark/pull/30135#issuecomment-864466090
Hi, All. FYI, From Apache Hadoop 3.3.1, we reverted [HADOOP-16878](https://issues.apache.org/jira/browse/HADOOP-16878) as the last revert commit on `branch-3.3.1`. - https://github.com/apache/hadoop/commit/a3b9c37a397ad4188041dd80621bdeefc46885f2 However, Apache Spark Jenkins seems to hit a flakiness issue. - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2/lastCompletedBuild/testReport/org.apache.spark.deploy.yarn/ClientSuite/distribute_jars_archive/history/ ``` org.apache.hadoop.fs.PathOperationException: `Source (file:/home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/resource-managers/yarn/target/tmp/spark-703b8e99-63cc-4ba6-a9bc-25c7cae8f5f9/testJar9120517778809167117.jar) and destination (/home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/resource-managers/yarn/target/tmp/spark-703b8e99-63cc-4ba6-a9bc-25c7cae8f5f9/testJar9120517778809167117.jar) are equal in the copy command.': Operation not supported at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:403) ``` Please note that this is a flakiness and at the same time the error log is pointing `FileUtil.java:403` which is the code before reverting. I'm investigating this. cc @gengliangwang since he is the release manager for Apache Spark 3.2.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
