dongjoon-hyun edited a comment on issue #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown URL: https://github.com/apache/spark/pull/25955#issuecomment-548230386 Hi, Guys. Sorry, but this breaks our `SBT with Hadoop 3.2 (JDK8)` profile. - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-3.2/681/ (OrcFilterSuite fails) - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-3.2/682/ (This is running, but OrcFilterSuite fails already) I checked that the failure happens consistently on `master` branch. ``` $ build/sbt "sql/testOnly *.OrcFilterSuite" -Phadoop-3.2 ... [info] - filter pushdown - integer *** FAILED *** (2 seconds, 173 milliseconds) [info] org.apache.spark.sql.AnalysisException: Can not match OrcTable in the query.; ... [info] *** 10 TESTS FAILED *** [error] Failed: Total 14, Failed 10, Errors 0, Passed 4 [error] Failed tests: [error] org.apache.spark.sql.execution.datasources.orc.OrcFilterSuite [error] (sql/test:testOnly) sbt.TestsFailedException: Tests unsuccessful [error] Total time: 57 s, completed Oct 30, 2019 11:05:15 PM ``` Without this patch, it's recovered. Although this is not a part of `3.0.0-preview` RC2, I'll revert this urgently in order to recover our all Jenkins environment during votes. Also, we may have RC3. cc @jiangxb1987 since he is a release manager for 3.0.0-preview.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
