Re: BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Hi, Thanks Sean! You're right -- my local repo got hosed. I don't know why the patch with AnalysisBarrier didn't go through. Speaking of the patch [1] I've noticed a sentence in the scaladoc of AnalysisBarrier that does not make much sense to me. There's something missing in it, isn't there? > The SQL Analyzer goes through a whole query plan even most part of it is analyzed. What is this sentence telling me? `if` missing in between "even most"? [1] https://github.com/apache/spark/blob/00d176d2fe7bbdf55cb3146a9cb04ca99b1858b7/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicLogicalOperators.scala?utf8=%E2%9C%93#L890 Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Fri, Dec 8, 2017 at 6:40 PM, Sean Owenwrote: > Build is fine for me, and on Jenkins. Try a clean build? > > On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowski wrote: > >> Hi, >> >> Just got BUILD FAILURE and have been wondering if it's just me or is this >> a known issue that's being worked on? >> >> (Sorry if that's just my local setup that I got broken) >> >> [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ >> spark-catalyst_2.11 --- >> [INFO] Using zinc server for incremental compilation >> [warn] Pruning sources from previous analysis, due to incompatible >> CompileSetup. >> [info] Compiling 222 Scala sources and 27 Java sources to >> /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes... >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: not found: >> value AnalysisBarrier >> [error] AnalysisBarrier(newRight) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: not found: >> value AnalysisBarrier >> [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => >> sa >> [error]^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: not found: >> value AnalysisBarrier >> [error] return AnalysisBarrier(plan) >> [error]^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: not found: >> value AnalysisBarrier >> [error] case filter @ Filter(havingCondition, >> AnalysisBarrier(aggregate: Aggregate)) => >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: not found: >> value AnalysisBarrier >> [error] apply(Filter(havingCondition, aggregate)).mapChildren( >> AnalysisBarrier) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: not found: >> value AnalysisBarrier >> [error] case sort @ Sort(sortOrder, global, >> AnalysisBarrier(aggregate: Aggregate)) => >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: not found: >> value AnalysisBarrier >> [error] apply(Sort(sortOrder, global, aggregate)).mapChildren( >> AnalysisBarrier) >> [error] ^ >> [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/ >> org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: not found: >> value AnalysisBarrier >> [error] case AnalysisBarrier(child) => child >> [error] ^ >> [error] 8 errors found >> [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s] >> [INFO] >> >> >> Pozdrawiam, >> Jacek Laskowski >> >> https://about.me/JacekLaskowski >> Spark Structured Streaming https://bit.ly/spark-structured-streaming >> Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark >> Follow me at https://twitter.com/jaceklaskowski >> >
Re: BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Build is fine for me, and on Jenkins. Try a clean build? On Fri, Dec 8, 2017 at 11:04 AM Jacek Laskowskiwrote: > Hi, > > Just got BUILD FAILURE and have been wondering if it's just me or is this > a known issue that's being worked on? > > (Sorry if that's just my local setup that I got broken) > > [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ > spark-catalyst_2.11 --- > [INFO] Using zinc server for incremental compilation > [warn] Pruning sources from previous analysis, due to incompatible > CompileSetup. > [info] Compiling 222 Scala sources and 27 Java sources to > /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes... > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: > not found: value AnalysisBarrier > [error] AnalysisBarrier(newRight) > [error] ^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: > not found: value AnalysisBarrier > [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => sa > [error]^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: > not found: value AnalysisBarrier > [error] return AnalysisBarrier(plan) > [error]^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: > not found: value AnalysisBarrier > [error] case filter @ Filter(havingCondition, > AnalysisBarrier(aggregate: Aggregate)) => > [error] ^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: > not found: value AnalysisBarrier > [error] apply(Filter(havingCondition, > aggregate)).mapChildren(AnalysisBarrier) > [error] ^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: > not found: value AnalysisBarrier > [error] case sort @ Sort(sortOrder, global, > AnalysisBarrier(aggregate: Aggregate)) => > [error] ^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: > not found: value AnalysisBarrier > [error] apply(Sort(sortOrder, global, > aggregate)).mapChildren(AnalysisBarrier) > [error] ^ > [error] > /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: > not found: value AnalysisBarrier > [error] case AnalysisBarrier(child) => child > [error] ^ > [error] 8 errors found > [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s] > [INFO] > > > Pozdrawiam, > Jacek Laskowski > > https://about.me/JacekLaskowski > Spark Structured Streaming https://bit.ly/spark-structured-streaming > Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark > Follow me at https://twitter.com/jaceklaskowski >
BUILD FAILURE due to...not found: value AnalysisBarrier in spark-catalyst_2.11?
Hi, Just got BUILD FAILURE and have been wondering if it's just me or is this a known issue that's being worked on? (Sorry if that's just my local setup that I got broken) [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-catalyst_2.11 --- [INFO] Using zinc server for incremental compilation [warn] Pruning sources from previous analysis, due to incompatible CompileSetup. [info] Compiling 222 Scala sources and 27 Java sources to /Users/jacek/dev/oss/spark/sql/catalyst/target/scala-2.11/classes... [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:728: not found: value AnalysisBarrier [error] AnalysisBarrier(newRight) [error] ^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1081: not found: value AnalysisBarrier [error] case sa @ Sort(_, _, AnalysisBarrier(child: Aggregate)) => sa [error]^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1134: not found: value AnalysisBarrier [error] return AnalysisBarrier(plan) [error]^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1409: not found: value AnalysisBarrier [error] case filter @ Filter(havingCondition, AnalysisBarrier(aggregate: Aggregate)) => [error] ^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1410: not found: value AnalysisBarrier [error] apply(Filter(havingCondition, aggregate)).mapChildren(AnalysisBarrier) [error] ^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1470: not found: value AnalysisBarrier [error] case sort @ Sort(sortOrder, global, AnalysisBarrier(aggregate: Aggregate)) => [error] ^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:1471: not found: value AnalysisBarrier [error] apply(Sort(sortOrder, global, aggregate)).mapChildren(AnalysisBarrier) [error] ^ [error] /Users/jacek/dev/oss/spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala:2345: not found: value AnalysisBarrier [error] case AnalysisBarrier(child) => child [error] ^ [error] 8 errors found [error] Compile failed at Dec 8, 2017 5:58:10 PM [8.170s] [INFO] Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski