I think the reason you're seeing this (and it then disappearing in Sean's case) is likely that there was a change in another that required a recompile of a module dependency. Maven doesn't do this automatically by default. So it eventually goes away when you do a full build either with Maven or SBT.
You could add `--also-make-dependents` (-amd) as a build flag to fix this behavior and rebuild dependencies too. On Tue, Feb 21, 2017 at 6:35 AM, Sean Owen <so...@cloudera.com> wrote: > I saw this too yesterday but not today. It may have been fixed by some > recent commits. > > On Mon, Feb 20, 2017 at 6:52 PM ron8hu <ron...@huawei.com> wrote: > > I am using Intellij IDEA 15.0.6. I used to use Maven to compile Spark > project Catalyst inside Intellij without problem. > > A couple of days ago, I fetched latest Spark code from its master > repository. There was a change in CreateJacksonParser.scala. So I used > Maven to compile Catalyst project again. Then I got this error: > ...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value > getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String > > Note that I was able to compile the source code using sbt. This compile > error happens inside Intellij/Maven. Below is the detailed message. Any > advice will be appreciated. > ******* **************** ******* > [INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ > spark-catalyst_2.11 --- > [INFO] Using zinc server for incremental compilation > > Compiling 203 Scala sources and 26 Java sources to > /home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes.... > /home/rhu/spark-20/sql/catalyst/src/main/scala/org/ > apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33: > value getByteBuffer is not a member of > org.apache.spark.unsafe.types.UTF8String > val bb = record.getByteBuffer > ^ not found > > One error found. > [INFO] Compile failed at Feb 20, 2017 > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 01:53 min > [INFO] Finished at: 2017-02-20T17:37:55-08:00 > [INFO] Final Memory: 38M/795M > [INFO] > ------------------------------------------------------------------------ > [WARNING] The requested profile "hive" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) > on > project spark-catalyst_2.11: Execution scala-compile-first of goal > net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed > -> > [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException > > Process finished with exit code 1 > > > > > -- > View this message in context: http://apache-spark- > developers-list.1001551.n3.nabble.com/In-Intellij-maven- > failed-to-build-Catalyst-project-tp21036.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
