I am using Intellij IDEA 15.0.6. I used to use Maven to compile Spark
project Catalyst inside Intellij without problem.
A couple of days ago, I fetched latest Spark code from its master
repository. There was a change in CreateJacksonParser.scala. So I used
Maven to compile Catalyst project again. Then I got this error:
...../spark/sql/catalyst/json/CreateJacksonParser.scala:33: value
getByteBuffer is not a member of org.apache.spark.unsafe.types.UTF8String
Note that I was able to compile the source code using sbt. This compile
error happens inside Intellij/Maven. Below is the detailed message. Any
advice will be appreciated.
******* **************** *******
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @
spark-catalyst_2.11 ---
[INFO] Using zinc server for incremental compilation
Compiling 203 Scala sources and 26 Java sources to
/home/rhu/spark-20/sql/catalyst/target/scala-2.11/classes....
/home/rhu/spark-20/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/json/CreateJacksonParser.scala:33:
value getByteBuffer is not a member of
org.apache.spark.unsafe.types.UTF8String
val bb = record.getByteBuffer
^ not found
One error found.
[INFO] Compile failed at Feb 20, 2017
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 01:53 min
[INFO] Finished at: 2017-02-20T17:37:55-08:00
[INFO] Final Memory: 38M/795M
[INFO]
------------------------------------------------------------------------
[WARNING] The requested profile "hive" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on
project spark-catalyst_2.11: Execution scala-compile-first of goal
net.alchim31.maven:scala-maven-plugin:3.2.2:compile failed. CompileFailed ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
Process finished with exit code 1
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/In-Intellij-maven-failed-to-build-Catalyst-project-tp21036.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
