[
https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15301457#comment-15301457
]
Sean Owen commented on SPARK-15541:
-----------------------------------
Yes, this is a subtle Java version issue. It means this was compiled with Java
8, but run on Java 7, which is almost always entirely fine if the source code
itself is targeted at Java 7 and works with Java 7. But in this case the
compiled version differs when compiled with Java 8 in a way that's not
backwards compatible. I think you have to compile with Java 7, but, best to fix
this by steering clear of it, perhaps following
http://stackoverflow.com/questions/25705259/undefined-reference-concurrenthashmap-keyset-when-building-in-java-8
> SparkContext.stop throws error
> ------------------------------
>
> Key: SPARK-15541
> URL: https://issues.apache.org/jira/browse/SPARK-15541
> Project: Spark
> Issue Type: Bug
> Reporter: Miao Wang
>
> When running unit-tests or examples from command line or Intellij,
> SparkContext throws errors.
> For example:
> ./bin/run-example ml.JavaNaiveBayesExample
> Exception in thread "main" 16/05/25 15:17:55 INFO
> OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
> OutputCommitCoordinator stopped!
> java.lang.NoSuchMethodError:
> java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView;
> at org.apache.spark.rpc.netty.Dispatcher.stop(Dispatcher.scala:176)
> at org.apache.spark.rpc.netty.NettyRpcEnv.cleanup(NettyRpcEnv.scala:291)
> at
> org.apache.spark.rpc.netty.NettyRpcEnv.shutdown(NettyRpcEnv.scala:269)
> at org.apache.spark.SparkEnv.stop(SparkEnv.scala:91)
> at
> org.apache.spark.SparkContext$$anonfun$stop$11.apply$mcV$sp(SparkContext.scala:1796)
> at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1219)
> at org.apache.spark.SparkContext.stop(SparkContext.scala:1795)
> at org.apache.spark.sql.SparkSession.stop(SparkSession.scala:577)
> at
> org.apache.spark.examples.ml.JavaNaiveBayesExample.main(JavaNaiveBayesExample.java:61)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:724)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 16/05/25 15:17:55 INFO ShutdownHookManager: Shutdown hook called
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
