[
https://issues.apache.org/jira/browse/SPARK-11956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-11956.
------------------------------------
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 1.7.0
> Test failures potentially related to SPARK-11140
> ------------------------------------------------
>
> Key: SPARK-11956
> URL: https://issues.apache.org/jira/browse/SPARK-11956
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.7.0
> Reporter: Marcelo Vanzin
> Assignee: Marcelo Vanzin
> Fix For: 1.7.0
>
>
> [~joshrosen] pointed out that some YARN tests started failing intermittently
> after that change went in. Here's a suspicious excerpt from one of the logs
> on Jenkins:
> {noformat}
> 15/11/24 08:58:18 DEBUG TransportClient: Sending stream request for
> /jars/sparkJar2657865636759819960.tmp to /192.168.10.27:53256
> 15/11/24 08:58:18 INFO Utils: Fetching
> spark://192.168.10.27:53256/jars/sparkJar2657865636759819960.tmp to
> /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/fetchFileTemp4632692089398180695.tmp
> 15/11/24 09:00:00 WARN CoarseGrainedExecutorBackend: An unknown
> (amp-jenkins-worker-07.amp:53256) driver disconnected.
> 15/11/24 09:00:00 ERROR NettyRpcEnv: Error downloading stream
> /jars/sparkJar2657865636759819960.tmp.
> java.nio.channels.ClosedChannelException
> at
> org.apache.spark.network.client.StreamInterceptor.channelInactive(StreamInterceptor.java:61)
> at
> org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:123)
> at
> io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
> at
> io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
> at
> io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:828)
> at
> io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:621)
> at
> io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
> at
> io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
> at java.lang.Thread.run(Thread.java:745)
> 15/11/24 09:00:00 INFO Utils: Copying
> /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/-4120705061448384283661_cache
> to
> /home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp
> 15/11/24 09:00:00 INFO Executor: Adding
> file:/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp
> to class loader
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
