Marcelo Vanzin created SPARK-11956:
--------------------------------------
Summary: Test failures potentially related to SPARK-11140
Key: SPARK-11956
URL: https://issues.apache.org/jira/browse/SPARK-11956
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 1.7.0
Reporter: Marcelo Vanzin
[~joshrosen] pointed out that some YARN tests started failing intermittently
after that change went in. Here's a suspicious excerpt from one of the logs on
Jenkins:
{noformat}
15/11/24 08:58:18 DEBUG TransportClient: Sending stream request for
/jars/sparkJar2657865636759819960.tmp to /192.168.10.27:53256
15/11/24 08:58:18 INFO Utils: Fetching
spark://192.168.10.27:53256/jars/sparkJar2657865636759819960.tmp to
/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/fetchFileTemp4632692089398180695.tmp
15/11/24 09:00:00 WARN CoarseGrainedExecutorBackend: An unknown
(amp-jenkins-worker-07.amp:53256) driver disconnected.
15/11/24 09:00:00 ERROR NettyRpcEnv: Error downloading stream
/jars/sparkJar2657865636759819960.tmp.
java.nio.channels.ClosedChannelException
at
org.apache.spark.network.client.StreamInterceptor.channelInactive(StreamInterceptor.java:61)
at
org.apache.spark.network.util.TransportFrameDecoder.channelInactive(TransportFrameDecoder.java:123)
at
io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:208)
at
io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:194)
at
io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:828)
at
io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:621)
at
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
at
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at java.lang.Thread.run(Thread.java:745)
15/11/24 09:00:00 INFO Utils: Copying
/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/spark-466b6740-bbb5-40ed-8abb-b084a6150115/-4120705061448384283661_cache
to
/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp
15/11/24 09:00:00 INFO Executor: Adding
file:/home/jenkins/workspace/Spark-Master-Maven-with-YARN/HADOOP_PROFILE/hadoop-2.4/label/spark-test/yarn/target/org.apache.spark.deploy.yarn.YarnClusterSuite/org.apache.spark.deploy.yarn.YarnClusterSuite-localDir-nm-0_0/usercache/jenkins/appcache/application_1448384095183_0006/container_1448384095183_0006_01_000002/./sparkJar2657865636759819960.tmp
to class loader
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
