[
https://issues.apache.org/jira/browse/SPARK-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-8643:
--------------------------------
Labels: bulk-closed (was: )
> local-cluster may not shutdown SparkContext gracefully
> ------------------------------------------------------
>
> Key: SPARK-8643
> URL: https://issues.apache.org/jira/browse/SPARK-8643
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Yin Huai
> Priority: Major
> Labels: bulk-closed
> Attachments: HiveSparkSubmitSuite (SPARK-8368).txt
>
>
> When I was debugging SPARK-8567, I found that when I was using local-cluster,
> at the end of an application, executors were first killed and then launched
> again. From the log (attached), seems the master/driver side does not know
> it's in the shutdown process. So, it detected executor loss and then called
> the worker to launch new executors.
> To reproduce the problem , you can remove sc.stop from classes used in
> HiveSparkSubmitSuite and you will see something like
> {code}
> err> 15/06/24 18:24:05 INFO ExecutorRunner: Killing process!
> err> 15/06/24 18:24:05 INFO ExecutorRunner: Killing process!
> err> 15/06/24 18:24:05 ERROR TaskSchedulerImpl: Lost executor 1 on
> 192.168.10.24: remote Rpc client disassociated
> err> 15/06/24 18:24:05 INFO DAGScheduler: Executor lost: 1 (epoch 3)
> err> 15/06/24 18:24:05 WARN ReliableDeliverySupervisor: Association with
> remote system [akka.tcp://[email protected]:50063] has failed,
> address is now gated for [5000] ms. Reason: [Disassociated]
> err> 15/06/24 18:24:05 WARN ReliableDeliverySupervisor: Association with
> remote system [akka.tcp://[email protected]:50063] has failed,
> address is now gated for [5000] ms. Reason: [Disassociated]
> err> 15/06/24 18:24:05 INFO Worker: Executor app-20150624182313-0000/1
> finished with state EXITED message Command exited with code 143 exitStatus 143
> err> 15/06/24 18:24:05 INFO Master: Removing executor
> app-20150624182313-0000/1 because it is EXITED
> err> 15/06/24 18:24:05 INFO Master: Launching executor
> app-20150624182313-0000/2 on worker worker-20150624182313-192.168.10.24-47283
> err> 15/06/24 18:24:05 INFO BlockManagerMasterEndpoint: Trying to remove
> executor 1 from BlockManagerMaster.
> err> 15/06/24 18:24:05 INFO AppClient$ClientActor: Executor updated:
> app-20150624182313-0000/1 is now EXITED (Command exited with code 143)
> err> 15/06/24 18:24:05 WARN Master: Got status update for unknown executor
> app-20150624182313-0000/1
> err> 15/06/24 18:24:05 INFO Worker: Unknown Executor
> app-20150624182313-0000/1 finished with state EXITED message Worker shutting
> down exitStatus 143
> err> 15/06/24 18:24:05 INFO SparkDeploySchedulerBackend: Executor
> app-20150624182313-0000/1 removed: Command exited with code 143
> err> 15/06/24 18:24:05 INFO BlockManagerMasterEndpoint: Removing block
> manager BlockManagerId(1, 192.168.10.24, 54832)
> err> 15/06/24 18:24:05 INFO Worker: Asked to launch executor
> app-20150624182313-0000/2 for SparkSubmitClassLoaderTest
> err> 15/06/24 18:24:05 INFO BlockManagerMaster: Removed 1 successfully in
> removeExecutor
> err> 15/06/24 18:24:05 ERROR SparkDeploySchedulerBackend: Asked to remove
> non-existent executor 1
> err> 15/06/24 18:24:05 INFO SecurityManager: Changing view acls to: jenkins
> err> 15/06/24 18:24:05 INFO SecurityManager: Changing modify acls to: jenkins
> err> 15/06/24 18:24:05 INFO AppClient$ClientActor: Executor added:
> app-20150624182313-0000/2 on worker-20150624182313-192.168.10.24-47283
> (192.168.10.24:47283) with 1 cores
> err> 15/06/24 18:24:05 INFO SecurityManager: SecurityManager: authentication
> disabled; ui acls disabled; users with view permissions: Set(jenkins); users
> with modify permissions: Set(jenkins)
> err> 15/06/24 18:24:05 INFO SparkDeploySchedulerBackend: Granted executor ID
> app-20150624182313-0000/2 on hostPort 192.168.10.24:47283 with 1 cores, 512.0
> MB RAM
> err> 15/06/24 18:24:05 INFO BlockManagerInfo: Removed broadcast_1_piece0 on
> 192.168.10.24:54899 in memory (size: 2.8 KB, free: 265.3 MB)
> err> 15/06/24 18:24:05 INFO AppClient$ClientActor: Executor updated:
> app-20150624182313-0000/2 is now RUNNING
> err> 15/06/24 18:24:05 INFO ExecutorRunner: Launch command:
> "/usr/java/latest/bin/java" "-cp"
> "/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/conf/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/core/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/repl/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/mllib/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/bagel/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/graphx/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/streaming/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/tools/target/scala-2.10/test-classes:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/catalyst/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/core/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/hive/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/hive-thriftserver/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/yarn/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/launcher/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/core/target/jars/*:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/assembly/target/scala-2.10/spark-assembly-1.5.0-SNAPSHOT-hadoop2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-rdbms-3.2.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-core-3.2.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-api-jdo-3.2.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/hive/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/hive/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/core/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/launcher/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/network/common/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/network/shuffle/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/unsafe/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/core/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/core/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/catalyst/target/scala-2.10/classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/core/target/scala-2.10/test-classes/:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/sql/catalyst/target/scala-2.10/test-classes/:/home/jenkins/.sbt/boot/scala-2.10.4/lib/scala-library.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/unused-1.0.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/netty-all-4.0.28.Final.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/guava-14.0.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/chill_2.10-0.5.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/chill-java-0.5.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/kryo-2.21.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/reflectasm-1.07-shaded.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/minlog-1.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/objenesis-1.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-client-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-common-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-annotations-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-cli-1.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-math3-3.1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/xmlenc-0.52.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-httpclient-3.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-logging-1.1.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-io-2.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-net-3.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-collections-3.2.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/log4j-1.2.17.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-lang-2.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-configuration-1.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-digester-1.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-beanutils-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-beanutils-core-1.8.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/slf4j-api-1.7.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/avro-1.7.7.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jackson-core-asl-1.9.13.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jackson-mapper-asl-1.9.13.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-compress-1.4.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/xz-1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/protobuf-java-2.5.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-auth-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-hdfs-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-util-6.1.26.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-mapreduce-client-app-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-mapreduce-client-common-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-yarn-common-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-yarn-api-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jaxb-api-2.2.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/stax-api-1.0-2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jersey-core-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/guice-3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/javax.inject-1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/aopalliance-1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/cglib-2.2.1-v20090111.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/asm-3.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jersey-server-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jersey-json-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jettison-1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jaxb-impl-2.2.3-1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jackson-jaxrs-1.8.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jackson-xc-1.8.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jersey-guice-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-yarn-client-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-mapreduce-client-core-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-yarn-server-common-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-mapreduce-client-shuffle-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hadoop-mapreduce-client-jobclient-2.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jersey-client-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jets3t-0.9.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/httpcore-4.3.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/httpclient-4.3.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/activation-1.1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/mx4j-3.0.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/mail-1.4.7.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/bcprov-jdk15on-1.51.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/java-xmlbuilder-1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/base64-2.3.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/curator-recipes-2.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/curator-framework-2.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/curator-client-2.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/zookeeper-3.4.5.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jline-0.9.94.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-plus-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/orbits/javax.transaction-1.1.1.v201105210645.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-webapp-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-xml-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-util-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-servlet-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-security-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-server-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/orbits/javax.servlet-3.0.0.v201112011016.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-continuation-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-http-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-io-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-jndi-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/orbits/javax.mail.glassfish-1.4.1.v201005082020.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/orbits/javax.activation-1.1.0.v201105071233.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-lang3-3.3.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jul-to-slf4j-1.7.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/slf4j-log4j12-1.7.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/compress-lzf-1.0.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/snappy-java-1.1.1.7.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/lz4-1.3.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/RoaringBitmap-0.4.5.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/akka-remote_2.10-2.3.11.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/akka-actor_2.10-2.3.11.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/config-1.2.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/netty-3.8.0.Final.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/uncommons-maths-1.2.2a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/akka-slf4j_2.10-2.3.11.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/json4s-jackson_2.10-3.2.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/json4s-core_2.10-3.2.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/json4s-ast_2.10-3.2.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/paranamer-2.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/scalap-2.10.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/scala-compiler-2.10.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jackson-databind-2.4.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jackson-core-2.4.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/mesos-0.21.1-shaded-protobuf.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/stream-2.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/metrics-core-3.1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/metrics-jvm-3.1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/metrics-json-3.1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/metrics-graphite-3.1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jackson-module-scala_2.10-2.4.4.jar:/home/jenkins/.sbt/boot/scala-2.10.4/lib/scala-reflect.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/jackson-annotations-2.4.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jsr305-2.0.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/ivy-2.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/oro-2.0.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/tachyon-client-0.6.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/tachyon-0.6.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/pyrolite-4.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/py4j-0.8.2.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/janino-2.7.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-compiler-2.7.8.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-column-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-common-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-encoding-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-generator-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-hadoop-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-format-2.3.0-incubating.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-jackson-1.7.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-metastore-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-serde-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-common-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-common-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/libthrift-0.9.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-common-secure-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/bonecp-0.8.0.RELEASE.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/derby-10.10.1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-api-jdo-3.2.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-core-3.2.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/datanucleus-rdbms-3.2.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jdo-api-3.0.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jta-1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/antlr-runtime-3.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/stringtemplate-3.2.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/antlr-2.7.7.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/libfb303-0.9.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-0.20-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-6.1.26.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/servlet-api-2.5-20081211.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-0.20S-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-shims-0.23-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-exec-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hive-ant-0.13.1a.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/ant-1.9.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/ant-launcher-1.9.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/velocity-1.5.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/parquet-hadoop-bundle-1.3.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/javolution-5.5.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/ST4-4.0.4.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/groovy-all-2.1.6.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/protobuf-java-2.5.0-spark.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/JavaEWAH-0.3.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/snappy-0.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/json-20090211.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/stax-api-1.0.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/avro-mapred-1.7.7-hadoop2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/avro-ipc-1.7.7-tests.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/avro-ipc-1.7.7.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/akka-testkit_2.10-2.3.11.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-java-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-chrome-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-remote-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/cglib-nodep-2.1_3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-api-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-exec-1.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jna-3.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/platform-3.4.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-htmlunit-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/htmlunit-2.14.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/xalan-2.7.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/serializer-2.7.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/xml-apis-1.4.01.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/httpmime-4.3.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/commons-codec-1.9.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/htmlunit-core-js-2.14.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/xercesImpl-2.11.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/nekohtml-1.9.20.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/cssparser-0.9.13.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/sac-1.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/jetty-websocket-8.1.14.v20131031.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-firefox-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-ie-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-safari-driver-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/webbit-0.4.14.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/selenium-support-2.42.2.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/mockito-all-1.9.5.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/scalacheck_2.10-1.11.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/test-interface-1.0.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/junit-4.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hamcrest-core-1.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/hamcrest-library-1.3.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/junit-interface-0.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/junit-dep-4.10.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/test-interface-0.5.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/bundles/scalatest_2.10-2.2.1.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/h2-1.4.183.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/mysql-connector-java-5.1.34.jar:/home/jenkins/workspace/Spark-Master-SBT/AMPLAB_JENKINS_BUILD_PROFILE/hadoop1.0/label/centos/lib_managed/jars/postgresql-9.3-1102-jdbc41.jar"
> "-Xms512M" "-Xmx512M" "-Dspark.driver.port=38230" "-XX:MaxPermSize=128m"
> "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url"
> "akka.tcp://[email protected]:38230/user/CoarseGrainedScheduler"
> "--executor-id" "2" "--hostname" "192.168.10.24" "--cores" "1" "--app-id"
> "app-20150624182313-0000" "--worker-url"
> "akka.tcp://[email protected]:47283/user/Worker"
> err> 15/06/24 18:24:06 INFO Worker: Executor app-20150624182313-0000/0
> finished with state EXITED message Command exited with code 143 exitStatus 143
> err> 15/06/24 18:24:06 INFO SparkContext: Invoking stop() from shutdown hook
> err> 15/06/24 18:24:06 ERROR TaskSchedulerImpl: Lost executor 0 on
> 192.168.10.24: remote Rpc client disassociated
> err> 15/06/24 18:24:06 WARN ReliableDeliverySupervisor: Association with
> remote system [akka.tcp://[email protected]:35910] has failed,
> address is now gated for [5000] ms. Reason: [Disassociated]
> err> 15/06/24 18:24:06 WARN ReliableDeliverySupervisor: Association with
> remote system [akka.tcp://[email protected]:35910] has failed,
> address is now gated for [5000] ms. Reason: [Disassociated]
> err> 15/06/24 18:24:06 INFO DAGScheduler: Executor lost: 0 (epoch 4)
> err> 15/06/24 18:24:06 INFO BlockManagerMasterEndpoint: Trying to remove
> executor 0 from BlockManagerMaster.
> err> 15/06/24 18:24:06 INFO BlockManagerMasterEndpoint: Removing block
> manager BlockManagerId(0, 192.168.10.24, 43624)
> err> 15/06/24 18:24:06 INFO BlockManagerMaster: Removed 0 successfully in
> removeExecutor
> err> 15/06/24 18:24:06 INFO Master: Removing executor
> app-20150624182313-0000/0 because it is EXITED
> err> 15/06/24 18:24:06 INFO Master: Launching executor
> app-20150624182313-0000/3 on worker worker-20150624182313-192.168.10.24-56784
> err> 15/06/24 18:24:06 INFO AppClient$ClientActor: Executor updated:
> app-20150624182313-0000/0 is now LOADING (Worker shutting down)
> err> 15/06/24 18:24:06 INFO Worker: Asked to launch executor
> app-20150624182313-0000/3 for SparkSubmitClassLoaderTest
> err> 15/06/24 18:24:06 INFO AppClient$ClientActor: Executor updated:
> app-20150624182313-0000/0 is now EXITED (Command exited with code 143)
> err> 15/06/24 18:24:06 INFO SparkDeploySchedulerBackend: Executor
> app-20150624182313-0000/0 removed: Command exited with code 143
> err> 15/06/24 18:24:06 INFO SecurityManager: Changing view acls to: jenkins
> err> 15/06/24 18:24:06 INFO SecurityManager: Changing modify acls to: jenkins
> err> 15/06/24 18:24:06 INFO SecurityManager: SecurityManager: authentication
> disabled; ui acls disabled; users with view permissions: Set(jenkins); users
> with modify permissions: Set(jenkins)
> err> 15/06/24 18:24:06 ERROR SparkDeploySchedulerBackend: Asked to remove
> non-existent executor 0
> err> 15/06/24 18:24:06 INFO AppClient$ClientActor: Executor added:
> app-20150624182313-0000/3 on worker-20150624182313-192.168.10.24-56784
> (192.168.10.24:56784) with 1 cores
> err> 15/06/24 18:24:06 INFO SparkDeploySchedulerBackend: Granted executor ID
> app-20150624182313-0000/3 on hostPort 192.168.10.24:56784 with 1 cores, 512.0
> MB RAM
> err> 15/06/24 18:24:06 INFO AppClient$ClientActor: Executor updated:
> app-20150624182313-0000/3 is now RUNNING
> err> 15/06/24 18:24:06 INFO ExecutorRunner: Launch command:
> "/usr/java/latest/bin/java" "-cp"
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
