Hi!
I am trying to run a small test giraph job and I'm getting the following
error:
2014-09-26 11:16:42,099 ERROR [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList:
Missing chosen workers [Worker(hostname=pc059946, MRtaskID=1,
port=30001)] on superstep -1
2014-09-26 11:16:42,099 ERROR [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.MasterThread: masterThread: Master algorithm
failed with IllegalStateException
java.lang.IllegalStateException: coordinateEdgeInputSplits: Worker
failed during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1470)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1632)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-09-26 11:16:42,099 FATAL [org.apache.giraph.master.MasterThread]
org.apache.giraph.graph.GraphTaskManager: uncaughtException:
OverrideExceptionHandler on thread
org.apache.giraph.master.MasterThread, msg =
java.lang.IllegalStateException: coordinateEdgeInputSplits: Worker
failed during input split (currently not supported), exiting...
java.lang.IllegalStateException: java.lang.IllegalStateException:
coordinateEdgeInputSplits: Worker failed during input split (currently
not supported)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:194)
Caused by: java.lang.IllegalStateException: coordinateEdgeInputSplits:
Worker failed during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1470)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1632)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-09-26 11:16:42,099 WARN [org.apache.giraph.master.MasterThread]
org.apache.giraph.zk.ZooKeeperManager: logZooKeeperOutput: Dumping up
to last 100 lines of the ZooKeeper process STDOUT and STDERR.
I am using a single-node setup with giraph-1.1.0-SNAPSHOT and hadoop
2.2.0 on ubuntu 14.04.
I have also tried hadoop 1.2.1, but I get the exact same behavior. The
input is very small and only contains 10 edges.
I am also attaching the full mapper logs.
The weird thing is that, with the exact same setup and configuration
files, the job runs fine on my laptop, also ubuntu 14.04 and the same
giraph/hadoop versions.
Any idea what might be wrong?
Thank you!
Cheers,
Vasia.
2014-09-26 11:16:36,699 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:36,700 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:36,721 WARN [main] org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2014-09-26 11:16:36,834 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2014-09-26 11:16:36,872 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at
10 second(s).
2014-09-26 11:16:36,872 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
started
2014-09-26 11:16:36,878 INFO [main] org.apache.hadoop.mapred.YarnChild:
Executing with tokens:
2014-09-26 11:16:36,878 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind:
mapreduce.job, Service: job_1411721785834_0003, Ident:
(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@6dae9680)
2014-09-26 11:16:36,915 INFO [main] org.apache.hadoop.mapred.YarnChild:
Sleeping for 0ms before retrying again. Got null now.
2014-09-26 11:16:37,100 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:37,101 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:37,137 INFO [main] org.apache.hadoop.mapred.YarnChild:
mapreduce.cluster.local.dir for child:
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003
2014-09-26 11:16:37,192 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:37,192 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:37,213 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
2014-09-26 11:16:37,213 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.is.map is
deprecated. Instead, use mapreduce.task.ismap
2014-09-26 11:16:37,213 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.tip.id is deprecated.
Instead, use mapreduce.task.id
2014-09-26 11:16:37,213 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is
deprecated. Instead, use mapreduce.task.partition
2014-09-26 11:16:37,214 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.local.dir is
deprecated. Instead, use mapreduce.cluster.local.dir
2014-09-26 11:16:37,214 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: job.local.dir is deprecated.
Instead, use mapreduce.job.local.dir
2014-09-26 11:16:37,214 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.job.id is deprecated.
Instead, use mapreduce.job.id
2014-09-26 11:16:37,325 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated.
Instead, use dfs.metrics.session-id
2014-09-26 11:16:37,549 INFO [main] org.apache.hadoop.mapred.Task: Using
ResourceCalculatorProcessTree : [ ]
2014-09-26 11:16:37,680 INFO [main] org.apache.hadoop.mapred.MapTask:
Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1
2014-09-26 11:16:37,694 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Log level remains at info
2014-09-26 11:16:37,735 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
_bsp/_defaultZkManagerDir/job_1411721785834_0003
2014-09-26 11:16:37,742 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_zkServer
2014-09-26 11:16:37,750 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Creating my filestamp
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_task/pc059946 0
2014-09-26 11:16:37,783 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: Got [pc059946] 1 hosts from 1 candidates when 1
required (polling period is 3000) on attempt 0
2014-09-26 11:16:37,783 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createZooKeeperServerList: Creating the final ZooKeeper file
'_bsp/_defaultZkManagerDir/job_1411721785834_0003/zkServerList_pc059946 0 '
2014-09-26 11:16:37,802 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: For task 0, got file 'zkServerList_pc059946 0 '
(polling period is 3000)
2014-09-26 11:16:37,802 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: Found [pc059946, 0] 2 hosts in filename
'zkServerList_pc059946 0 '
2014-09-26 11:16:37,803 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Trying to delete old directory
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/work/_bspZooKeeper
2014-09-26 11:16:37,805 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
generateZooKeeperConfigFile: Creating file
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/work/_bspZooKeeper/zoo.cfg
in
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/work/_bspZooKeeper
with base port 22181
2014-09-26 11:16:37,805 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
generateZooKeeperConfigFile: Make directory of _bspZooKeeper = true
2014-09-26 11:16:37,805 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
generateZooKeeperConfigFile: Delete of zoo.cfg = false
2014-09-26 11:16:37,806 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Attempting to start ZooKeeper server with command
[/usr/lib/jvm/java-7-openjdk-amd64/jre/bin/java, -cp,
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002/job.jar:/home/b.vka/workspace/hadoop-2.2.0/etc/hadoop:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jettison-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/junit-4.8.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-json-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-math-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/activation-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar,
-Xmx512m, -XX:ParallelGCThreads=4, -XX:+UseConcMarkSweepGC,
-XX:CMSInitiatingOccupancyFraction=70, -XX:MaxGCPauseMillis=100,
org.apache.zookeeper.server.quorum.QuorumPeerMain,
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/work/_bspZooKeeper/zoo.cfg]
in directory
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/work/_bspZooKeeper
2014-09-26 11:16:37,807 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Shutdown hook added.
2014-09-26 11:16:37,807 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Connect attempt 0 of 10 max trying to connect to
pc059946:22181 with poll msecs = 3000
2014-09-26 11:16:37,810 WARN [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Got ConnectException
java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at
org.apache.giraph.zk.ZooKeeperManager.onlineZooKeeperServers(ZooKeeperManager.java:736)
at
org.apache.giraph.graph.GraphTaskManager.startZooKeeperManager(GraphTaskManager.java:422)
at
org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskManager.java:220)
at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:61)
at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:91)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:339)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)
2014-09-26 11:16:40,811 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Connect attempt 1 of 10 max trying to connect to
pc059946:22181 with poll msecs = 3000
2014-09-26 11:16:40,812 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Connected to PC059946/127.0.1.1:22181!
2014-09-26 11:16:40,812 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Creating my filestamp
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_zkServer/pc059946 0
2014-09-26 11:16:40,835 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Chosen to run ZooKeeper...
2014-09-26 11:16:40,835 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Starting up BspServiceMaster (master thread)...
2014-09-26 11:16:40,852 INFO [main] org.apache.giraph.bsp.BspService:
BspService: Path to create to halt is
/_hadoopBsp/job_1411721785834_0003/_haltComputation
2014-09-26 11:16:40,852 INFO [main] org.apache.giraph.bsp.BspService:
BspService: Connecting to ZooKeeper with job job_1411721785834_0003, 0 on
pc059946:22181
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:host.name=PC059946
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_65
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002/job.jar:/home/b.vka/workspace/hadoop-2.2.0/etc/hadoop:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jettison-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/junit-4.8.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-json-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-math-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/activation-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002:/home/b.vka/workspace/hadoop-2.2.0/lib/native:/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002/tmp
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.name=Linux
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.version=3.13.0-36-generic
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.name=bvka
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.home=/home/b.vka
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000002
2014-09-26 11:16:40,857 INFO [main] org.apache.zookeeper.ZooKeeper: Initiating
client connection, connectString=pc059946:22181 sessionTimeout=60000
watcher=org.apache.giraph.master.BspServiceMaster@7ef4e077
2014-09-26 11:16:40,866 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Opening socket connection to server
PC059946/127.0.1.1:22181. Will not attempt to authenticate using SASL (unknown
error)
2014-09-26 11:16:40,866 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Socket connection established to
PC059946/127.0.1.1:22181, initiating session
2014-09-26 11:16:40,878 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Session establishment complete on server
PC059946/127.0.1.1:22181, sessionid = 0x148b13f71450000, negotiated timeout =
600000
2014-09-26 11:16:40,879 INFO [main-EventThread]
org.apache.giraph.bsp.BspService: process: Asynchronous connection complete.
2014-09-26 11:16:40,883 INFO [main] org.apache.giraph.graph.GraphTaskManager:
map: No need to do anything when not a worker
2014-09-26 11:16:40,883 INFO [main] org.apache.giraph.graph.GraphTaskManager:
cleanup: Starting for MASTER_ZOOKEEPER_ONLY
2014-09-26 11:16:40,918 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: becomeMaster: First child is
'/_hadoopBsp/job_1411721785834_0003/_masterElectionDir/pc059946_00000000000'
and my bid is
'/_hadoopBsp/job_1411721785834_0003/_masterElectionDir/pc059946_00000000000'
2014-09-26 11:16:40,956 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.comm.netty.NettyServer: NettyServer: Using execution group
with 8 threads for requestFrameDecoder.
2014-09-26 11:16:40,964 INFO [org.apache.giraph.master.MasterThread]
org.apache.hadoop.conf.Configuration.deprecation: mapred.map.tasks is
deprecated. Instead, use mapreduce.job.maps
2014-09-26 11:16:40,980 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.comm.netty.NettyServer: start: Started server communication
server: PC059946/127.0.1.1:30000 with up to 16 threads on bind attempt 0 with
sendBufferSize = 32768 receiveBufferSize = 524288
2014-09-26 11:16:40,983 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.comm.netty.NettyClient: NettyClient: Using execution handler
with 8 threads after request-encoder.
2014-09-26 11:16:40,985 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: becomeMaster: I am now the master!
2014-09-26 11:16:40,990 INFO [main-EventThread]
org.apache.giraph.bsp.BspService: process: applicationAttemptChanged signaled
2014-09-26 11:16:40,995 WARN [main-EventThread]
org.apache.giraph.bsp.BspService: process: Unknown and unprocessed event
(path=/_hadoopBsp/job_1411721785834_0003/_applicationAttemptsDir/0/_superstepDir,
type=NodeChildrenChanged, state=SyncConnected)
2014-09-26 11:16:42,014 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.io.formats.GiraphFileInputFormat: Total input paths to
process : 1
2014-09-26 11:16:42,022 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: generateEdgeInputSplits: Got 1 input
splits for 1 input threads
2014-09-26 11:16:42,022 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: createEdgeInputSplits: Starting to
write input split data to zookeeper with 1 threads
2014-09-26 11:16:42,026 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: createEdgeInputSplits: Done writing
input split data to zookeeper
2014-09-26 11:16:42,032 INFO [netty-client-worker-0]
org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication.
2014-09-26 11:16:42,036 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.comm.netty.NettyClient: connectAllAddresses: Successfully
added 1 connections, (1 total connected) 0 failed, 0 failures total.
2014-09-26 11:16:42,037 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.partition.PartitionUtils: computePartitionCount: Creating 1,
default would have been 1 partitions.
2014-09-26 11:16:42,046 INFO [org.apache.giraph.master.MasterThread]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.timeout is
deprecated. Instead, use mapreduce.task.timeout
2014-09-26 11:16:42,047 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: 0 out of 1
workers finished on superstep -1 on path
/_hadoopBsp/job_1411721785834_0003/_edgeInputSplitDoneDir
2014-09-26 11:16:42,049 INFO [netty-server-worker-0]
org.apache.giraph.comm.netty.NettyServer: start: Using Netty without
authentication.
2014-09-26 11:16:42,050 INFO [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: Waiting on
[pc059946_1]
2014-09-26 11:16:42,099 ERROR [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: Missing chosen
workers [Worker(hostname=pc059946, MRtaskID=1, port=30001)] on superstep -1
2014-09-26 11:16:42,099 ERROR [org.apache.giraph.master.MasterThread]
org.apache.giraph.master.MasterThread: masterThread: Master algorithm failed
with IllegalStateException
java.lang.IllegalStateException: coordinateEdgeInputSplits: Worker failed
during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1470)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1632)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-09-26 11:16:42,099 FATAL [org.apache.giraph.master.MasterThread]
org.apache.giraph.graph.GraphTaskManager: uncaughtException:
OverrideExceptionHandler on thread org.apache.giraph.master.MasterThread, msg =
java.lang.IllegalStateException: coordinateEdgeInputSplits: Worker failed
during input split (currently not supported), exiting...
java.lang.IllegalStateException: java.lang.IllegalStateException:
coordinateEdgeInputSplits: Worker failed during input split (currently not
supported)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:194)
Caused by: java.lang.IllegalStateException: coordinateEdgeInputSplits: Worker
failed during input split (currently not supported)
at
org.apache.giraph.master.BspServiceMaster.coordinateInputSplits(BspServiceMaster.java:1470)
at
org.apache.giraph.master.BspServiceMaster.coordinateSuperstep(BspServiceMaster.java:1632)
at org.apache.giraph.master.MasterThread.run(MasterThread.java:124)
2014-09-26 11:16:42,099 WARN [org.apache.giraph.master.MasterThread]
org.apache.giraph.zk.ZooKeeperManager: logZooKeeperOutput: Dumping up to last
100 lines of the ZooKeeper process STDOUT and STDERR.
2014-09-26 11:16:37,769 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:37,770 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:37,803 WARN [main] org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2014-09-26 11:16:37,947 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from
hadoop-metrics2.properties
2014-09-26 11:16:37,991 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at
10 second(s).
2014-09-26 11:16:37,991 INFO [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
started
2014-09-26 11:16:37,997 INFO [main] org.apache.hadoop.mapred.YarnChild:
Executing with tokens:
2014-09-26 11:16:37,997 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind:
mapreduce.job, Service: job_1411721785834_0003, Ident:
(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@6dae9680)
2014-09-26 11:16:38,039 INFO [main] org.apache.hadoop.mapred.YarnChild:
Sleeping for 0ms before retrying again. Got null now.
2014-09-26 11:16:38,218 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:38,218 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:38,266 INFO [main] org.apache.hadoop.mapred.YarnChild:
mapreduce.cluster.local.dir for child:
/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003
2014-09-26 11:16:38,332 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.retry.interval; Ignoring.
2014-09-26 11:16:38,332 WARN [main] org.apache.hadoop.conf.Configuration:
job.xml:an attempt to override final parameter:
mapreduce.job.end-notification.max.attempts; Ignoring.
2014-09-26 11:16:38,355 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
2014-09-26 11:16:38,356 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.is.map is
deprecated. Instead, use mapreduce.task.ismap
2014-09-26 11:16:38,356 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.tip.id is deprecated.
Instead, use mapreduce.task.id
2014-09-26 11:16:38,356 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is
deprecated. Instead, use mapreduce.task.partition
2014-09-26 11:16:38,357 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.local.dir is
deprecated. Instead, use mapreduce.cluster.local.dir
2014-09-26 11:16:38,357 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: job.local.dir is deprecated.
Instead, use mapreduce.job.local.dir
2014-09-26 11:16:38,358 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.job.id is deprecated.
Instead, use mapreduce.job.id
2014-09-26 11:16:38,477 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated.
Instead, use dfs.metrics.session-id
2014-09-26 11:16:38,673 INFO [main] org.apache.hadoop.mapred.Task: Using
ResourceCalculatorProcessTree : [ ]
2014-09-26 11:16:38,790 INFO [main] org.apache.hadoop.mapred.MapTask:
Processing split: 'org.apache.giraph.bsp.BspInputSplit, index=-1, num=-1
2014-09-26 11:16:38,804 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Log level remains at info
2014-09-26 11:16:38,829 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
_bsp/_defaultZkManagerDir/job_1411721785834_0003
2014-09-26 11:16:38,830 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_zkServer
2014-09-26 11:16:38,835 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Creating my filestamp
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_task/pc059946 1
2014-09-26 11:16:38,880 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: For task 1, got file 'zkServerList_pc059946 0 '
(polling period is 3000)
2014-09-26 11:16:38,880 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: Found [pc059946, 0] 2 hosts in filename
'zkServerList_pc059946 0 '
2014-09-26 11:16:38,882 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperSErvers: Empty directory
_bsp/_defaultZkManagerDir/job_1411721785834_0003/_zkServer, waiting 3000 msecs.
2014-09-26 11:16:41,883 INFO [main] org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Got [pc059946] 1 hosts from 1 ready servers when 1
required (polling period is 3000) on attempt 1
2014-09-26 11:16:41,884 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Starting up BspServiceWorker...
2014-09-26 11:16:41,899 INFO [main] org.apache.giraph.bsp.BspService:
BspService: Path to create to halt is
/_hadoopBsp/job_1411721785834_0003/_haltComputation
2014-09-26 11:16:41,899 INFO [main] org.apache.giraph.bsp.BspService:
BspService: Connecting to ZooKeeper with job job_1411721785834_0003, 1 on
pc059946:22181
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:host.name=PC059946
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_65
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/java-7-openjdk-amd64/jre
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000003:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000003/job.jar:/home/b.vka/workspace/hadoop-2.2.0/etc/hadoop:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/hadoop-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-digester-1.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsch-0.1.42.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jettison-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-net-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-compiler-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jets3t-0.6.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-collections-3.2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/junit-4.8.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-httpclient-3.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jersey-json-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-math-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-jaxrs-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-xc-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/stax-api-1.0.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/slf4j-api-1.7.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/activation-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/zookeeper-3.4.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/common/lib/hadoop-auth-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-nfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/hadoop-hdfs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsp-api-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jasper-runtime-5.5.23.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-el-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-logging-1.1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jsr305-1.3.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/hdfs/lib/commons-lang-2.5.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/yarn/lib/asm-3.2.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/b.vka/workspace/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000003:/home/b.vka/workspace/hadoop-2.2.0/lib/native:/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000003/tmp
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.name=Linux
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:os.version=3.13.0-36-generic
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.name=bvka
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.home=/home/b.vka
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=/tmp/hadoop-bvka/nm-local-dir/usercache/bvka/appcache/application_1411721785834_0003/container_1411721785834_0003_01_000003
2014-09-26 11:16:41,904 INFO [main] org.apache.zookeeper.ZooKeeper: Initiating
client connection, connectString=pc059946:22181 sessionTimeout=60000
watcher=org.apache.giraph.worker.BspServiceWorker@6b547bae
2014-09-26 11:16:41,915 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Opening socket connection to server
PC059946/127.0.1.1:22181. Will not attempt to authenticate using SASL (unknown
error)
2014-09-26 11:16:41,915 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Socket connection established to
PC059946/127.0.1.1:22181, initiating session
2014-09-26 11:16:41,919 INFO [main-SendThread(PC059946:22181)]
org.apache.zookeeper.ClientCnxn: Session establishment complete on server
PC059946/127.0.1.1:22181, sessionid = 0x148b13f71450001, negotiated timeout =
600000
2014-09-26 11:16:41,920 INFO [main-EventThread]
org.apache.giraph.bsp.BspService: process: Asynchronous connection complete.
2014-09-26 11:16:41,957 INFO [main] org.apache.giraph.comm.netty.NettyServer:
NettyServer: Using execution group with 8 threads for requestFrameDecoder.
2014-09-26 11:16:41,965 INFO [main]
org.apache.hadoop.conf.Configuration.deprecation: mapred.map.tasks is
deprecated. Instead, use mapreduce.job.maps
2014-09-26 11:16:41,982 INFO [main] org.apache.giraph.comm.netty.NettyServer:
start: Started server communication server: PC059946/127.0.1.1:30001 with up to
16 threads on bind attempt 0 with sendBufferSize = 32768 receiveBufferSize =
524288
2014-09-26 11:16:41,984 INFO [main] org.apache.giraph.comm.netty.NettyClient:
NettyClient: Using execution handler with 8 threads after request-encoder.
2014-09-26 11:16:41,989 INFO [main] org.apache.giraph.graph.GraphTaskManager:
setup: Registering health of this worker...
2014-09-26 11:16:41,996 INFO [main] org.apache.giraph.bsp.BspService:
getJobState: Job state already exists
(/_hadoopBsp/job_1411721785834_0003/_masterJobState)
2014-09-26 11:16:41,998 INFO [main] org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_1411721785834_0003/_applicationAttemptsDir already exists!
2014-09-26 11:16:42,000 INFO [main] org.apache.giraph.bsp.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_1411721785834_0003/_applicationAttemptsDir already exists!
2014-09-26 11:16:42,002 INFO [main] org.apache.giraph.worker.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=-1 with
/_hadoopBsp/job_1411721785834_0003/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/pc059946_1
and workerInfo= Worker(hostname=pc059946, MRtaskID=1, port=30001)
2014-09-26 11:16:42,037 INFO [netty-server-worker-0]
org.apache.giraph.comm.netty.NettyServer: start: Using Netty without
authentication.
2014-09-26 11:16:42,040 INFO [main-EventThread]
org.apache.giraph.bsp.BspService: process: partitionAssignmentsReadyChanged
(partitions are assigned)
2014-09-26 11:16:42,043 INFO [main] org.apache.giraph.worker.BspServiceWorker:
startSuperstep: Master(hostname=pc059946, MRtaskID=0, port=30000)
2014-09-26 11:16:42,043 INFO [main] org.apache.giraph.worker.BspServiceWorker:
startSuperstep: Ready for computation on superstep -1 since worker selection
and vertex range assignments are done in
/_hadoopBsp/job_1411721785834_0003/_applicationAttemptsDir/0/_superstepDir/-1/_addressesAndPartitions
2014-09-26 11:16:42,045 INFO [netty-client-worker-0]
org.apache.giraph.comm.netty.NettyClient: Using Netty without authentication.
2014-09-26 11:16:42,048 INFO [main] org.apache.giraph.comm.netty.NettyClient:
connectAllAddresses: Successfully added 1 connections, (1 total connected) 0
failed, 0 failures total.
2014-09-26 11:16:42,059 INFO [netty-server-worker-0]
org.apache.giraph.comm.netty.handler.RequestDecoder: decode: Server window
metrics MBytes/sec received = 0, MBytesReceived = 0.0001, ave received req
MBytes = 0.0001, secs waited = 1.41172301E9
2014-09-26 11:16:42,066 INFO [main] org.apache.giraph.worker.BspServiceWorker:
loadInputSplits: Using 1 thread(s), originally 1 threads(s) for 1 total splits.
2014-09-26 11:16:42,072 INFO [load-0]
org.apache.giraph.worker.InputSplitsHandler: reserveInputSplit: Reserved input
split path /_hadoopBsp/job_1411721785834_0003/_edgeInputSplitDir/0, overall
roughly 0.0% input splits reserved
2014-09-26 11:16:42,073 INFO [load-0]
org.apache.giraph.worker.InputSplitsCallable: getInputSplit: Reserved
/_hadoopBsp/job_1411721785834_0003/_edgeInputSplitDir/0 from ZooKeeper and got
input split 'hdfs://localhost:9000/user/edges.test:0+80'
2014-09-26 11:16:42,090 INFO [load-0]
org.apache.giraph.worker.InputSplitsCallable: loadFromInputSplit: Finished
loading /_hadoopBsp/job_1411721785834_0003/_edgeInputSplitDir/0 (v=0, e=10)
2014-09-26 11:16:42,092 INFO [load-0]
org.apache.giraph.worker.InputSplitsCallable: call: Loaded 1 input splits in
0.025486704 secs, (v=0, e=10) 0.0 vertices/sec, 392.36145 edges/sec
2014-09-26 11:16:42,097 INFO [main] org.apache.giraph.comm.netty.NettyClient:
waitAllRequests: Finished all requests. MBytes/sec received = 0, MBytesReceived
= 0, ave received req MBytes = 0, secs waited = 1.41172301E9
MBytes/sec sent = 0, MBytesSent = 0, ave sent req MBytes = 0, secs waited =
1.41172301E9
2014-09-26 11:16:42,097 INFO [main] org.apache.giraph.worker.BspServiceWorker:
setup: Finally loaded a total of (v=0, e=10)
