[
https://issues.apache.org/jira/browse/GIRAPH-169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240285#comment-13240285
]
Jianfeng Qian commented on GIRAPH-169:
--------------------------------------
hadoop 0.20.205.0. most of the time, the worker can't quit.
sorry, there is the full worker log
2012-03-28 10:18:00,122 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to
load native-hadoop library for your platform... using builtin-java classes
where applicable
2012-03-28 10:18:00,387 WARN org.apache.giraph.bsp.BspOutputFormat:
getOutputCommitter: Returning ImmutableOutputCommiter (does nothing).
2012-03-28 10:18:00,397 INFO org.apache.hadoop.util.ProcessTree: setsid exited
with exit code 0
2012-03-28 10:18:00,405 INFO org.apache.hadoop.mapred.Task: Using
ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@18330bf
2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: Distributed
cache is empty. Assuming fatjar.
2012-03-28 10:18:00,489 INFO org.apache.giraph.graph.GraphMapper: setup:
classpath @
/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars/job.jar
2012-03-28 10:18:00,498 INFO org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Made the directory
_bsp/_defaultZkManagerDir/job_201203281017_0001
2012-03-28 10:18:00,500 INFO org.apache.giraph.zk.ZooKeeperManager:
createCandidateStamp: Creating my filestamp
_bsp/_defaultZkManagerDir/job_201203281017_0001/_task/tmm-e6 1
2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: For task 1, got file 'zkServerList_tmm-e10 0 ' (polling
period is 3000)
2012-03-28 10:18:00,521 INFO org.apache.giraph.zk.ZooKeeperManager:
getZooKeeperServerList: Found [tmm-e10, 0] 2 hosts in filename
'zkServerList_tmm-e10 0 '
2012-03-28 10:18:00,524 INFO org.apache.giraph.zk.ZooKeeperManager:
onlineZooKeeperServers: Got [tmm-e10] 1 hosts from 1 ready servers when 1
required (polling period is 3000) on attempt 0
2012-03-28 10:18:00,524 INFO org.apache.giraph.graph.GraphMapper: setup:
Starting up BspServiceWorker...
2012-03-28 10:18:00,534 INFO org.apache.giraph.graph.BspService: BspService:
Connecting to ZooKeeper with job job_201203281017_0001, 1 on tmm-e10:22181
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.3.3-1073969, built on 02/23/2011 22:27 GMT
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:host.name=tmm-e6
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.version=1.6.0_22
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.vendor=Sun Microsystems Inc.
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.home=/usr/local/java/jdk1.6.0_22/jre
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.class.path=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars/classes:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/jars:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../conf:/usr/local/java/jdk1.6.0_22/lib/tools.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/hadoop-core-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/asm-3.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/aspectjrt-1.6.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/aspectjtools-1.6.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-cli-1.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-codec-1.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-collections-3.2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-configuration-1.6.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-daemon-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-digester-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-el-1.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-lang-2.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-logging-1.1.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-math-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/commons-net-1.4.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/core-3.1.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-capacity-scheduler-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-fairscheduler-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hadoop-thriftfs-0.20.205.0.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jackson-core-asl-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jackson-mapper-asl-1.0.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jdeb-0.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-core-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-json-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jersey-server-1.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jets3t-0.6.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jetty-6.1.26.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jetty-util-6.1.26.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsch-0.1.42.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/junit-4.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/kfs-0.2.2.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/log4j-1.2.15.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/mockito-all-1.8.5.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/oro-2.0.8.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-api-1.4.3.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/xmlenc-0.52.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/local/test-0302/hadoop-0.20.205.0/libexec/../share/hadoop/lib/jsp-2.1/jsp-api-2.1.jar
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/local/test-0302/hadoop-0.20.205.0/libexec/../lib:/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work/tmp
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.name=Linux
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.arch=amd64
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:os.version=2.6.32.12-0.7-default
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.name=root
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.home=/root
2012-03-28 10:18:00,540 INFO org.apache.zookeeper.ZooKeeper: Client
environment:user.dir=/usr/local/test-0302/hadoop-data/h-0.20.205/mapred/local/taskTracker/root/jobcache/job_201203281017_0001/attempt_201203281017_0001_m_000001_0/work
2012-03-28 10:18:00,541 INFO org.apache.zookeeper.ZooKeeper: Initiating client
connection, connectString=tmm-e10:22181 sessionTimeout=60000
watcher=org.apache.giraph.graph.BspServiceWorker@4cdada24
2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Opening socket
connection to server tmm-e10/2.1.1.130:22181
2012-03-28 10:18:00,552 INFO org.apache.zookeeper.ClientCnxn: Socket connection
established to tmm-e10/2.1.1.130:22181, initiating session
2012-03-28 10:18:01,045 INFO org.apache.zookeeper.ClientCnxn: Session
establishment complete on server tmm-e10/2.1.1.130:22181, sessionid =
0x1365720ee4e0001, negotiated timeout = 300000
2012-03-28 10:18:01,046 INFO org.apache.giraph.graph.BspService: process:
Asynchronous connection complete.
2012-03-28 10:18:01,370 INFO org.apache.giraph.comm.RPCCommunications:
getRPCServer: Added jobToken Ident: 15 6a 6f 62 5f 32 30 31 32 30 33 32 38 31
30 31 37 5f 30 30 30 31, Pass: 19 3a 73 94 ac b2 04 7e fb 06 a6 18 d8 3a 54 11
e2 15 42 64, Kind: mapreduce.job, Service: job_201203281017_0001
2012-03-28 10:18:01,375 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2012-03-28 10:18:01,380 INFO org.apache.hadoop.ipc.Server: IPC Server listener
on 30001: starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0
on 30001: starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1
on 30001: starting
2012-03-28 10:18:01,381 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2
on 30001: starting
2012-03-28 10:18:01,382 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3
on 30001: starting
..........................
2012-03-28 10:18:01,388 INFO org.apache.hadoop.ipc.Server: IPC Server handler
64 on 30001: starting
2012-03-28 10:18:01,388 INFO org.apache.giraph.comm.BasicRPCCommunications:
BasicRPCCommunications: Started RPC communication server:
tmm-e6/2.1.1.126:30001 with 65 handlers and 63 flush threads on bind attempt 0
2012-03-28 10:18:01,388 INFO org.apache.giraph.graph.GraphMapper: setup:
Registering health of this worker...
2012-03-28 10:18:01,408 INFO org.apache.giraph.graph.BspService: getJobState:
Job state already exists (/_hadoopBsp/job_201203281017_0001/_masterJobState)
2012-03-28 10:18:01,421 INFO org.apache.giraph.graph.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir already exists!
2012-03-28 10:18:01,427 INFO org.apache.giraph.graph.BspService:
getApplicationAttempt: Node
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir already exists!
2012-03-28 10:18:01,494 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=-1 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/-1/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:21,970 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)
2012-03-28 10:18:22,093 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep -1 since worker selection
and vertex range assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/-1/_partitionAssignments
2012-03-28 10:18:22,637 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/34/_inputSplitReserved
2012-03-28 10:18:22,709 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/39/_inputSplitReserved
2012-03-28 10:18:22,783 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/37/_inputSplitReserved
2012-03-28 10:18:22,818 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/38/_inputSplitReserved
2012-03-28 10:18:22,896 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/43/_inputSplitReserved
2012-03-28 10:18:22,957 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/42/_inputSplitReserved
2012-03-28 10:18:22,980 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/41/_inputSplitReserved
2012-03-28 10:18:23,053 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/40/_inputSplitReserved
2012-03-28 10:18:23,083 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/22/_inputSplitReserved
2012-03-28 10:18:23,165 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/23/_inputSplitReserved
2012-03-28 10:18:23,233 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Couldn't reserve (already reserved) inputSplit at
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/24/_inputSplitReserved
2012-03-28 10:18:23,340 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Reserved input split path
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/25, overall roughly 0.0% input
splits finished
2012-03-28 10:18:23,357 INFO org.apache.giraph.graph.BspServiceWorker:
getInputSplitForVertices: Reserved
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/25 from ZooKeeper and got
input split ''org.apache.giraph.bsp.BspInputSplit, index=25, num=64'
2012-03-28 10:18:23,914 INFO org.apache.giraph.graph.BspServiceWorker:
loadVerticesFromInputSplit: Finished loading
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/25 (v=15625, e=250000)
2012-03-28 10:18:25,192 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: Reserved input split path
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/50, overall roughly 34.375%
input splits finished
2012-03-28 10:18:25,198 INFO org.apache.giraph.graph.BspServiceWorker:
getInputSplitForVertices: Reserved
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/50 from ZooKeeper and got
input split ''org.apache.giraph.bsp.BspInputSplit, index=50, num=64'
2012-03-28 10:18:25,402 INFO org.apache.giraph.graph.BspServiceWorker:
loadVerticesFromInputSplit: Finished loading
/_hadoopBsp/job_201203281017_0001/_inputSplitDir/50 (v=15625, e=250000)
2012-03-28 10:18:25,623 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: reservedPath = null, 62 of 64 InputSplits are finished.
2012-03-28 10:18:25,760 INFO org.apache.giraph.graph.BspServiceWorker:
reserveInputSplit: reservedPath = null, 64 of 64 InputSplits are finished.
2012-03-28 10:18:32,009 INFO org.apache.giraph.graph.BspServiceWorker: setup:
Finally loaded a total of (v=31250, e=500000)
2012-03-28 10:18:32,040 INFO org.apache.giraph.graph.BspService: process:
inputSplitsAllDoneChanged (all vertices sent from input splits)
2012-03-28 10:18:32,226 INFO org.apache.giraph.graph.BspServiceWorker:
moveVerticesToWorker: Adding 334 vertices for partition id 1582
.......................................
2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker:
moveVerticesToWorker: Adding 334 vertices for partition id 302
2012-03-28 10:18:32,236 INFO org.apache.giraph.graph.BspServiceWorker:
moveVerticesToWorker: Adding 334 vertices for partition id 1454
2012-03-28 10:18:32,249 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep -1 totalMem = 301.125M, maxMem = 1777.8125M,
freeMem = 139.03758M
2012-03-28 10:18:32,265 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: ended for superstep -1 totalMem = 301.125M, maxMem = 1777.8125M, freeMem
= 139.02933M
2012-03-28 10:18:32,266 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep -1 totalMem = 301.125M, maxMem = 1777.8125M, freeMem
= 139.02933M
2012-03-28 10:18:32,455 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled
2012-03-28 10:18:32,458 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep -1 with global stats
(vtx=1000000,finVtx=0,edges=16000000,msgCount=0)
2012-03-28 10:18:32,458 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 0 totalMem = 301.125M, maxMem = 1777.8125M, freeMem
= 139.02928M
2012-03-28 10:18:32,649 WARN org.apache.giraph.graph.BspService: process:
Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir,
type=NodeChildrenChanged, state=SyncConnected)
2012-03-28 10:18:32,742 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=0 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:32,848 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)
2012-03-28 10:18:32,916 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 0 since worker selection and
vertex range assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_partitionAssignments
2012-03-28 10:18:33,004 INFO org.apache.giraph.graph.BspServiceWorker:
sendWorkerPartitions: Done sending all my partitions.
2012-03-28 10:18:33,010 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:18:34,115 INFO org.apache.giraph.graph.BspServiceWorker:
storeCheckpoint: Finished metadata
(_bsp/_checkpoints/job_201203281017_0001/0.tmm-e6_1.metadata) and vertices
(_bsp/_checkpoints/job_201203281017_0001/0.tmm-e6_1.vertices).
2012-03-28 10:18:35,127 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 0 totalMem = 448.125M, maxMem = 1777.8125M,
freeMem = 293.0052M
2012-03-28 10:18:37,939 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: ended for superstep 0 totalMem = 449.75M, maxMem = 1777.8125M, freeMem =
324.476M
2012-03-28 10:18:37,939 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep 0 totalMem = 449.75M, maxMem = 1777.8125M, freeMem =
324.476M
2012-03-28 10:18:38,350 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled
2012-03-28 10:18:38,381 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep 0 with global stats
(vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:38,382 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 1 totalMem = 449.75M, maxMem = 1777.8125M, freeMem
= 318.8769M
2012-03-28 10:18:38,702 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=1 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:39,026 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)
2012-03-28 10:18:39,135 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 1 since worker selection and
vertex range assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_partitionAssignments
2012-03-28 10:18:39,152 INFO org.apache.giraph.graph.BspServiceWorker:
getAggregatorValues: no aggregators in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_mergedAggregatorDir
on superstep 1
2012-03-28 10:18:39,268 INFO org.apache.giraph.graph.BspServiceWorker:
sendWorkerPartitions: Done sending all my partitions.
2012-03-28 10:18:39,324 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:18:40,042 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 1 totalMem = 449.75M, maxMem = 1777.8125M,
freeMem = 205.70113M
2012-03-28 10:18:42,148 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: ended for superstep 1 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem
= 430.8365M
2012-03-28 10:18:42,148 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep 1 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem
= 430.8365M
2012-03-28 10:18:42,625 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled
2012-03-28 10:18:42,681 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep 1 with global stats
(vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:42,682 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M,
freeMem = 424.08615M
2012-03-28 10:18:42,733 WARN org.apache.giraph.graph.BspService: process:
Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:42,882 INFO org.apache.giraph.graph.BspServiceWorker:
registerHealth: Created my health node for attempt=0, superstep=2 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:43,429 INFO org.apache.giraph.graph.BspServiceWorker:
processEvent : partitionExchangeChildrenChanged (at least one worker is done
sending partitions)
2012-03-28 10:18:43,885 WARN org.apache.giraph.graph.BspService: process:
Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/0/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:44,458 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)
2012-03-28 10:18:44,527 INFO org.apache.giraph.graph.BspServiceWorker:
startSuperstep: Ready for computation on superstep 2 since worker selection and
vertex range assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_partitionAssignments
2012-03-28 10:18:44,653 INFO org.apache.giraph.graph.BspServiceWorker:
getAggregatorValues: no aggregators in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_mergedAggregatorDir
on superstep 2
2012-03-28 10:18:44,778 INFO org.apache.giraph.graph.BspServiceWorker:
sendWorkerPartitions: Done sending all my partitions.
2012-03-28 10:18:44,793 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:18:45,295 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M,
freeMem = 344.8612M
2012-03-28 10:18:47,269 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: ended for superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem
= 154.54968M
2012-03-28 10:18:47,433 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep 2 totalMem = 683.1875M, maxMem = 1777.8125M, freeMem
= 142.03284M
2012-03-28 10:18:47,955 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled
2012-03-28 10:18:47,968 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep 2 with global stats
(vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:47,969 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 3 totalMem = 683.1875M, maxMem = 1777.8125M,
freeMem = 133.7648M
2012-03-28 10:18:47,988 WARN org.apache.giraph.graph.BspService: process:
Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:48,327 INFO
org.apache.giraph.graph.BspServiceWorker: registerHealth: Created my health
node for attempt=0, superstep=3 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)2012-03-28
10:18:48,735 INFO org.apache.giraph.graph.BspServiceWorker: processEvent :
partitionExchangeChildrenChanged (at least one worker is done sending
partitions)2012-03-28 10:18:49,186 WARN org.apache.giraph.graph.BspService:
process: Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/1/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:49,709 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)2012-03-28
10:18:49,766 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep:
Ready for computation on superstep 3 since worker selection and vertex range
assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_partitionAssignments2012-03-28
10:18:49,831 INFO org.apache.giraph.graph.BspServiceWorker:
getAggregatorValues: no aggregators in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_mergedAggregatorDir
on superstep 3
2012-03-28 10:18:49,890 INFO org.apache.giraph.graph.BspServiceWorker:
sendWorkerPartitions: Done sending all my partitions.
2012-03-28 10:18:49,927 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:18:49,937 INFO org.apache.giraph.graph.BspServiceWorker:
processEvent : partitionExchangeChildrenChanged (at least one worker is done
sending partitions)
2012-03-28 10:18:50,701 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 3 totalMem = 704.125M, maxMem = 1777.8125M,
freeMem = 540.77454M2012-03-28 10:18:52,680 INFO
org.apache.giraph.comm.BasicRPCCommunications: flush: ended for superstep 3
totalMem = 704.125M, maxMem = 1777.8125M, freeMem = 326.51126M
2012-03-28 10:18:52,680 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep 3 totalMem = 704.125M, maxMem = 1777.8125M, freeMem
= 326.51126M
2012-03-28 10:18:52,951 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled2012-03-28 10:18:52,960 INFO
org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed superstep
3 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:52,960 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 4 totalMem = 704.125M, maxMem = 1777.8125M, freeMem
= 325.5547M2012-03-28 10:18:52,997 WARN org.apache.giraph.graph.BspService:
process: Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:53,329 INFO
org.apache.giraph.graph.BspServiceWorker: registerHealth: Created my health
node for attempt=0, superstep=4 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)
2012-03-28 10:18:53,755 INFO org.apache.giraph.graph.BspServiceWorker:
processEvent : partitionExchangeChildrenChanged (at least one worker is done
sending partitions)2012-03-28 10:18:54,245 WARN
org.apache.giraph.graph.BspService: process: Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/2/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:54,781 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)2012-03-28
10:18:54,833 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep:
Ready for computation on superstep 4 since worker selection and vertex range
assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_partitionAssignments2012-03-28
10:18:54,876 INFO org.apache.giraph.graph.BspServiceWorker:
getAggregatorValues: no aggregators in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_mergedAggregatorDir
on superstep 42012-03-28 10:18:54,976 INFO
org.apache.giraph.graph.BspServiceWorker: sendWorkerPartitions: Done sending
all my partitions.
2012-03-28 10:18:54,988 INFO org.apache.giraph.graph.BspServiceWorker:
exchangeVertexPartitions: Done with exchange.
2012-03-28 10:18:55,682 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 4 totalMem = 704.125M, maxMem = 1777.8125M,
freeMem = 232.67145M2012-03-28 10:18:57,644 INFO
org.apache.giraph.comm.BasicRPCCommunications: flush: ended for superstep 4
totalMem = 768.5625M, maxMem = 1777.8125M, freeMem = 563.79004M
2012-03-28 10:18:57,645 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Superstep 4 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem
= 563.79004M
2012-03-28 10:18:57,994 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled2012-03-28 10:18:58,004 INFO
org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Completed superstep
4 with global stats (vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:58,004 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep 4 with global stats
(vtx=1000000,finVtx=0,edges=16000000,msgCount=748805328)
2012-03-28 10:18:58,004 INFO org.apache.giraph.comm.BasicRPCCommunications:
prepareSuperstep: Superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M,
freeMem = 552.1009M2012-03-28 10:18:58,035 WARN
org.apache.giraph.graph.BspService: process: Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)2012-03-28 10:18:58,361 INFO
org.apache.giraph.graph.BspServiceWorker: registerHealth: Created my health
node for attempt=0, superstep=5 with
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/5/_workerHealthyDir/tmm-e6_1
and workerInfo= Worker(hostname=tmm-e6, MRpartition=1, port=30001)2012-03-28
10:18:59,261 WARN org.apache.giraph.graph.BspService: process: Unknown and
unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/3/_superstepFinished,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:18:59,834 INFO org.apache.giraph.graph.BspService: process:
partitionAssignmentsReadyChanged (partitions are assigned)2012-03-28
10:18:59,881 INFO org.apache.giraph.graph.BspServiceWorker: startSuperstep:
Ready for computation on superstep 5 since worker selection and vertex range
assignments are done in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/5/_partitionAssignments2012-03-28
10:18:59,979 INFO org.apache.giraph.graph.BspServiceWorker:
getAggregatorValues: no aggregators in
/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_mergedAggregatorDir
on superstep 5
2012-03-28 10:19:00,076 INFO org.apache.giraph.graph.BspServiceWorker:
sendWorkerPartitions: Done sending all my partitions.2012-03-28 10:19:00,113
INFO org.apache.giraph.graph.BspServiceWorker: exchangeVertexPartitions: Done
with exchange.
2012-03-28 10:19:00,153 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: starting for superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M,
freeMem = 536.97296M
2012-03-28 10:19:00,154 INFO org.apache.giraph.comm.BasicRPCCommunications:
flush: ended for superstep 5 totalMem = 768.5625M, maxMem = 1777.8125M, freeMem
= 536.9681M2012-03-28 10:19:00,155 INFO
org.apache.giraph.graph.BspServiceWorker: finishSuperstep: Superstep 5 totalMem
= 768.5625M, maxMem = 1777.8125M, freeMem = 536.9675M
2012-03-28 10:19:00,270 INFO org.apache.giraph.graph.BspService: process:
superstepFinished signaled
2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.BspServiceWorker:
finishSuperstep: Completed superstep 5 with global stats
(vtx=1000000,finVtx=1000000,edges=16000000,msgCount=0)2012-03-28 10:19:00,282
INFO org.apache.giraph.graph.GraphMapper: map: BSP application done (global
vertices marked done)
2012-03-28 10:19:00,282 INFO org.apache.giraph.graph.GraphMapper: cleanup:
Starting for WORKER_ONLY2012-03-28 10:19:00,283 WARN
org.apache.giraph.graph.BspServiceWorker: saveVertices:
giraph.vertexOutputFormatClass not specified -- there will be no saved
output2012-03-28 10:19:00,329 WARN org.apache.giraph.graph.BspService: process:
Unknown and unprocessed event
(path=/_hadoopBsp/job_201203281017_0001/_applicationAttemptsDir/0/_superstepDir/4/_partitionAssignments,
type=NodeDeleted, state=SyncConnected)
2012-03-28 10:19:00,534 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,535 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,537 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,538 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,539 INFO org.apache.giraph.graph.BspServiceWorker: cleanup:
Notifying master its okay to cleanup with
/_hadoopBsp/job_201203281017_0001/_cleanedUpDir/1_worker
2012-03-28 10:19:00,544 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,546 INFO
org.apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a
reservation)
2012-03-28 10:19:00,547 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,548 INFO
org.apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a
reservation)
2012-03-28 10:19:00,549 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,552 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,552 INFO
org.apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a
reservation)
2012-03-28 10:19:00,556 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,558 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,559 INFO
org.apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a
reservation)
2012-03-28 10:19:00,560 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,562 INFO
org.apache.giraph.graph.BspService: process: inputSplitsStateChanged (lost a
reservation)
2012-03-28 10:19:00,563 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,564 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,576 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,577 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
2012-03-28 10:19:00,578 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)
.............
2012-03-28 10:19:00,583 INFO org.apache.giraph.graph.BspService: process:
inputSplitsStateChanged (lost a reservation)2012-03-28 10:19:00,585 INFO
org.apache.zookeeper.ZooKeeper: Session: 0x1365720ee4e0001 closed
2012-03-28 10:19:00,585 INFO org.apache.zookeeper.ClientCnxn: EventThread shut
down2012-03-28 10:19:00,585 INFO org.apache.giraph.comm.BasicRPCCommunications:
close: shutting down RPC server
2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: Stopping server on
30001
2012-03-28 10:19:00,585 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6
on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
10 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
16 on 30001: exiting2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server:
Stopping IPC Server listener on 30001
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
14 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
15 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
23 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
17 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
22 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
12 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
13 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.metrics.RpcInstrumentation:
shut down
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: Stopping IPC Server
Responder
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
32 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
11 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
27 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
31 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
29 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
21 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
37 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.giraph.zk.ZooKeeperManager:
createZooKeeperClosedStamp: Creating my filestamp
_bsp/_defaultZkManagerDir/job_201203281017_0001/_task/1.COMPUTATION_DONE
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
39 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
40 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
26 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
33 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
38 on 30001: exiting
2012-03-28 10:19:00,587 INFO org.apache.hadoop.ipc.Server: IPC Server handler
25 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
18 on 30001: exiting
2012-03-28 10:19:00,586 INFO org.apache.hadoop.ipc.Server: IPC Server handler
20 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
59 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8
on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
44 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
56 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
55 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
24 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler
28 on 30001: exiting
2012-03-28 10:19:00,588 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7
on 30001: exiting
2012-03-28 10:19:00,809 INFO org.apache.hadoop.mapred.Task:
Task:attempt_201203281017_0001_m_000001_0 is done. And is in the process of
commiting
2012-03-28 10:19:00,863 INFO org.apache.hadoop.mapred.Task: Task
'attempt_201203281017_0001_m_000001_0' done.
2012-03-28 10:19:00,868 INFO org.apache.hadoop.mapred.TaskLogsTruncater:
Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
> How to close all child when a job finished?
> -------------------------------------------
>
> Key: GIRAPH-169
> URL: https://issues.apache.org/jira/browse/GIRAPH-169
> Project: Giraph
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.2.0
> Environment: sles 11 x64,jdk 1.6,hadoop 0.20.205.0,1 Master and 8
> slaves,
> Reporter: Jianfeng Qian
> Priority: Minor
>
> I ran pagerank at hadoop 0.20.205.0. When the job finished,the child in
> slaves didn't quit immediately and sometimes they never quit and I have to
> kill them.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
