[ 
https://issues.apache.org/jira/browse/GIRAPH-169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13240116#comment-13240116
 ] 

Jianfeng Qian commented on GIRAPH-169:
--------------------------------------

I have a master and 9 slaves,and each slave has 9 mapper.
The console output is as follow:
 /usr/local/test-0302/hadoop-0.20.205.0/bin/hadoop jar 
/usr/local/test-0302/hadoop-0.20.205.0/lib/giraph
-0.2-all.jar org.apache.giraph.benchmark.PageRankBenchmark -e 16 -s 5 -v -V 
1000000 -w 64 -c 1
12/03/28 10:20:43 INFO benchmark.PageRankBenchmark: Using class 
org.apache.giraph.benchmark.PageRankBenchmark
12/03/28 10:20:43 WARN bsp.BspOutputFormat: checkOutputSpecs: 
ImmutableOutputCommiter will not check anything
12/03/28 10:20:44 INFO mapred.JobClient: Running job: job_201203281017_0001
12/03/28 10:20:45 INFO mapred.JobClient:  map 0% reduce 0%
12/03/28 10:21:03 INFO mapred.JobClient:  map 1% reduce 0%
12/03/28 10:21:36 INFO mapred.JobClient:  map 100% reduce 0%
12/03/28 10:22:11 INFO mapred.JobClient: Job complete: job_201203281017_0001
12/03/28 10:22:11 INFO mapred.JobClient: Counters: 37
12/03/28 10:22:11 INFO mapred.JobClient:   Job Counters 
12/03/28 10:22:11 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=3600296
12/03/28 10:22:11 INFO mapred.JobClient:     Total time spent by all reduces 
waiting after reserving slots (ms)=0
12/03/28 10:22:11 INFO mapred.JobClient:     Total time spent by all maps 
waiting after reserving slots (ms)=0
12/03/28 10:22:11 INFO mapred.JobClient:     Launched map tasks=65
12/03/28 10:22:11 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
12/03/28 10:22:11 INFO mapred.JobClient:   Giraph Timers
12/03/28 10:22:11 INFO mapred.JobClient:     Total (milliseconds)=64352
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 3 (milliseconds)=5068
12/03/28 10:22:11 INFO mapred.JobClient:     Setup (milliseconds)=20768
12/03/28 10:22:11 INFO mapred.JobClient:     Shutdown (milliseconds)=4826
12/03/28 10:22:11 INFO mapred.JobClient:     Vertex input superstep 
(milliseconds)=10669
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 0 (milliseconds)=6173
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 4 (milliseconds)=5056
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 5 (milliseconds)=806
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 2 (milliseconds)=5265
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep 1 (milliseconds)=5717
12/03/28 10:22:11 INFO mapred.JobClient:   Giraph Stats
12/03/28 10:22:11 INFO mapred.JobClient:     Aggregate edges=16000000
12/03/28 10:22:11 INFO mapred.JobClient:     Superstep=6
12/03/28 10:22:11 INFO mapred.JobClient:     Last checkpointed superstep=0
12/03/28 10:22:11 INFO mapred.JobClient:     Current workers=64
12/03/28 10:22:11 INFO mapred.JobClient:     Current master task partition=0
12/03/28 10:22:11 INFO mapred.JobClient:     Sent messages=0
12/03/28 10:22:11 INFO mapred.JobClient:     Aggregate finished vertices=1000000
12/03/28 10:22:11 INFO mapred.JobClient:     Aggregate vertices=1000000
12/03/28 10:22:11 INFO mapred.JobClient:   File Output Format Counters 
12/03/28 10:22:11 INFO mapred.JobClient:     Bytes Written=0
12/03/28 10:22:11 INFO mapred.JobClient:   FileSystemCounters
12/03/28 10:22:11 INFO mapred.JobClient:     FILE_BYTES_READ=7552
12/03/28 10:22:11 INFO mapred.JobClient:     HDFS_BYTES_READ=2860
12/03/28 10:22:11 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=1425440
12/03/28 10:22:11 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=282051638
12/03/28 10:22:11 INFO mapred.JobClient:   File Input Format Counters 
12/03/28 10:22:11 INFO mapred.JobClient:     Bytes Read=0
12/03/28 10:22:11 INFO mapred.JobClient:   Map-Reduce Framework
12/03/28 10:22:11 INFO mapred.JobClient:     Map input records=65
12/03/28 10:22:11 INFO mapred.JobClient:     Physical memory (bytes) 
snapshot=40195567616
12/03/28 10:22:11 INFO mapred.JobClient:     Spilled Records=0
12/03/28 10:22:11 INFO mapred.JobClient:     CPU time spent (ms)=1544910
12/03/28 10:22:11 INFO mapred.JobClient:     Total committed heap usage 
(bytes)=43066982400
12/03/28 10:22:11 INFO mapred.JobClient:     Virtual memory (bytes) 
snapshot=170265358336
12/03/28 10:22:11 INFO mapred.JobClient:     Map output records=0
12/03/28 10:22:11 INFO mapred.JobClient:     SPLIT_RAW_BYTES=2860
The job information is as follow:
Completed Jobs
Jobid Priority User Name Map % Complete Map Total Maps Completed Reduce % 
Complete Reduce Total Reduces Completed Job Scheduling Information Diagnostic 
Info  
job_201203281017_0001 NORMAL root org.apache.giraph.benchmark.PageRankBenchmark 
100.00% 
 65 65 100.00% 
 0 0 NA NA.
but all child can't quit. 

                
> How to close all child when a job finished?
> -------------------------------------------
>
>                 Key: GIRAPH-169
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-169
>             Project: Giraph
>          Issue Type: Improvement
>          Components: mapreduce
>    Affects Versions: 0.2.0
>         Environment: sles 11 x64,jdk 1.6,hadoop 0.20.205.0,1 Master and 8 
> slaves,
>            Reporter: Jianfeng Qian
>            Priority: Minor
>
> I ran pagerank at hadoop 0.20.205.0. When the job finished,the child in 
> slaves didn't quit immediately and sometimes they never quit and I have to 
> kill them. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to