[
https://issues.apache.org/jira/browse/GIRAPH-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14559742#comment-14559742
]
Avery Ching commented on GIRAPH-1009:
-------------------------------------
https://reviews.facebook.net/D38949
+1'ed.
> Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end
> of the computation.
> ------------------------------------------------------------------------------------------------
>
> Key: GIRAPH-1009
> URL: https://issues.apache.org/jira/browse/GIRAPH-1009
> Project: Giraph
> Issue Type: Bug
> Components: bsp, zookeeper
> Affects Versions: 1.2.0-SNAPSHOT
> Environment: All environment, while running with more than one worker.
> Reporter: Hassan Eslami
> Assignee: Hassan Eslami
> Priority: Minor
> Labels: log, worker, zookeeper
> Fix For: 1.2.0-SNAPSHOT
>
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> When running Giraph with more than one worker, ZooKeeper usually throws a
> bunch of 'lost reservation' info log messages for input splits at the end of
> the computation in workers' log. This clutters log file of workers, specially
> in cases where the job is running on a large graph with fairly large number
> of input splits.
> Here are examples of these log messages:
> ...
> {{INFO 2015-05-19 14:44:58,894 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1126 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,894 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2585 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1166 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1212 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,895 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1666 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2282 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1302 lost
> reservation}}
> {{INFO 2015-05-19 14:44:58,896 \[main-EventThread\]
> org.apache.giraph.worker.InputSplitsHandler - process: Input split
> /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2364 lost
> reservation}}
> ...
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
