[
https://issues.apache.org/jira/browse/GIRAPH-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13566937#comment-13566937
]
Hudson commented on GIRAPH-492:
-------------------------------
Integrated in Giraph-trunk-Commit #651 (See
[https://builds.apache.org/job/Giraph-trunk-Commit/651/])
GIRAPH-492: Saving vertices has no status report, making it hard to
(Revision 6fd9f12da217774f15d32deeaeda3a389d44ea34)
Result = SUCCESS
aching :
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=6fd9f12da217774f15d32deeaeda3a389d44ea34
Files :
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/graph/FinishedSuperstepStats.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/graph/GraphTaskManager.java
* giraph-core/src/main/java/org/apache/giraph/master/BspServiceMaster.java
* giraph-core/src/main/java/org/apache/giraph/utils/LoggerUtils.java
*
giraph-core/src/main/java/org/apache/giraph/worker/VertexInputSplitsCallable.java
* giraph-core/src/main/java/org/apache/giraph/benchmark/PageRankBenchmark.java
* giraph-core/src/main/java/org/apache/giraph/bsp/CentralizedServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/bsp/CentralizedServiceMaster.java
* giraph-core/src/main/java/org/apache/giraph/bsp/CentralizedService.java
> Saving vertices has no status report, making it hard to find DFS issues
> -----------------------------------------------------------------------
>
> Key: GIRAPH-492
> URL: https://issues.apache.org/jira/browse/GIRAPH-492
> Project: Giraph
> Issue Type: Bug
> Reporter: Avery Ching
> Assignee: Avery Ching
> Attachments: GIRAPH-492.patch
>
>
> Adds status updates to saving of the vertices and improve the overall logic
> of when to print status of loading/storing the graph (every 250k vertices or
> 15 secs). This will help us to see which are the slow workers when saving
> output. This updates the Hadoop status messages as well as prints to the
> task log. I also made this consistent for the loading.
> Task log messages look like the following:
> org.apache.giraph.worker.BspServiceWorker - saveVertices: Saved 598753 out
> of 1000000 vertices, on partition 14 out of 24
> INFO 2013-01-29 12:54:02,072 [main]
> org.apache.giraph.worker.BspServiceWorker - saveVertices: Saved 848754 out
> of 1000000 vertices, on partition 20 out of 24
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
