[
https://issues.apache.org/jira/browse/GIRAPH-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13571618#comment-13571618
]
Hudson commented on GIRAPH-498:
-------------------------------
Integrated in Giraph-trunk-Commit #669 (See
[https://builds.apache.org/job/Giraph-trunk-Commit/669/])
GIRAPH-498: We should check input splits status from zookeeeper once per
worker, not once per split thread (majakabiljo) (Revision
1c967b8e0b282deb9a3d49231f410ffcabd9e9de)
Result = SUCCESS
majakabiljo :
http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=1c967b8e0b282deb9a3d49231f410ffcabd9e9de
Files :
*
giraph-core/src/main/java/org/apache/giraph/worker/InputSplitPathOrganizer.java
*
giraph-core/src/main/java/org/apache/giraph/worker/EdgeInputSplitsCallableFactory.java
* giraph-core/src/test/java/org/apache/giraph/TestBspBasic.java
*
giraph-core/src/main/java/org/apache/giraph/worker/VertexInputSplitsCallable.java
*
giraph-core/src/main/java/org/apache/giraph/worker/EdgeInputSplitsCallable.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/worker/InputSplitsHandler.java
* giraph-core/src/main/java/org/apache/giraph/worker/InputSplitsCallable.java
*
giraph-core/src/main/java/org/apache/giraph/worker/VertexInputSplitsCallableFactory.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java
> We should check input splits status from zookeeeper once per worker, not once
> per split thread
> ----------------------------------------------------------------------------------------------
>
> Key: GIRAPH-498
> URL: https://issues.apache.org/jira/browse/GIRAPH-498
> Project: Giraph
> Issue Type: Bug
> Reporter: Maja Kabiljo
> Assignee: Maja Kabiljo
> Attachments: GIRAPH-498.diff
>
>
> When using a lot of workers and a lot of input split threads, checking that
> all input splits are finished after the reading is done takes a long time,
> since we check every input split once per thread.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
