[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2018-03-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384290#comment-16384290 ] Tsz Wo Nicholas Sze commented on HDFS-9412: --- Thanks for getBlocks problem! Just have discussed

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245049#comment-15245049 ] Hudson commented on HDFS-9412: -- FAILURE: Integrated in Hadoop-trunk-Commit #9625 (See

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-17 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244578#comment-15244578 ] He Tianyi commented on HDFS-9412: - Hi, [~walter.k.su]. Would you commit this patch when available? >

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240996#comment-15240996 ] Walter Su commented on HDFS-9412: - {{TestBalancer}} passes locally. +1 for the last patch. > getBlocks

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240714#comment-15240714 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240455#comment-15240455 ] Walter Su commented on HDFS-9412: - Thank you for updating. The test {{TestGetBlocks}} failed. Do you mind

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239642#comment-15239642 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239103#comment-15239103 ] Walter Su commented on HDFS-9412: - One thread holding a readLock too long is very like holding a writeLock.

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-04-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239094#comment-15239094 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2016-01-30 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124822#comment-15124822 ] He Tianyi commented on HDFS-9412: - Added ~200 nodes to HDFS cluster recently. As balancing become radical,

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-12-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066038#comment-15066038 ] Hadoop QA commented on HDFS-9412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-12-07 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046417#comment-15046417 ] He Tianyi commented on HDFS-9412: - [~andrew.wang] Perhaps switching to unfair RWLock may cause other

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-11-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009537#comment-15009537 ] Andrew Wang commented on HDFS-9412: --- If the issue is a writer blocking the RWLock, you can turn on unfair

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-11-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009542#comment-15009542 ] Andrew Wang commented on HDFS-9412: --- Also many of our listing operations return RemoteIterators which

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-11-11 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000242#comment-15000242 ] He Tianyi commented on HDFS-9412: - Sorry the misuse of word "starvation". It's not starvation exactly, just

[jira] [Commented] (HDFS-9412) getBlocks occupies FSLock and takes too long to complete

2015-11-11 Thread He Tianyi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000269#comment-15000269 ] He Tianyi commented on HDFS-9412: - A simpler approach would be ignore small blocks during iteration (just