[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-23 Thread He Liangliang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022007#comment-15022007 ] He Liangliang commented on HDFS-9422: - Just record the time consumed, jstack not captured. ~5s(mean

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-18 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011573#comment-15011573 ] Haohui Mai commented on HDFS-9422: -- My question is why it takes 5 seconds if this is a purely in memory

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010505#comment-15010505 ] Hadoop QA commented on HDFS-9422: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009046#comment-15009046 ] stack commented on HDFS-9422: - Patch just undoes the synchronize on dataset. This dataset synchronize in scan

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-17 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010058#comment-15010058 ] Mingliang Liu commented on HDFS-9422: - Agreed. The most heavy I/O operations scanning the disk are not

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-16 Thread He Liangliang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007908#comment-15007908 ] He Liangliang commented on HDFS-9422: - No, the lock can make NO difference, EXCEPT we move the

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-16 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007962#comment-15007962 ] Walter Su commented on HDFS-9422: - I have no idea why use Arrays.sort() instead of Collections.sort(). And

[jira] [Commented] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-13 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003986#comment-15003986 ] Kai Zheng commented on HDFS-9422: - Hi [~heliangliang], Thanks for finding and reporting the issue. I took