[jira] [Created] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9334: - Summary: NameNode crash caused by ArrayIndexOutOfBoundsException Key: HDFS-9334 URL: https://issues.apache.org/jira/browse/HDFS-9334 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979748#comment-14979748 ] He Xiaoqiao commented on HDFS-9334: --- hi [~walter.k.su], the case happens at SBN when do editlog tailer.

[jira] [Commented] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2015-10-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979765#comment-14979765 ] He Xiaoqiao commented on HDFS-9334: --- the following scenario may occur ArrayIndexOutOfBoundsException: 1.

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-09 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951576#comment-14951576 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi] after check source code, maybe {{getDistance}} could

[jira] [Commented] (HDFS-8973) NameNode exit without any exception log

2015-08-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716600#comment-14716600 ] He Xiaoqiao commented on HDFS-8973: --- Thanks Kanaka for your comments. The follow is the

[jira] [Updated] (HDFS-8993) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-8993: -- Description: Balancer may throw NPE because the following {{if Statements}}

[jira] [Commented] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721016#comment-14721016 ] He Xiaoqiao commented on HDFS-8992: --- Thanks Tsz Wo Nicholas Sze for your comments, there

[jira] [Commented] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721017#comment-14721017 ] He Xiaoqiao commented on HDFS-8992: --- Thanks Tsz Wo Nicholas Sze for your comments, there

[jira] [Updated] (HDFS-8993) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-8993: -- Description: Balancer may throw NPE because the following {{if Statements}} at line 709 of

[jira] [Resolved] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-8992. --- Resolution: Duplicate Balancer throws NPE --- Key: HDFS-8992

[jira] [Commented] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721030#comment-14721030 ] He Xiaoqiao commented on HDFS-8992: --- thanks [~brahmareddy] for ur comment. i will close

[jira] [Commented] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721015#comment-14721015 ] He Xiaoqiao commented on HDFS-8992: --- Thanks Tsz Wo Nicholas Sze for your comments, there

[jira] [Created] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-8992: - Summary: Balancer throws NPE Key: HDFS-8992 URL: https://issues.apache.org/jira/browse/HDFS-8992 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Created] (HDFS-8993) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-8993: - Summary: Balancer throws NPE Key: HDFS-8993 URL: https://issues.apache.org/jira/browse/HDFS-8993 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Updated] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-8992: -- Description: Balancer may throw NPE because the following {{if Statements}} at line 709 of

[jira] [Commented] (HDFS-8993) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721021#comment-14721021 ] He Xiaoqiao commented on HDFS-8993: --- sorry to create to the same ticket since first

[jira] [Commented] (HDFS-8992) Balancer throws NPE

2015-08-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721018#comment-14721018 ] He Xiaoqiao commented on HDFS-8992: --- Actually, it can be fixed only add condition at {{if

[jira] [Commented] (HDFS-8973) NameNode exit without any exception log

2015-08-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14716414#comment-14716414 ] He Xiaoqiao commented on HDFS-8973: --- Thanks, Kanaka. before stop logging everything looks

[jira] [Updated] (HDFS-8973) NameNode exit without any exception log

2015-08-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-8973: -- Description: namenode process exit without any useful WARN/ERROR log, and after .log file output

[jira] [Created] (HDFS-8973) NameNode exit without any exception log

2015-08-27 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-8973: - Summary: NameNode exit without any exception log Key: HDFS-8973 URL: https://issues.apache.org/jira/browse/HDFS-8973 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742366#comment-14742366 ] He Xiaoqiao commented on HDFS-9068: --- it is necessary to add thread to periodic check if the sd in

[jira] [Created] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9068: - Summary: SBN checkpoint could not work after the only name directory recovery from failure Key: HDFS-9068 URL: https://issues.apache.org/jira/browse/HDFS-9068 Project:

[jira] [Updated] (HDFS-9068) SBN checkpoint could not work after the only name directory recovery from failure

2015-09-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9068: -- Attachment: HDFS-9068.patch Attach patch: check failure directory if OK before saving fsimage. > SBN

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941243#comment-14941243 ] He Xiaoqiao commented on HDFS-9149: --- hi [~He Tianyi]], thank you for your comments. {quote} The only

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941360#comment-14941360 ] He Xiaoqiao commented on HDFS-9149: --- Thanks, [~He Tianyi]. it's not a good solution exactly. maybe we

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-10-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942122#comment-14942122 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] thanks for your advice. i'll work on that. > Consider

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909767#comment-14909767 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend

[jira] [Commented] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-27 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909768#comment-14909768 ] He Xiaoqiao commented on HDFS-9149: --- [~He Tianyi] i think it is not necessary to extend

[jira] [Created] (HDFS-9149) Consider multi

2015-09-26 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-9149: - Summary: Consider multi Key: HDFS-9149 URL: https://issues.apache.org/jira/browse/HDFS-9149 Project: Hadoop HDFS Issue Type: Improvement Reporter: He

[jira] [Updated] (HDFS-9149) Consider multi datacenter when sortByDistance

2015-09-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-9149: -- Description: {{sortByDistance}} doesn't consider multi-datacenter when read data, so there my be reading

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.5.2 2.6.4 > ReplicationMonitor thread could stuck for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.001.patch > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-25 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: (was: 2.7.1) Affects Version/s: (was: 2.7.1) Target Version/s:

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Target Version/s: 2.7.1 Status: Patch Available (was: Open) > ReplicationMonitor

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305222#comment-15305222 ] He Xiaoqiao commented on HDFS-10453: hi [~shahrs87], thanks a lot for your watching this issue. It

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306312#comment-15306312 ] He Xiaoqiao commented on HDFS-10453: hi [~vinayrpet], thanks for your comments. Actually this case

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.7.1 > ReplicationMonitor thread could stuck for long time due to the race

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303438#comment-15303438 ] He Xiaoqiao commented on HDFS-8718: --- hi [~jianbginglover] and [~kanaka], ReplicationMonitor stuck for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.003.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Affects Version/s: 2.4.1 Status: Patch Available (was: Open) Kick jenkins for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453.patch > ReplicationMonitor thread could stuck for long time due to the race

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.1 Status: Patch Available (was: Open) committe to branch-2.7.1 >

[jira] [Created] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10453: -- Summary: ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. Key: HDFS-10453 URL:

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Patch Available (was: Open) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: (was: HDFS-10453.patch) > ReplicationMonitor thread could stuck for long time due to

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Status: Open (was: Patch Available) > ReplicationMonitor thread could stuck for long time due to the

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-05-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.001.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-8718) Block replicating cannot work after upgrading to 2.7

2016-05-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268067#comment-15268067 ] He Xiaoqiao commented on HDFS-8718: --- i met the same problem after upgraded the cluster to 2.7.1, and

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Attachment: HDFS-10606-branch-2.7.001.patch submit patch for branch-2.7 > TrashPolicyDefault

[jira] [Updated] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-13 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10606: --- Affects Version/s: (was: 2.7.1) 2.7.0 Status: Patch

[jira] [Created] (HDFS-10606) TrashPolicyDefault supports time of auto clean up can configured

2016-07-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10606: -- Summary: TrashPolicyDefault supports time of auto clean up can configured Key: HDFS-10606 URL: https://issues.apache.org/jira/browse/HDFS-10606 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10728) DN can't communicate with NN when IP address of NN changed since Auth failed

2016-08-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10728: --- Affects Version/s: 2.7.1 Description: In security authentication hadoop cluster with

[jira] [Created] (HDFS-10728) DataNode cann't connect to NameNode

2016-08-07 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10728: -- Summary: DataNode cann't connect to NameNode Key: HDFS-10728 URL: https://issues.apache.org/jira/browse/HDFS-10728 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2016-07-04 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15360989#comment-15360989 ] He Xiaoqiao commented on HDFS-7858: --- hi [~asuresh] when i patch this to 2.7.1, it throws some exception

[jira] [Created] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-21 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-10782: -- Summary: Decrease memory frequent exchange of Centralized Cache Management when run balancer Key: HDFS-10782 URL: https://issues.apache.org/jira/browse/HDFS-10782

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch submit patch for branch-2.7 > Decrease memory frequent

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Labels: patch (was: ) Status: Patch Available (was: Open) NN returns uncached blocks for

[jira] [Resolved] (HDFS-9334) NameNode crash caused by ArrayIndexOutOfBoundsException

2016-09-05 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao resolved HDFS-9334. --- Resolution: Duplicate HDFS-6830 has fixed this. > NameNode crash caused by

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: HDFS-10782-branch-2.001.patch > Decrease memory frequent exchange of Centralized Cache

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Attachment: (was: HDFS-10782-branch-2.001.patch) > Decrease memory frequent exchange of

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Open (was: Patch Available) > Decrease memory frequent exchange of Centralized Cache

[jira] [Updated] (HDFS-10782) Decrease memory frequent exchange of Centralized Cache Management when run balancer

2016-08-24 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10782: --- Status: Patch Available (was: Open) re-submit patch. > Decrease memory frequent exchange of

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-12-17 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756632#comment-15756632 ] He Xiaoqiao commented on HDFS-10453: [~yangyishan0901m] patch is ready and it works well for long

[jira] [Created] (HDFS-11231) federation support to linux-like mount type

2016-12-11 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-11231: -- Summary: federation support to linux-like mount type Key: HDFS-11231 URL: https://issues.apache.org/jira/browse/HDFS-11231 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710645#comment-15710645 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710643#comment-15710643 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710641#comment-15710641 ] He Xiaoqiao commented on HDFS-10453: [~wutak...@amazon.com] Thanks for your comments, The patch is

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Issue Comment Deleted] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2016-11-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Comment: was deleted (was: [~wutak...@amazon.com] Thanks for your comments, The patch is ready, and i

[jira] [Commented] (HDFS-11231) federation support to linux-like mount type

2017-01-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804218#comment-15804218 ] He Xiaoqiao commented on HDFS-11231: [~andrew.wang] Thanks for your comments. Yes, i think there are

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281571#comment-16281571 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] [~genericqa] Thanks for your comments and tests.

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.004.patch attach new patch for branch-2.7 > ReplicationMonitor

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281696#comment-16281696 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] The new patch is ready and update based on you

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-11 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.005.patch [~Octivian] thanks for your suggestions, we do need to

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226339#comment-16226339 ] He Xiaoqiao commented on HDFS-12749: [~tanyuxin] could you attach some more troubleshoot or exception

[jira] [Updated] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13529: --- Status: Patch Available (was: Open) > Fix default trash policy emptier trigger time correctly >

[jira] [Updated] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13529: --- Attachment: HDFS-13529-trunk.001.patch > Fix default trash policy emptier trigger time correctly >

[jira] [Commented] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465250#comment-16465250 ] He Xiaoqiao commented on HDFS-13529: submit v001 patch and trigger jenkins. > Fix default trash

[jira] [Created] (HDFS-13529) Fix default trash policy emptier trigger time correctly

2018-05-06 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13529: -- Summary: Fix default trash policy emptier trigger time correctly Key: HDFS-13529 URL: https://issues.apache.org/jira/browse/HDFS-13529 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2018-06-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503271#comment-16503271 ] He Xiaoqiao commented on HDFS-13183: Thanks [~elgoiri] and [~shv] for your comments. {quote} If we

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Attachment: HDFS-13668-trunk.001.patch > FSPermissionChecker may throws AIOOE when check if inode

[jira] [Updated] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13668: --- Status: Patch Available (was: Open) submit v0 patch and trigger jenkins. > FSPermissionChecker may

[jira] [Created] (HDFS-13668) FSPermissionChecker may throws AIOOE when check if inode has permission

2018-06-10 Thread He Xiaoqiao (JIRA)
He Xiaoqiao created HDFS-13668: -- Summary: FSPermissionChecker may throws AIOOE when check if inode has permission Key: HDFS-13668 URL: https://issues.apache.org/jira/browse/HDFS-13668 Project: Hadoop

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504601#comment-16504601 ] He Xiaoqiao commented on HDFS-13473: [~daryn] any further comments and suggestions? > DataNode

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.004.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514831#comment-16514831 ] He Xiaoqiao commented on HDFS-13473: [~daryn], Thanks for your review. In v003, update logic about

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.004.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514861#comment-16514861 ] He Xiaoqiao commented on HDFS-13473: re-upload v004 patch, fix compile fail and kick on jenknis

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: (was: HDFS-13473-trunk.004.patch) > DataNode update BlockKeys using mode PULL rather

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-16 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.003.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Updated] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-13473: --- Attachment: HDFS-13473-trunk.005.patch > DataNode update BlockKeys using mode PULL rather than PUSH

[jira] [Commented] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515693#comment-16515693 ] He Xiaoqiao commented on HDFS-13473: upload v005 patch to fix bug about auto-update block token keys

[jira] [Comment Edited] (HDFS-13473) DataNode update BlockKeys using mode PULL rather than PUSH from NameNode

2018-06-18 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515693#comment-16515693 ] He Xiaoqiao edited comment on HDFS-13473 at 6/18/18 1:24 PM: - upload v005

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2018-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-12749: --- Attachment: HDFS-12749-trunk.005.patch > DN may not send block report to NN after NN restart >

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2018-05-26 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491812#comment-16491812 ] He Xiaoqiao commented on HDFS-12749: thanks [~kihwal], v005 patch is with test case following your

[jira] [Commented] (HDFS-13638) DataNode Can't replicate block because NameNode thinks the length is 9223372036854775807

2018-05-29 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494689#comment-16494689 ] He Xiaoqiao commented on HDFS-13638: [~jojochuang], I met this problem in apache-2.7.1, IIUC, it may

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-02-02 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350705#comment-16350705 ] He Xiaoqiao commented on HDFS-10453: ping [~ajayydv], please share your feedback and give some

  1   2   3   4   5   6   7   8   9   >