[jira] [Created] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6616: -- Summary: bestNode shouldn't always return the first DataNode Key: HDFS-6616 URL: https://issues.apache.org/jira/browse/HDFS-6616 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.patch One possible solution is choose DataNode randomly with the cost of ignore

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.patch bestNode shouldn't always return the first DataNode

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: (was: HDFS-6616.patch) bestNode shouldn't always return the first DataNode

[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-02 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049669#comment-14049669 ] zhaoyunjiong commented on HDFS-6616: What happened on our cluster is very rare case.

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-07-02 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-2.patch Thanks Daryn Sharp for your time. Update patch, use boolean instead of

[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-02 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051076#comment-14051076 ] zhaoyunjiong commented on HDFS-6616: Yes. You are right. I never thought user may use

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.1.patch Update patch to support exclude nodes in WebHDFS. bestNode shouldn't

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.2.patch Thanks Tsz Wo Nicholas Sze Jing Zhao. Update patch according to

[jira] [Updated] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-18 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6616: --- Attachment: HDFS-6616.3.patch Update patch according to comments and fix test failures. bestNode

[jira] [Created] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

2014-08-06 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6829: -- Summary: DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster Key: HDFS-6829 URL: https://issues.apache.org/jira/browse/HDFS-6829 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6829) DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster

2014-08-06 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6829: --- Attachment: HDFS-6829.patch This patch is very simple, use HdfsConfiguration to load hdfs-site.xml

[jira] [Created] (HDFS-7044) Support retention policy based on access time and modify time, use XAttr to store policy

2014-09-11 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-7044: -- Summary: Support retention policy based on access time and modify time, use XAttr to store policy Key: HDFS-7044 URL: https://issues.apache.org/jira/browse/HDFS-7044

[jira] [Updated] (HDFS-7044) Support retention policy based on access time and modify time, use XAttr to store policy

2014-09-11 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7044: --- Attachment: Retention policy design.pdf Attach a simple design document. The major difference between

[jira] [Created] (HDFS-6133) Make Balancer support don't move blocks belongs to Hbase

2014-03-20 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6133: -- Summary: Make Balancer support don't move blocks belongs to Hbase Key: HDFS-6133 URL: https://issues.apache.org/jira/browse/HDFS-6133 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6133) Make Balancer support don't move blocks belongs to Hbase

2014-03-20 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133.patch This patch make Balancer support don't move blocks belongs to Hbase

[jira] [Commented] (HDFS-6133) Make Balancer support don't move blocks belongs to Hbase

2014-03-21 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943050#comment-13943050 ] zhaoyunjiong commented on HDFS-6133: Thanks for your review, stack. I didn't aware

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-03-21 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Summary: Make Balancer support exclude specified path (was: Make Balancer support don't move blocks

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-03-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: (was: HDFS-6133.patch) Make Balancer support exclude specified path

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-03-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133.patch This patch support exclude multiple paths. Make Balancer support

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-03-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Status: Patch Available (was: Open) Make Balancer support exclude specified path

[jira] [Created] (HDFS-6228) comments typo fix for FsDatasetImpl.java

2014-04-09 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6228: -- Summary: comments typo fix for FsDatasetImpl.java Key: HDFS-6228 URL: https://issues.apache.org/jira/browse/HDFS-6228 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6228) comments typo fix for FsDatasetImpl.java

2014-04-09 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6228: --- Attachment: HDFS-6228.patch A patch fix typo in comments: - * @param estimateBlockLen estimate

[jira] [Updated] (HDFS-6228) comments typo fix for FsDatasetImpl.java

2014-04-09 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6228: --- Status: Patch Available (was: Open) comments typo fix for FsDatasetImpl.java

[jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process

2014-04-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13971498#comment-13971498 ] zhaoyunjiong commented on HDFS-4420: Hi Yongjun, Could you check

[jira] [Updated] (HDFS-2139) Fast copy for HDFS.

2014-04-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-2139: --- Attachment: HDFS-2139.patch Seems Pritam don't have time to create a patch for Apache. And I do think

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-04-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133.patch Thanks Yongjun Zhang and Benoy Antony for the review. Update patches

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-04-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: (was: HDFS-6133.patch) Make Balancer support exclude specified path

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-04-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: (was: HDFS-6133.patch) Make Balancer support exclude specified path

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-04-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133.patch Upload patch according to comments. By the way, do we have new BM

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2014-04-29 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984113#comment-13984113 ] zhaoyunjiong commented on HDFS-6133: Yes, block pinning works. By the way, where do you

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-05-06 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133.patch.1 This patch will set sticky bit on the block file if the DFSClient have

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-05-06 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: (was: HDFS-6133.patch.1) Make Balancer support exclude specified path

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-05-06 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-1.patch Make Balancer support exclude specified path

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2014-05-07 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13991492#comment-13991492 ] zhaoyunjiong commented on HDFS-6133: I'll use boolean instead of Boolean. Yes, the NN

[jira] [Updated] (HDFS-2139) Fast copy for HDFS.

2014-06-12 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-2139: --- Attachment: HDFS-2139.patch Thanks Guo Ruijing Daryn Sharp for your time. Update patch according to

[jira] [Moved] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong moved MAPREDUCE-5415 to HDFS-5028: --- Assignee: (was: zhaoyunjiong) Affects Version/s:

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: (was: MAPREDUCE-5415.patch) LeaseRenewer throw

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: HDFS-5028 LeaseRenewer throw java.util.ConcurrentModificationException when timeout

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Affects Version/s: (was: 1.2.0) 1.1.2 Fix Version/s: 1.1.3

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: (was: HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: HDFS-5028.patch HDFS-5028-1.1.2.patch Update patch for both trunk and

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Affects Version/s: (was: 1.1.2) 1.1.0 LeaseRenewer throw

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: (was: HDFS-5028-1.1.2.patch) LeaseRenewer throw

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: HDFS-5028-branch-1.1.patch LeaseRenewer throw

[jira] [Commented] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-07-29 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13723253#comment-13723253 ] zhaoyunjiong commented on HDFS-5028: dfsclients was syncronizing. The problem here is

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-08-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: (was: HDFS-5028.patch) LeaseRenewer throw

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-08-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: (was: HDFS-5028-branch-1.1.patch) LeaseRenewer throw

[jira] [Updated] (HDFS-5028) LeaseRenewer throw java.util.ConcurrentModificationException when timeout

2013-08-01 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5028: --- Attachment: HDFS-5028.patch HDFS-5028-branch-1.1.patch Thanks Nicholas. Change

[jira] [Created] (HDFS-5247) Namenode should close editlog and unlock storage when removing failed storage dir

2013-09-22 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-5247: -- Summary: Namenode should close editlog and unlock storage when removing failed storage dir Key: HDFS-5247 URL: https://issues.apache.org/jira/browse/HDFS-5247 Project:

[jira] [Commented] (HDFS-5247) Namenode should close editlog and unlock storage when removing failed storage dir

2013-09-24 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13777073#comment-13777073 ] zhaoyunjiong commented on HDFS-5247: I'm saying for the failed directory. Our case is

[jira] [Created] (HDFS-5367) Restore fsimage locked NameNode too long when the size of fsimage are big

2013-10-16 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-5367: -- Summary: Restore fsimage locked NameNode too long when the size of fsimage are big Key: HDFS-5367 URL: https://issues.apache.org/jira/browse/HDFS-5367 Project: Hadoop

[jira] [Updated] (HDFS-5367) Restore fsimage locked NameNode too long when the size of fsimage are big

2013-10-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5367: --- Attachment: (was: HDFS-5367) Restore fsimage locked NameNode too long when the size of fsimage

[jira] [Updated] (HDFS-5367) Restore fsimage locked NameNode too long when the size of fsimage are big

2013-10-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5367: --- Attachment: HDFS-5367 The fsimage restored when SecondaryNameNode call rollEditLog will be replaced

[jira] [Updated] (HDFS-5367) Restore fsimage locked NameNode too long when the size of fsimage are big

2013-10-16 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5367: --- Attachment: HDFS-5367-branch-1.2.patch This patch avoid restore fsimage to make rollEditLog finished

[jira] [Commented] (HDFS-5367) Restoring namenode storage locks namenode due to unnecessary fsimage write

2013-10-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798610#comment-13798610 ] zhaoyunjiong commented on HDFS-5367: Thank you for your review. Restoring namenode

[jira] [Created] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2013-10-21 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-5396: -- Summary: FSImage.getFsImageName should check whether fsimage exists Key: HDFS-5396 URL: https://issues.apache.org/jira/browse/HDFS-5396 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2013-10-21 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5396: --- Attachment: HDFS-5396-branch-1.2.patch Check whether fsimage exists before return.

[jira] [Resolved] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2013-10-22 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong resolved HDFS-5396. Resolution: Not A Problem FSImage.getFsImageName should check whether fsimage exists

[jira] [Commented] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2013-10-22 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802545#comment-13802545 ] zhaoyunjiong commented on HDFS-5396: The first image storage dir always have fsimage

[jira] [Created] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-11-27 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-5579: -- Summary: Under construction files make DataNode decommission take very long hours Key: HDFS-5579 URL: https://issues.apache.org/jira/browse/HDFS-5579 Project: Hadoop

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-11-27 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579.patch HDFS-5579-branch-1.2.patch This patch let NameNode can

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-11-28 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579-branch-1.2.patch HDFS-5579.patch Thanks Vinay. Update patch as

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-11-28 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579-branch-1.2.patch) Under construction files make DataNode

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-11-28 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579.patch HDFS-5579-branch-1.2.patch Update patch, added test case

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2013-12-05 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579-branch-1.2.patch) Under construction files make DataNode

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865202#comment-13865202 ] zhaoyunjiong commented on HDFS-5579: It's already in the patch. +if

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579-branch-1.2.patch HDFS-5579.patch Good point. Thanks Jing.

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579-branch-1.2.patch) Under construction files make DataNode

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: HDFS-5579.patch Under construction files make DataNode decommission take very long hours

[jira] [Updated] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-08 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5579: --- Attachment: (was: HDFS-5579.patch) Under construction files make DataNode decommission take very

[jira] [Commented] (HDFS-5579) Under construction files make DataNode decommission take very long hours

2014-01-13 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13870385#comment-13870385 ] zhaoyunjiong commented on HDFS-5579: Thanks for your time to review the patch, Jing.

[jira] [Reopened] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2014-02-10 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong reopened HDFS-5396: I made a mistake when I resolved this as Not A Problem. Because for (IteratorStorageDirectory it =

[jira] [Created] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-12 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-5944: -- Summary: LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint Key: HDFS-5944 URL:

[jira] [Updated] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-12 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5944: --- Description: In our cluster, we encountered error like this: java.io.IOException: saveLeases found

[jira] [Updated] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-12 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5944: --- Attachment: HDFS-5944.patch HDFS-5944-branch-1.2.patch This patch is very simple, if

[jira] [Commented] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-13 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13901171#comment-13901171 ] zhaoyunjiong commented on HDFS-5944: Brandon, thanks for your time to review this

[jira] [Updated] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5944: --- Attachment: HDFS-5944-branch-1.2.patch HDFS-5944.patch Update patches with unit test.

[jira] [Updated] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5944: --- Attachment: (was: HDFS-5944-branch-1.2.patch) LeaseManager:findLeaseWithPrefixPath didn't handle

[jira] [Updated] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5944: --- Attachment: (was: HDFS-5944.patch) LeaseManager:findLeaseWithPrefixPath didn't handle path like

[jira] [Commented] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-19 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13905361#comment-13905361 ] zhaoyunjiong commented on HDFS-5944: Multiple trailing / is impossible.

[jira] [Commented] (HDFS-5944) LeaseManager:findLeaseWithPrefixPath didn't handle path like /a/b/ right cause SecondaryNameNode failed do checkpoint

2014-02-19 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13906435#comment-13906435 ] zhaoyunjiong commented on HDFS-5944: Thank you Brandon and Benoy.

[jira] [Updated] (HDFS-5396) FSImage.getFsImageName should check whether fsimage exists

2014-02-20 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-5396: --- Attachment: HDFS-5396-branch-1.2.patch Update patch. FSImage.getFsImageName should check whether

[jira] [Resolved] (HDFS-7044) Support retention policy based on access time and modify time, use XAttr to store policy

2014-09-17 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong resolved HDFS-7044. Resolution: Duplicate Thanks Allen Wittenauer and Zesheng Wu. After I read the comments in

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-10-09 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-3.patch Update patch for merge the trunk. {quote} Why we always pass false in

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-10-10 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: (was: HDFS-6133-3.patch) Make Balancer support exclude specified path

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-10-10 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-3.patch Update patch, merge with trunk. Make Balancer support exclude

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-11-18 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-4.patch Thanks Yongjun Zhang. Update patch according to comments. {quote} The

[jira] [Created] (HDFS-7429) DomainSocketWatcher.doPoll0 stuck

2014-11-23 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-7429: -- Summary: DomainSocketWatcher.doPoll0 stuck Key: HDFS-7429 URL: https://issues.apache.org/jira/browse/HDFS-7429 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7429) DomainSocketWatcher.doPoll0 stuck

2014-11-23 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7429: --- Attachment: 11241025 11241023 11241021 Upload more stack trace files.

[jira] [Updated] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7429: --- Summary: DomainSocketWatcher.kick stuck (was: DomainSocketWatcher.doPoll0 stuck)

[jira] [Updated] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7429: --- Description: I found some of our DataNodes will run exceeds the limit of concurrent xciever, the

[jira] [Commented] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224249#comment-14224249 ] zhaoyunjiong commented on HDFS-7429: The previous description is not right. The stuck

[jira] [Updated] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-7429: --- Description: I found some of our DataNodes will run exceeds the limit of concurrent xciever, the

[jira] [Assigned] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong reassigned HDFS-7429: -- Assignee: zhaoyunjiong DomainSocketWatcher.kick stuck --

[jira] [Commented] (HDFS-7429) DomainSocketWatcher.kick stuck

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224325#comment-14224325 ] zhaoyunjiong commented on HDFS-7429: The problem here is in our machine we can only

[jira] [Updated] (HDFS-6133) Make Balancer support exclude specified path

2014-11-25 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated HDFS-6133: --- Attachment: HDFS-6133-5.patch Thanks Yongjun Zhang, update patch to fix the format. Make Balancer

  1   2   >