[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967293#comment-14967293 ] Xiao Chen commented on HDFS-9273: - The Findbugs warning is not relevant. > ACLs on root directory may be

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.008.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972793#comment-14972793 ] Xiao Chen commented on HDFS-9231: - Patch 08 addresses checkstyle errors. The test failure is unrelate and

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Description: Currently for snapshot files, {{fsck -list-corruptfileblocks}} shows corrupt blocks with the

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.005.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971469#comment-14971469 ] Xiao Chen commented on HDFS-9231: - Thanks a lot for the review [~yzhangal]! {quote} 1. The description is

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968590#comment-14968590 ] Xiao Chen commented on HDFS-7087: - Thanks Jason for reporting the error, and thanks Yi for fixing it! >

[jira] [Updated] (HDFS-9280) Document NFS gateway export point parameter

2015-10-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9280: Attachment: HDFS-9280.002.patch Thanks Zhe for the review! Attached patch 002 addresses your comments. The

[jira] [Commented] (HDFS-9280) Document NFS gateway export point parameter

2015-10-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969674#comment-14969674 ] Xiao Chen commented on HDFS-9280: - Thanks for committing Zhe! > Document NFS gateway export point

[jira] [Commented] (HDFS-9280) Document NFS gateway export point parameter

2015-10-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969604#comment-14969604 ] Xiao Chen commented on HDFS-9280: - Thanks Zhe for submitting the patch. I thought Hadoop QA will -1 me

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967525#comment-14967525 ] Xiao Chen commented on HDFS-9231: - patch 004 is attached. I think I should re-summarize it below: - fsck

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967815#comment-14967815 ] Xiao Chen commented on HDFS-9231: - The test failures look unrelated and passed locally. Findbugs seems to

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.009.patch Patch 009 fixes the check style warning of comments ending in '.'. Test

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-10-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978717#comment-14978717 ] Xiao Chen commented on HDFS-9231: - Thanks Yongjun for the reviews and commit! > fsck doesn't list correct

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9273: Status: Patch Available (was: Open) Thanks [~cnauroth] for the review! You are absolutely right. Attached

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967891#comment-14967891 ] Xiao Chen commented on HDFS-9273: - Thanks very much Chris for verifying the fix locally. > ACLs on root

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9273: Attachment: HDFS-9273.002.patch > ACLs on root directory may be lost after NN restart >

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9273: Status: Open (was: Patch Available) > ACLs on root directory may be lost after NN restart >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: (was: HDFS-9231.006.patch) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.006.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.007.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.006.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971947#comment-14971947 ] Xiao Chen commented on HDFS-9231: - Per the offline talk, we can make {{FSDirSnapshotOp#getSnapshotFiles}}

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.006.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: (was: HDFS-9231.006.patch) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971855#comment-14971855 ] Xiao Chen commented on HDFS-9231: - Hi Yongjun, Thanks again for the quick review! Your comments makes

[jira] [Updated] (HDFS-9280) Document NFS gateway export point parameter

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9280: Attachment: HDFS-9280.001.patch Hi [~zhz], thanks for creating this JIRA! I have read up the code and

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.004.patch > fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot >

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-10-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968213#comment-14968213 ] Xiao Chen commented on HDFS-9273: - Thanks a lot Chris for reviewing and committing! > ACLs on root

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998892#comment-14998892 ] Xiao Chen commented on HDFS-7553: - The findbugs warning seems to be HDFS-9401 which is fixed yesterday. The

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999016#comment-14999016 ] Xiao Chen commented on HDFS-9364: - Thanks Zhe! > Unnecessary DNS resolution attempts when creating

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.002.patch > TestDFSAdminWithHA#tearDown may throw NPE >

[jira] [Commented] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000709#comment-15000709 ] Xiao Chen commented on HDFS-9410: - Thanks very much Walter for looking into this! Your comments makes

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997953#comment-14997953 ] Xiao Chen commented on HDFS-9364: - Thanks Zhe. The findbugs and asflicense warnings are not introduced by

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.003.patch > TestDFSAdminWithHA#tearDown may throw NPE >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Description: Originally found in {{TestDFSAdminWithHA#tearDown}} where System.out.flush() throws an NPE.

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Open (was: Patch Available) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002916#comment-15002916 ] Xiao Chen commented on HDFS-9410: - Hi [~walter.k.su], here comes patch 003 which fixes all similar errors,

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Summary: Fix all HDFS unit tests to correctly reset to sysout and syserr (was: TestDFSAdminWithHA#tearDown

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Patch Available (was: Open) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.003.patch > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003368#comment-15003368 ] Xiao Chen commented on HDFS-9410: - Seems [jenkins run into some docker

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Open (was: Patch Available) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Patch Available (was: Open) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: (was: HDFS-9410.003.patch) > Fix all HDFS unit tests to correctly reset to sysout and syserr

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003630#comment-15003630 ] Xiao Chen commented on HDFS-9410: - Thanks Walter for the review and commit. > Some tests should always

[jira] [Created] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-13 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9429: --- Summary: Tests in TestDFSAdminWithHA intermittently fail with EOFException Key: HDFS-9429 URL: https://issues.apache.org/jira/browse/HDFS-9429 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005071#comment-15005071 ] Xiao Chen commented on HDFS-9429: - A sample failure below: *Error Message* {noformat} Unable to check if

[jira] [Commented] (HDFS-8770) ReplicationMonitor thread received Runtime exception: NullPointerException when BlockManager.chooseExcessReplicates

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007000#comment-15007000 ] Xiao Chen commented on HDFS-8770: - Thanks [~walter.k.su] for the reference. This should be the same as

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.001.patch > Improve BlockPlacementPolicyDefault's picking of excess replicas >

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007005#comment-15007005 ] Xiao Chen commented on HDFS-9314: - Thanks [~mingma] for creating this, and nice work on HDFS-9313! Looks

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Assignee: Xiao Chen Status: Patch Available (was: Open) > Improve BlockPlacementPolicyDefault's

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9314: Attachment: HDFS-9314.002.patch Thanks [~zhz] for the prompt review! Attached patch 002 to address your

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007689#comment-15007689 ] Xiao Chen commented on HDFS-9314: - The test failures all seems unrelated. > Improve

[jira] [Commented] (HDFS-8770) ReplicationMonitor thread received Runtime exception: NullPointerException when BlockManager.chooseExcessReplicates

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002599#comment-15002599 ] Xiao Chen commented on HDFS-8770: - Hi [~aderen], Thanks for reporting the issue and providing a patch. The

[jira] [Created] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-10 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9410: --- Summary: TestDFSAdminWithHA#tearDown may throw NPE Key: HDFS-9410 URL: https://issues.apache.org/jira/browse/HDFS-9410 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999850#comment-14999850 ] Xiao Chen commented on HDFS-9410: - Attached patch 001 for the fix. > TestDFSAdminWithHA#tearDown may throw

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.001.patch > TestDFSAdminWithHA#tearDown may throw NPE >

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Patch Available (was: Open) > TestDFSAdminWithHA#tearDown may throw NPE >

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Description: If for any reason {{setUpHaCluster}} fails before storing {{System.out}} and {{System.err}} as

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-7553: Attachment: HDFS-7553.002.patch > fix the TestDFSUpgradeWithHA due to BindException >

[jira] [Commented] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2015-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997637#comment-14997637 ] Xiao Chen commented on HDFS-7553: - I came across the same error: *Error Message* Port in use:

[jira] [Assigned] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-9344: --- Assignee: Xiao Chen (was: Jagadesh Kiran N) > QUEUE_WITH_CORRUPT_BLOCKS is no longer needed >

[jira] [Commented] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981969#comment-14981969 ] Xiao Chen commented on HDFS-9344: - Thanks for creating the JIRA Zhe. I'll be working on it. >

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Status: Patch Available (was: Open) > Unnecessary DNS resolution attempts when NameNodeProxies >

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Attachment: HDFS-9364.001.patch Patch 001 fixes the unnecessary DNS resolution by checking against

[jira] [Updated] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9351: Attachment: HDFS-9351.patch Thanks very much for the additional review and creating this JIRA. Good catch! I

[jira] [Updated] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9351: Status: Patch Available (was: Open) > No checkNNStartup() is called when fsck calls >

[jira] [Commented] (HDFS-9231) fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990628#comment-14990628 ] Xiao Chen commented on HDFS-9231: - Thanks [~liuml07] and [~yzhangal], and sorry for the findbugs miss. >

[jira] [Commented] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990634#comment-14990634 ] Xiao Chen commented on HDFS-9377: - Thanks very much for the work guys! I added a link to the original JIRA,

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Summary: Unnecessary DNS resolution attempts when creating NameNodeProxies (was: Unnecessary DNS resolution

[jira] [Commented] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987757#comment-14987757 ] Xiao Chen commented on HDFS-9351: - Thanks Yongjun! > No checkNNStartup() is called when fsck calls >

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14991939#comment-14991939 ] Xiao Chen commented on HDFS-9364: - Thanks [~zhz] for the review! bq. Is there a downside of always doing

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Attachment: HDFS-9364.004.patch > Unnecessary DNS resolution attempts when creating NameNodeProxies >

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994859#comment-14994859 ] Xiao Chen commented on HDFS-9364: - Thanks [~zhz], attached patch 4 with the fix. > Unnecessary DNS

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Status: Patch Available (was: Open) > Unnecessary DNS resolution attempts when creating NameNodeProxies >

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Status: Open (was: Patch Available) > Unnecessary DNS resolution attempts when creating NameNodeProxies >

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Attachment: HDFS-9364.003.patch > Unnecessary DNS resolution attempts when creating NameNodeProxies >

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-04 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989862#comment-14989862 ] Xiao Chen commented on HDFS-9364: - Thanks for the quick response [~andreina]. I initially meant a more

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Attachment: HDFS-9364.002.patch Thanks for the review [~andreina]! Attached patch 002. 1. Makes sense,

[jira] [Assigned] (HDFS-2746) Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary storage dir

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-2746: --- Assignee: Xiao Chen > Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary >

[jira] [Commented] (HDFS-2746) Add a parameter to `hdfs dfsadmin -saveNamespace' to allow an arbitrary storage dir

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983502#comment-14983502 ] Xiao Chen commented on HDFS-2746: - Thanks ATM and Harsh for creating this issue and clarifying. This sounds

[jira] [Commented] (HDFS-9351) No checkNNStartup() is called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986495#comment-14986495 ] Xiao Chen commented on HDFS-9351: - The findbugs warning / test failures / asflicense are unrelated. This

[jira] [Created] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9364: --- Summary: Unnecessary DNS resolution attempts when NameNodeProxies Key: HDFS-9364 URL: https://issues.apache.org/jira/browse/HDFS-9364 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9364) Unnecessary DNS resolution attempts when NameNodeProxies

2015-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986478#comment-14986478 ] Xiao Chen commented on HDFS-9364: - Example stacktrace: {noformat} at

[jira] [Updated] (HDFS-9364) Unnecessary DNS resolution attempts when creating NameNodeProxies

2015-11-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9364: Component/s: performance ha > Unnecessary DNS resolution attempts when creating

[jira] [Commented] (HDFS-9329) TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983124#comment-14983124 ] Xiao Chen commented on HDFS-9329: - Hi [~zhz], thanks for fixing this! It makes sense and I'm mostly reading

[jira] [Commented] (HDFS-9344) QUEUE_WITH_CORRUPT_BLOCKS is no longer needed

2015-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983582#comment-14983582 ] Xiao Chen commented on HDFS-9344: - After some investigation, although {{QUEUE_WITH_CORRUPT_BLOCKS}} is not

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Patch Available (was: Open) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Attachment: HDFS-9231.002.patch Patch 002 addresses the test failure. The findbugs warning seems odd. >

[jira] [Updated] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9231: Status: Open (was: Patch Available) > fsck doesn't explicitly list when Bad Replicas/Blocks are in a

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-18 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Patch Available (was: Open) > ssl-server.xml causes NullPointer > -

[jira] [Commented] (HDFS-9231) fsck doesn't explicitly list when Bad Replicas/Blocks are in a snapshot

2015-10-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956329#comment-14956329 ] Xiao Chen commented on HDFS-9231: - Attached patch 001. Description below: * fsck from command line with

  1   2   3   4   5   6   7   8   9   10   >