[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.01.patch > Support meta tags in configs > > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: (was: HDFS-12350.01.patch) > Support meta tags in configs >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.01.patch > Support meta tags in configs > > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: (was: HDFS-12350.01.patch) > Support meta tags in configs >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.01.patch > Support meta tags in configs > > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Status: Patch Available (was: Open) > Support meta tags in configs > > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Description: We should add meta tag extension to the hadoop/hdfs config so that we can retrieve

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Description: We should add meta tag extension to the hadoop/hdfs config so that we can retrieve

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-08-29 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146650#comment-16146650 ] Wei-Chiu Chuang commented on HDFS-12359: Thanks [~xiaochen]. I reviewed the patch 001. Looks good

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146646#comment-16146646 ] Hadoop QA commented on HDFS-12258: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file

2017-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146620#comment-16146620 ] Yongjun Zhang commented on HDFS-12191: -- Many thanks to [~manojg] for the review, committed to trunk

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file

2017-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146608#comment-16146608 ] Hadoop QA commented on HDFS-12235: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146607#comment-16146607 ] Hudson commented on HDFS-12336: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12269 (See

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146603#comment-16146603 ] Surendra Singh Lilhore commented on HDFS-12291: --- Failed tests are unrelated. Check-style and

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146583#comment-16146583 ] Xiao Chen commented on HDFS-12336: -- Committed this to trunk. [~wchevreuil], you're right, branch-2 patch

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12336: - Fix Version/s: 3.0.0-beta1 > Listing encryption zones still fails when deleted EZ is not a direct child

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12336: - Component/s: encryption > Listing encryption zones still fails when deleted EZ is not a direct child of

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146582#comment-16146582 ] Xiao Chen commented on HDFS-12336: -- Compared failed tests side-by-side, the only intersections are

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146552#comment-16146552 ] Xiao Chen commented on HDFS-12369: -- Following the above, we also brainstormed about other scenarios that

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-29 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12258: Attachment: HDFS-12258.07.patch Thanks [~rakeshr] for reviewing, doc updated based on the comments, thanks!

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146520#comment-16146520 ] Hadoop QA commented on HDFS-11882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-29 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12235: -- Attachment: HDFS-12235-HDFS-7240.003.patch [~cheersyang] Thanks for your review. The most important

[jira] [Work started] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11922 started by Weiwei Yang. -- > Ozone: KSM: Garbage collect deleted blocks >

[jira] [Created] (HDFS-12373) Trying to construct Path for a file that has colon (":") throws IllegalArgumentException

2017-08-29 Thread Vlad Rozov (JIRA)
Vlad Rozov created HDFS-12373: - Summary: Trying to construct Path for a file that has colon (":") throws IllegalArgumentException Key: HDFS-12373 URL: https://issues.apache.org/jira/browse/HDFS-12373

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146455#comment-16146455 ] Hadoop QA commented on HDFS-12369: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146426#comment-16146426 ] Hadoop QA commented on HDFS-12356: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Attachment: HDFS-11882.05.patch Thanks for the reviews all. Here's another patch rev. I had the wrong

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146411#comment-16146411 ] Hudson commented on HDFS-12191: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12267 (See

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146402#comment-16146402 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146400#comment-16146400 ] Lei (Eddy) Xu commented on HDFS-7859: - Hi, [~Sammi] Thanks for the latest patch. I have some questions

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-29 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146393#comment-16146393 ] Aaron T. Myers commented on HDFS-12357: --- Took a quick look at the patch, not thorough. One thing

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done to this file

2017-08-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Summary: Provide option to not capture the accessTime change of a file to snapshot if no other

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146299#comment-16146299 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.02.patch Chatted offline with [~yzhangal] and [~manojg]. We cannot remove the

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

2017-08-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12356: -- Attachment: HDFS-12356.003.patch Fixed the testSyncDuringRollingUpgrade intermittent failure in

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-29 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146254#comment-16146254 ] Andrew Wang commented on HDFS-12349: Thanks for working on this Eddy, nice supportability improvement.

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

2017-08-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146182#comment-16146182 ] Erik Krogen commented on HDFS-11069: Hey [~kihwal], it looks like you missed some fix versions (2.8.?

[jira] [Updated] (HDFS-11834) Ozone: Fix TestArchive#testArchive

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11834: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11834) Ozone: Fix TestArchive#testArchive

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146135#comment-16146135 ] Anu Engineer commented on HDFS-11834: - Had an offline chat with [~xyao]. He was kind enough to explain

[jira] [Updated] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12333: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Updated] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12366: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-08-29 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12372: -- Summary: Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC) Key: HDFS-12372 URL: https://issues.apache.org/jira/browse/HDFS-12372

[jira] [Commented] (HDFS-12366) Ozone: Refactor KSM metadata class names to avoid confusion

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146099#comment-16146099 ] Anu Engineer commented on HDFS-12366: - +1, I will commit this shortly. > Ozone: Refactor KSM

[jira] [Commented] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

2017-08-29 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146096#comment-16146096 ] Anu Engineer commented on HDFS-12333: - +1, I will commit this shortly. > Ozone: Extend Datanode web

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146067#comment-16146067 ] Xiao Chen commented on HDFS-12336: -- Patch 4 LGTM, thanks [~wchevreuil]. Failed tests look unrelated, but

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145946#comment-16145946 ] Hadoop QA commented on HDFS-12349: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-29 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145945#comment-16145945 ] George Huang commented on HDFS-11912: - Thank you so much [~manojg] and [~andrew.wang] for all the

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12117: - Issue Type: Improvement (was: New Feature) > HttpFS does not seem to support SNAPSHOT related methods

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145899#comment-16145899 ] Hudson commented on HDFS-11912: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12262 (See

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145885#comment-16145885 ] Manoj Govindassamy commented on HDFS-12191: --- LGTM, +1. Thanks [~yzhangal]. > Provide option to

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-29 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11912: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was:

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145775#comment-16145775 ] Xiaoyu Yao commented on HDFS-10234: --- Thanks [~linyiqun] for the update. The patch v3 looks pretty good

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-29 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Attachment: HDFS-12349.01.patch Fixed {{testAddBlockWhenNoSufficientDataBlockNumOfNodes}}

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145658#comment-16145658 ] Xiao Chen commented on HDFS-12291: -- Thanks for the ping Surendra, will take a look by Thursday. > [SPS]:

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12248: - Component/s: ha > SNN will not upload fsimage on IOE and Interrupted exceptions >

[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-29 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12248: - Component/s: namenode > SNN will not upload fsimage on IOE and Interrupted exceptions >

[jira] [Commented] (HDFS-12371) "BlockVerificationFailures" and "BlocksVerified" show up as 0 in Datanode JMX

2017-08-29 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145482#comment-16145482 ] Kihwal Lee commented on HDFS-12371: --- {{BlockPoolSliceScanner}} used to call {{incrBlocksVerified()}}.

[jira] [Moved] (HDFS-12371) "BlockVerificationFailures" and "BlocksVerified" show up as 0 in Datanode JMX

2017-08-29 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee moved HADOOP-14806 to HDFS-12371: Affects Version/s: (was: 2.7.1) 2.7.1

[jira] [Comment Edited] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-08-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145433#comment-16145433 ] Brahma Reddy Battula edited comment on HDFS-12136 at 8/29/17 3:00 PM: --

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-08-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145433#comment-16145433 ] Brahma Reddy Battula commented on HDFS-12136: - bq.so we could target 2.8.3 for the fix.

[jira] [Updated] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

2017-08-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12136: Target Version/s: 2.8.3 (was: 2.8.2) > BlockSender performance regression due to

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145334#comment-16145334 ] Hadoop QA commented on HDFS-12291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145293#comment-16145293 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12204) Dfsclient Do not close file descriptor when using shortcircuit

2017-08-29 Thread HanRyong,Jung (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145244#comment-16145244 ] HanRyong,Jung commented on HDFS-12204: -- RefCount of Hdfs ShortCircuitReplica has an initial value of

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145217#comment-16145217 ] Hadoop QA commented on HDFS-11964: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-29 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Attachment: HDFS-11964.2.patch I uploaded a new patch. This patch makes

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145158#comment-16145158 ] Surendra Singh Lilhore commented on HDFS-12291: --- Attached v2 patch. Please review. Thanks

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-02.patch > [SPS]: Provide a mechanism to

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Attachment: HDFS-12336.004.patch Thanks for the latest suggestions [~xiaochen]! All

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-29 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145064#comment-16145064 ] Rakesh R commented on HDFS-12258: - Thanks [~zhouwei] for the good work! Just realized that

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144993#comment-16144993 ] Weiwei Yang commented on HDFS-12367: Hi [~msingh] I was able to easily reproduce this yesterday but I

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144981#comment-16144981 ] Weiwei Yang commented on HDFS-12370: Thanks for filing this task, look forward for a patch. For those

[jira] [Commented] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144976#comment-16144976 ] Weiwei Yang commented on HDFS-12329: Hi [~msingh] The patch makes sense to me, I have 2 questions and

[jira] [Comment Edited] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144969#comment-16144969 ] Yiqun Lin edited comment on HDFS-12354 at 8/29/17 9:20 AM: --- Thanks weiwei, I

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144969#comment-16144969 ] Yiqun Lin commented on HDFS-12354: -- Thanks weiwei, I have filling the JIRA HDFS-12370 to track for the

[jira] [Commented] (HDFS-12367) Ozone: Too many open files error while running corona

2017-08-29 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144967#comment-16144967 ] Mukul Kumar Singh commented on HDFS-12367: -- Hi [~cheersyang], I did try to reproduce the issue

[jira] [Created] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-29 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12370: Summary: Ozone: Implement TopN container choosing policy for BlockDeletionService Key: HDFS-12370 URL: https://issues.apache.org/jira/browse/HDFS-12370 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12354: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144955#comment-16144955 ] Mukul Kumar Singh commented on HDFS-12354: -- Hi [~linyiqun] and [~cheersyang], I have added a

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144949#comment-16144949 ] Weiwei Yang commented on HDFS-12354: Thanks for confirming this, looks like TestKeys crashed the JVM.

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144893#comment-16144893 ] Yiqun Lin commented on HDFS-12354: -- I think ASF warning is not related with this change. I have met this

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-29 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144892#comment-16144892 ] Wei Zhou commented on HDFS-12258: - Thanks [~rakeshr] for reviewing the patch! The test failures are not

[jira] [Comment Edited] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144881#comment-16144881 ] Weiwei Yang edited comment on HDFS-12354 at 8/29/17 7:45 AM: - I just noticed

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144881#comment-16144881 ] Weiwei Yang commented on HDFS-12354: I just noticed there was an asflicense warning in latest jenkins

[jira] [Commented] (HDFS-12354) Ozone: Shuffle container list for datanode BlockDeletingService

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144875#comment-16144875 ] Weiwei Yang commented on HDFS-12354: +1 to v2 patch, non of those UT failures are related. I have

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144866#comment-16144866 ] Hadoop QA commented on HDFS-12191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144856#comment-16144856 ] Weiwei Yang commented on HDFS-12235: Hi [~yuanbo] Please see my comments below

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-29 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144821#comment-16144821 ] Surendra Singh Lilhore commented on HDFS-11968: --- Hi [~msingh], Thanks for the patch. I have

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144787#comment-16144787 ] Hadoop QA commented on HDFS-12369: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||