[jira] [Commented] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2017-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148492#comment-16148492 ] Zhe Zhang commented on HDFS-12379: -- Pinging [~daryn] [~wheat9] [~kihwal] for opinions based on HDFS-11641

[jira] [Created] (HDFS-12379) NameNode getListing should use FileStatus instead of HdfsFileStatus

2017-08-30 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-12379: Summary: NameNode getListing should use FileStatus instead of HdfsFileStatus Key: HDFS-12379 URL: https://issues.apache.org/jira/browse/HDFS-12379 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-30 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-11964: Attachment: HDFS-11964.3.patch Thanks for the review, [~drankye]! I uploaded a new patch

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148448#comment-16148448 ] Hadoop QA commented on HDFS-12359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Status: Patch Available (was: Open) > Ozone: Implement TopN container choosing policy for

[jira] [Updated] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12370: - Attachment: HDFS-12370-HDFS-7240.001.patch > Ozone: Implement TopN container choosing policy for

[jira] [Commented] (HDFS-12370) Ozone: Implement TopN container choosing policy for BlockDeletionService

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148428#comment-16148428 ] Yiqun Lin commented on HDFS-12370: -- Attach initial patch. > Ozone: Implement TopN container choosing

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12363: - Target Version/s: 3.0.0-beta1 (was: 2.9.0, 3.0.0-beta1, 2.6.6, 2.8.3, 2.7.5) > Possible NPE in

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148387#comment-16148387 ] Xiao Chen commented on HDFS-12363: -- Failed tests are not related to the changes here. The intersections

[jira] [Created] (HDFS-12378) TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk

2017-08-30 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12378: Summary: TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk Key: HDFS-12378 URL: https://issues.apache.org/jira/browse/HDFS-12378 Project: Hadoop

[jira] [Updated] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12359: - Attachment: HDFS-12359.02.patch > Re-encryption should operate with minimum KMS ACL requirements. >

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148375#comment-16148375 ] Xiao Chen commented on HDFS-12359: -- Thanks for the review Wei-Chiu, added a few specific checks in patch

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148354#comment-16148354 ] Andrew Wang commented on HDFS-12377: I think we're hitting the surefire timeout (15min) vs. the junit

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Description: We should tag the hadoop/hdfs config so that we can retrieve properties by there

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148330#comment-16148330 ] Kai Zheng commented on HDFS-11882: -- Travel today. Please expect slow response. > Client fails if

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148329#comment-16148329 ] Andrew Wang commented on HDFS-11882: Amazingly, I think these are all flakes. HDFS-12360 tracks the

[jira] [Comment Edited] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148139#comment-16148139 ] Yongjun Zhang edited comment on HDFS-12357 at 8/31/17 1:14 AM: --- Thanks you

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148291#comment-16148291 ] Hadoop QA commented on HDFS-12377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148269#comment-16148269 ] Hadoop QA commented on HDFS-10787: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148249#comment-16148249 ] Kai Zheng commented on HDFS-7859: - We want to stabilize the API before BETA 1, that includes API names. I'm

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148241#comment-16148241 ] Kai Zheng commented on HDFS-7859: - bq. Are only the number of policies persisted? It looks off to me. It

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148223#comment-16148223 ] Hanisha Koneru commented on HDFS-12376: --- Hi [~jingzhao], please let me know your thoughts on this.

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148221#comment-16148221 ] Hanisha Koneru commented on HDFS-12376: --- The test failures look unrelated. > Enable JournalNode

[jira] [Updated] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2017-08-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9107: -- Fix Version/s: 2.7.5 2.9.0 Pushed to branch-2.7. Only a minor

[jira] [Created] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-30 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-12377: -- Summary: Refactor TestReadStripedFileWithDecoding to avoid test timeouts Key: HDFS-12377 URL: https://issues.apache.org/jira/browse/HDFS-12377 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Attachment: HDFS-12377.001.patch Patch attached. > Refactor TestReadStripedFileWithDecoding to avoid

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Status: Patch Available (was: Open) > Refactor TestReadStripedFileWithDecoding to avoid test

[jira] [Updated] (HDFS-8797) WebHdfsFileSystem creates too many connections for pread

2017-08-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8797: -- Fix Version/s: 2.7.5 2.9.0 Pushed to branch-2.7. Only a minor

[jira] [Commented] (HDFS-9153) Pretty-format the output for DFSIO

2017-08-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148138#comment-16148138 ] Konstantin Shvachko commented on HDFS-9153: --- Committed to branch-2.7 along with MAPREDUCE-6931.

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148139#comment-16148139 ] Yongjun Zhang commented on HDFS-12357: -- Thanks you all for the review and comments! [~atm]: good

[jira] [Updated] (HDFS-9153) Pretty-format the output for DFSIO

2017-08-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9153: -- Fix Version/s: 2.7.5 2.9.0 > Pretty-format the output for DFSIO >

[jira] [Commented] (HDFS-12373) Trying to construct Path for a file that has colon (":") throws IllegalArgumentException

2017-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148083#comment-16148083 ] Chen Liang commented on HDFS-12373: --- This seems to be intentional. {{DFSUtilClient.isValidName}} is

[jira] [Commented] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148068#comment-16148068 ] Hadoop QA commented on HDFS-12376: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148062#comment-16148062 ] Manoj Govindassamy commented on HDFS-12357: --- [~yzhangal], Here is one other jira on the

[jira] [Updated] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12376: -- Attachment: HDFS-12376.001.patch > Enable JournalNode Sync by default >

[jira] [Updated] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12376: -- Status: Patch Available (was: Open) > Enable JournalNode Sync by default >

[jira] [Created] (HDFS-12376) Enable JournalNode Sync by default

2017-08-30 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-12376: - Summary: Enable JournalNode Sync by default Key: HDFS-12376 URL: https://issues.apache.org/jira/browse/HDFS-12376 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147765#comment-16147765 ] Hadoop QA commented on HDFS-12363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12356) Unit test for JournalNode sync during Rolling Upgrade

2017-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147706#comment-16147706 ] Hudson commented on HDFS-12356: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12276 (See

[jira] [Reopened] (HDFS-11294) libhdfs++: Segfault in HA failover if DNS lookup for both Namenodes fails

2017-08-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reopened HDFS-11294: Reopening. Looks like this is a real issue that existing tests weren't hitting. Given an HA

[jira] [Updated] (HDFS-12356) Unit test for JournalNode sync during Rolling Upgrade

2017-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12356: - Summary: Unit test for JournalNode sync during Rolling Upgrade (was: Unit test for JN sync

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

2017-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12356: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status:

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

2017-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12356: - Component/s: ha > Unit test for JN sync during Rolling Upgrade >

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

2017-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147640#comment-16147640 ] Arpit Agarwal commented on HDFS-12356: -- +1 The UT failures are clearly unrelated. I will commit the

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

2017-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147611#comment-16147611 ] Erik Krogen commented on HDFS-11069: Ah, thank you for the context, Kihwal. I am too new for that :)

[jira] [Commented] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-08-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147612#comment-16147612 ] Kihwal Lee commented on HDFS-12372: --- As you can see from the code, issuing command as a hdfs admin user

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147604#comment-16147604 ] Ajay Kumar commented on HDFS-12350: --- [~anu],[~xyao],[~arpitagarwal] Please review the patch. > Support

[jira] [Commented] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-08-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147594#comment-16147594 ] Kihwal Lee commented on HDFS-12372: --- You should not run datanode as a hdfs superuser. Many examples

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

2017-08-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147586#comment-16147586 ] Kihwal Lee commented on HDFS-11069: --- [~xkrogen]. Fixed. Once it was a convention to not include

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12336: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.3 2.9.0

[jira] [Updated] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12372: --- Target Version/s: 2.9.0, 2.8.2, 3.0.0 > Document the impact of HDFS-11069 (Tighten the

[jira] [Updated] (HDFS-12372) Document the impact of HDFS-11069 (Tighten the authorization of datanode RPC)

2017-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12372: --- Affects Version/s: 2.9.0 2.8.0 2.7.4

[jira] [Updated] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-30 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10787: - Attachment: HDFS-10787.HDFS-8707.003.patch Thanks for the reveiw, [~James C]. * In the new patch

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147553#comment-16147553 ] Xiaoyu Yao commented on HDFS-10234: --- Thanks [~linyiqun] for the update. Patch v5 looks good to me. +1.

[jira] [Updated] (HDFS-11069) Tighten the authorization of datanode RPC

2017-08-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11069: -- Fix Version/s: 2.8.0 2.9.0 > Tighten the authorization of datanode RPC >

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147523#comment-16147523 ] Hadoop QA commented on HDFS-12350: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11069) Tighten the authorization of datanode RPC

2017-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147517#comment-16147517 ] Wei-Chiu Chuang commented on HDFS-11069: Hi [~kihwal], I'm just curious, for security concerns,

[jira] [Commented] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147445#comment-16147445 ] Hadoop QA commented on HDFS-12100: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-30 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147443#comment-16147443 ] Ruslan Dautkhanov commented on HDFS-12339: -- We think this might be the root cause for nfs clients

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.02.patch > Support meta tags in configs > > >

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-30 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147308#comment-16147308 ] Wellington Chevreuil commented on HDFS-12336: - Had a look at last build failed tests, don't

[jira] [Assigned] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12235: -- Assignee: Weiwei Yang (was: Yuanbo Liu) > Ozone: DeleteKey-3: KSM SCM block deletion message

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-08-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147261#comment-16147261 ] Weiwei Yang commented on HDFS-12235: Hi [~yuanbo] Thanks for the updated patch, your change mostly

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-08-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147258#comment-16147258 ] Daryn Sharp commented on HDFS-12357: Should this perhaps be implemented in the external attribute

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-30 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12100: --- Status: Patch Available (was: Open) > Ozone: KSM: Allocate key should honour volume quota if quota

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-30 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12100: --- Attachment: HDFS-12100-HDFS-7240.001.patch This patch adds functionality for volume quota to be

[jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147236#comment-16147236 ] Hadoop QA commented on HDFS-11799: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147130#comment-16147130 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147119#comment-16147119 ] Hadoop QA commented on HDFS-10234: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10234: - Attachment: HDFS-10234.005.patch Failed test is related. Attach the new patch to fix this. > DistCp log

[jira] [Updated] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11799: Attachment: HDFS-11799-005.patch Uploaded the patch to address above comments. now

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147051#comment-16147051 ] Hadoop QA commented on HDFS-10234: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147009#comment-16147009 ] Yiqun Lin commented on HDFS-10234: -- Thanks for the review, [~xyao]! Attach the updated patch to address

[jira] [Updated] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10234: - Attachment: HDFS-10234.004.patch > DistCp log output should contain copied and deleted files and

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-30 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Attachment: HDFS-12336-branch-2.001.patch Thanks a lot [~xiaochen] for the help

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146892#comment-16146892 ] SammiChen commented on HDFS-7859: - [~eddyxu] mentioned upgrade and downgrade, it's a good question. Not

[jira] [Assigned] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-30 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12339: Assignee: Mukul Kumar Singh > NFS Gateway on Shutdown Gives Unregistration

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146844#comment-16146844 ] Hudson commented on HDFS-12258: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12272 (See

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146836#comment-16146836 ] Hadoop QA commented on HDFS-12350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12258: Attachment: HDFS-12258-07.patch > ec -listPolicies should list all policies in system, no matter it's

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146833#comment-16146833 ] Hadoop QA commented on HDFS-12350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12258: Resolution: Fixed Hadoop Flags: Incompatible change Fix Version/s: 3.0.0-beta1

[jira] [Comment Edited] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146814#comment-16146814 ] Rakesh R edited comment on HDFS-12258 at 8/30/17 7:37 AM: -- Thanks [~zhouwei] for

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146814#comment-16146814 ] Rakesh R commented on HDFS-12258: - Thanks [~zhouwei] for the contribution. +1 LGTM > ec -listPolicies

[jira] [Created] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2017-08-30 Thread Wenxin He (JIRA)
Wenxin He created HDFS-12375: Summary: Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. Key: HDFS-12375 URL: https://issues.apache.org/jira/browse/HDFS-12375 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146778#comment-16146778 ] Hadoop QA commented on HDFS-12350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11066) Improve test coverage for ISA-L native coder

2017-08-30 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang reassigned HDFS-11066: --- Assignee: Huafeng Wang > Improve test coverage for ISA-L native coder >

[jira] [Created] (HDFS-12374) Document the missing -ns option of haadmin.

2017-08-30 Thread Wenxin He (JIRA)
Wenxin He created HDFS-12374: Summary: Document the missing -ns option of haadmin. Key: HDFS-12374 URL: https://issues.apache.org/jira/browse/HDFS-12374 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.01.patch > Support meta tags in configs > > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: (was: HDFS-12350.01.patch) > Support meta tags in configs >

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146708#comment-16146708 ] Kai Zheng commented on HDFS-11964: -- Hi [~tasanuma0829], Thanks for your update digging into the deep. I

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: (was: HDFS-12350.01.patch) > Support meta tags in configs >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-30 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Attachment: HDFS-12350.01.patch > Support meta tags in configs > > >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-08-30 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146700#comment-16146700 ] SammiChen commented on HDFS-7859: - Hi [~eddyxu], thanks for reviewing the patch! Persist erasure coding

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146677#comment-16146677 ] Mingliang Liu commented on HDFS-12363: -- The unit tests failures seem not related, can you confirm? If