[jira] [Commented] (HDFS-13093) Quota set don't compute usage of unspecified storage policy content

2018-01-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348128#comment-16348128 ] liaoyuxiangqin commented on HDFS-13093: --- Thanks [~xyao] review this and give detail reason

[jira] [Commented] (HDFS-12897) getErasureCodingPolicy should handle .snapshot dir better

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348129#comment-16348129 ] Hudson commented on HDFS-12897: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13597 (See

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348115#comment-16348115 ] Hudson commented on HDFS-13060: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13596 (See

[jira] [Updated] (HDFS-12897) getErasureCodingPolicy should handle .snapshot dir better

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12897: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 3.1.0

[jira] [Commented] (HDFS-12897) getErasureCodingPolicy should handle .snapshot dir better

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348107#comment-16348107 ] Xiao Chen commented on HDFS-12897: -- +1 on patch 5, failed tests are not related to the change here.

[jira] [Updated] (HDFS-12897) Path not found when getErasureCodingPolicy on a .snapshot dir

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12897: - Summary: Path not found when getErasureCodingPolicy on a .snapshot dir (was: Path not found when we get

[jira] [Updated] (HDFS-12897) getErasureCodingPolicy should handle .snapshot dir better

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12897: - Summary: getErasureCodingPolicy should handle .snapshot dir better (was: Path not found when

[jira] [Updated] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13060: -- Component/s: security datanode > Adding a BlacklistBasedTrustedChannelResolver for

[jira] [Updated] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13060: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved

[jira] [Commented] (HDFS-13095) Improve slice tree traversal implementation

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348072#comment-16348072 ] Xiao Chen commented on HDFS-13095: -- I think it's also arguable whether snapshots should be supported for

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Fix Version/s: 2.7.6 > ReplicationMonitor thread could stuck for long time due to the race between >

[jira] [Commented] (HDFS-12897) Path not found when we get the ec policy for a .snapshot dir

2018-01-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348058#comment-16348058 ] Rakesh R commented on HDFS-12897: - Thanks [~GeLiXin], good unit test cases. +1 latest patch looks good to

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348057#comment-16348057 ] Xiaoyu Yao commented on HDFS-13060: --- +1 for v3 patch. I'll fix the minor checkstyle comment issue upon

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348056#comment-16348056 ] He Xiaoqiao commented on HDFS-10453: [~ajayydv] Thank you for your suggestion,  I just attach new

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348053#comment-16348053 ] genericqa commented on HDFS-13068: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.006.patch > ReplicationMonitor thread could stuck for long time due

[jira] [Commented] (HDFS-13093) Quota set don't compute usage of unspecified storage policy content

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348042#comment-16348042 ] Xiaoyu Yao commented on HDFS-13093: --- Thanks [~liaoyuxiangqin] for reporting this. This could relate to

[jira] [Commented] (HDFS-13095) Improve slice tree traversal implementation

2018-01-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348021#comment-16348021 ] Rakesh R commented on HDFS-13095: - Thank you [~xiaochen] for the quick reply. I understand that 

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Status: Patch Available (was: Open) > RBF: Add WebHDFS > > > Key:

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Status: Open (was: Patch Available) > RBF: Add WebHDFS > > > Key:

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347472#comment-16347472 ] Rakesh R edited comment on HDFS-10285 at 2/1/18 5:07 AM: - Thank you very much 

[jira] [Updated] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13092: - Affects Version/s: 3.0.0 Priority: Minor (was: Major) > Reduce verbosity for

[jira] [Updated] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13092: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 3.1.0

[jira] [Commented] (HDFS-7134) Replication count for a block should not update till the blocks have settled on Datanodes

2018-01-31 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347959#comment-16347959 ] liaoyuxiangqin commented on HDFS-7134: -- [~gurmukhd] I have test in hadoop 3.1.0, this issue no longer

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347949#comment-16347949 ] Yiqun Lin commented on HDFS-13043: -- Failed unit tests are not related. LGTM, +1. [~elgoiri], as the work

[jira] [Updated] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13068: - Attachment: HDFS-13068.003.patch > RBF: Add router admin option to manage safe mode >

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-31 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347945#comment-16347945 ] Yiqun Lin commented on HDFS-13068: -- Thanks for the review, [~elgoiri]. Attach the update patch to address

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347931#comment-16347931 ] genericqa commented on HDFS-13060: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12997) Move logging to slf4j in BlockPoolSliceStorage and Storage

2018-01-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347903#comment-16347903 ] Akira Ajisaka commented on HDFS-12997: -- +1, thanks Ajay. > Move logging to slf4j in

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: hdfs-file-composite-crc32-v3.pdf > Expose file-level composite CRCs in HDFS which are

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347851#comment-16347851 ] Dennis Huo commented on HDFS-13056: --- Uploaded initial end-to-end working draft against trunk which

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: HDFS-13056.001.patch > Expose file-level composite CRCs in HDFS which are comparable across

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347786#comment-16347786 ] genericqa commented on HDFS-13062: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13098) RBF: Datanodes interacting with Routers

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347783#comment-16347783 ] Íñigo Goiri commented on HDFS-13098: Currently, we do the assignment of DNs to subclusters using

[jira] [Created] (HDFS-13098) RBF: Datanodes interacting with Routers

2018-01-31 Thread JIRA
Íñigo Goiri created HDFS-13098: -- Summary: RBF: Datanodes interacting with Routers Key: HDFS-13098 URL: https://issues.apache.org/jira/browse/HDFS-13098 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347764#comment-16347764 ] genericqa commented on HDFS-13097: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347753#comment-16347753 ] Ajay Kumar edited comment on HDFS-10453 at 1/31/18 11:12 PM: - Hi

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347753#comment-16347753 ] Ajay Kumar edited comment on HDFS-10453 at 1/31/18 11:11 PM: - Hi

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347753#comment-16347753 ] Ajay Kumar commented on HDFS-10453: --- Hi [~hexiaoqiao], Thanks for working on this. Patch looks good to

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347752#comment-16347752 ] genericqa commented on HDFS-13043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347747#comment-16347747 ] Hanisha Koneru commented on HDFS-13062: --- Thanks [~bharatviswa]. +1 for patch v06. Test failures are

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347728#comment-16347728 ] Ajay Kumar commented on HDFS-13060: --- added package-info file in patch v3 to address checkstyle issue. >

[jira] [Updated] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13060: -- Attachment: HDFS-13060.003.patch > Adding a BlacklistBasedTrustedChannelResolver for

[jira] [Commented] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347712#comment-16347712 ] genericqa commented on HDFS-13073: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347677#comment-16347677 ] genericqa commented on HDFS-13062: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12545) Autotune NameNode RPC handler threads according to number of datanodes in cluster

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12545: - Assignee: (was: Ajay Kumar) > Autotune NameNode RPC handler threads according to number of

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347625#comment-16347625 ] genericqa commented on HDFS-13060: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13095) Improve slice tree traversal implementation

2018-01-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347616#comment-16347616 ] Xiao Chen commented on HDFS-13095: -- Thanks [~rakeshr] for creating the Jira and [~daryn] for reviewing

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347614#comment-16347614 ] Ajay Kumar commented on HDFS-13060: --- [~xyao] thanks for review, created [HADOOP-15202] for "deprecation

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347601#comment-16347601 ] Ajay Kumar commented on HDFS-13061: --- [~xyao], thanks for review and commit. >

[jira] [Updated] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13043: --- Attachment: HDFS-13043.009.patch > RBF: Expose the state of the Routers in the federation >

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347575#comment-16347575 ] Surendra Singh Lilhore edited comment on HDFS-10285 at 1/31/18 8:38 PM:

[jira] [Updated] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13097: -- Status: Patch Available (was: Open) > [SPS]: Fix the branch review

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347575#comment-16347575 ] Surendra Singh Lilhore commented on HDFS-10285: --- Thanks [~daryn] for reviews. Create Part1

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347573#comment-16347573 ] Surendra Singh Lilhore commented on HDFS-13097: --- Attached v1 patch > [SPS]: Fix the branch

[jira] [Updated] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-13097: -- Attachment: HDFS-13097-HDFS-10285.01.patch > [SPS]: Fix the branch review

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347571#comment-16347571 ] Bharat Viswanadham commented on HDFS-13062: --- Hi [~hanishakoneru] Thanks for offline discussion

[jira] [Commented] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347569#comment-16347569 ] genericqa commented on HDFS-13043: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13062: -- Attachment: HDFS-13062.06.patch > Provide support for JN to use separate journal disk

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347565#comment-16347565 ] Surendra Singh Lilhore commented on HDFS-13097: --- Fixing below comments *Comment-1)*

[jira] [Created] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

2018-01-31 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-13097: - Summary: [SPS]: Fix the branch review comments(Part1) Key: HDFS-13097 URL: https://issues.apache.org/jira/browse/HDFS-13097 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2018-01-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-11419. -- Resolution: Done > BlockPlacementPolicyDefault is choosing datanode in an inefficient way >

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347525#comment-16347525 ] Wei Yan commented on HDFS-12512: Saw exceptions "java.lang.OutOfMemoryError: unable to create new native

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347510#comment-16347510 ] genericqa commented on HDFS-12512: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-13096) HDFS group quota

2018-01-31 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created HDFS-13096: Summary: HDFS group quota Key: HDFS-13096 URL: https://issues.apache.org/jira/browse/HDFS-13096 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2018-01-31 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347472#comment-16347472 ] Rakesh R commented on HDFS-10285: - Thank you very much [~daryn] for your time and useful

[jira] [Created] (HDFS-13095) Improve slice tree traversal implementation

2018-01-31 Thread Rakesh R (JIRA)
Rakesh R created HDFS-13095: --- Summary: Improve slice tree traversal implementation Key: HDFS-13095 URL: https://issues.apache.org/jira/browse/HDFS-13095 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347445#comment-16347445 ] Hudson commented on HDFS-13092: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13593 (See

[jira] [Updated] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13092: -- Issue Type: Improvement (was: Bug) > Reduce verbosity for ThrottledAsyncChecker.java:schedule

[jira] [Comment Edited] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347408#comment-16347408 ] Bharat Viswanadham edited comment on HDFS-13073 at 1/31/18 7:08 PM:

[jira] [Commented] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347416#comment-16347416 ] Hanisha Koneru commented on HDFS-13092: --- Committed to trunk and branch-3.0. > Reduce verbosity for

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347412#comment-16347412 ] Hudson commented on HDFS-13061: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13592 (See

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347407#comment-16347407 ] Dennis Huo commented on HDFS-13056: --- I ended up going with modifying the existing protocol, since

[jira] [Commented] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347408#comment-16347408 ] Bharat Viswanadham commented on HDFS-13073: --- Fixed checkstyle issues in patch v01. > Cleanup

[jira] [Updated] (HDFS-13073) Cleanup code in InterQJournalProtocol.proto

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13073: -- Attachment: HDFS-13073.01.patch > Cleanup code in InterQJournalProtocol.proto >

[jira] [Updated] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread Dennis Huo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dennis Huo updated HDFS-13056: -- Attachment: hdfs-file-composite-crc32-v2.pdf > Expose file-level composite CRCs in HDFS which are

[jira] [Commented] (HDFS-13058) Fix dfs.namenode.shared.edits.dir in TestJournalNode

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347402#comment-16347402 ] Bharat Viswanadham commented on HDFS-13058: --- Test failures are not related. Ran them locally,

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347397#comment-16347397 ] Xiaoyu Yao commented on HDFS-13060: --- Thanks [~ajayydv] for the update. Patch v2 LGTM, +1 pending

[jira] [Updated] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-13061: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved

[jira] [Commented] (HDFS-13092) Reduce verbosity for ThrottledAsyncChecker.java:schedule

2018-01-31 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347383#comment-16347383 ] Hanisha Koneru commented on HDFS-13092: --- Thanks for the patch, [~msingh]. LGTM. Test failures are

[jira] [Created] (HDFS-13094) Refactor TestJournalNode

2018-01-31 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-13094: - Summary: Refactor TestJournalNode Key: HDFS-13094 URL: https://issues.apache.org/jira/browse/HDFS-13094 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347375#comment-16347375 ] Bharat Viswanadham commented on HDFS-13062: --- Hi [~hanishakoneru] Thanks for review. Addressed

[jira] [Updated] (HDFS-13062) Provide support for JN to use separate journal disk per namespace

2018-01-31 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-13062: -- Attachment: HDFS-13062.05.patch > Provide support for JN to use separate journal disk

[jira] [Comment Edited] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread zhenzhao wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347281#comment-16347281 ] zhenzhao wang edited comment on HDFS-13056 at 1/31/18 6:44 PM: --- Thanks for

[jira] [Assigned] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2018-01-31 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-10453: Assignee: He Xiaoqiao > ReplicationMonitor thread could stuck for long time due to the

[jira] [Comment Edited] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347201#comment-16347201 ] Ajay Kumar edited comment on HDFS-13060 at 1/31/18 6:08 PM: [~xyao], thanks

[jira] [Commented] (HDFS-13056) Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts

2018-01-31 Thread zhenzhao wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347281#comment-16347281 ] zhenzhao wang commented on HDFS-13056: -- Thanks for the detailed info. Both adding new method and

[jira] [Comment Edited] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347274#comment-16347274 ] Xiaoyu Yao edited comment on HDFS-13061 at 1/31/18 5:55 PM: Thanks [~ajayydv]

[jira] [Commented] (HDFS-13061) SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel

2018-01-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347274#comment-16347274 ] Xiaoyu Yao commented on HDFS-13061: --- Thanks [~ajayydv] for the update. +1 for the v4 patch. The test

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347266#comment-16347266 ] Íñigo Goiri commented on HDFS-12512: [^HDFS-12512.004.patch] looks good. Waiting for Yetus to come

[jira] [Commented] (HDFS-13068) RBF: Add router admin option to manage safe mode

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347260#comment-16347260 ] Íñigo Goiri commented on HDFS-13068: [^HDFS-13068.002.patch] looks good other than the check style

[jira] [Updated] (HDFS-13043) RBF: Expose the state of the Routers in the federation

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13043: --- Attachment: HDFS-13043.008.patch > RBF: Expose the state of the Routers in the federation >

[jira] [Updated] (HDFS-12512) RBF: Add WebHDFS

2018-01-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-12512: --- Attachment: HDFS-12512.004.patch > RBF: Add WebHDFS > > > Key: HDFS-12512 >

[jira] [Updated] (HDFS-13044) RBF: Add a safe mode for the Router

2018-01-31 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13044: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1 2.9.1

[jira] [Commented] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347201#comment-16347201 ] Ajay Kumar commented on HDFS-13060: --- [~xyao], thanks for review. Updated patch v2 to address

[jira] [Updated] (HDFS-13060) Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver

2018-01-31 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13060: -- Attachment: HDFS-13060.002.patch > Adding a BlacklistBasedTrustedChannelResolver for

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-31 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346967#comment-16346967 ] Kihwal Lee commented on HDFS-11187: --- bq.  Not sure why yetus said it failed tests. Some tests failed to

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-01-31 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346942#comment-16346942 ] Wei-Chiu Chuang commented on HDFS-11187: the latest patch actually passed all tests. Not sure why

[jira] [Commented] (HDFS-12504) Ozone: Improve SQLCLI performance

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346858#comment-16346858 ] genericqa commented on HDFS-12504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12504) Ozone: Improve SQLCLI performance

2018-01-31 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain reassigned HDFS-12504: -- Assignee: Yuanbo Liu (was: Weiwei Yang) > Ozone: Improve SQLCLI performance >

  1   2   >