[jira] [Updated] (HDFS-14103) Review Logging of BlockPlacementPolicyDefault

2019-01-14 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-14103: --- Status: Open (was: Patch Available) > Review Logging of BlockPlacementPolicyDefault >

[jira] [Commented] (HDFS-14103) Review Logging of BlockPlacementPolicyDefault

2019-01-14 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742240#comment-16742240 ] BELUGA BEHR commented on HDFS-14103: [~ayushtkn] Thank you for the review! The difference here is

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742313#comment-16742313 ] Erik Krogen commented on HDFS-14186: [~kihwal] - Can you elaborate more on the below? How did you

[jira] [Updated] (HDFS-14192) Track Missing DFS Operations in Statistics And StorageStatistics

2019-01-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14192: Attachment: HDFS-14192-01.patch > Track Missing DFS Operations in Statistics And StorageStatistics

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742293#comment-16742293 ] Kihwal Lee commented on HDFS-14186: --- [~hexiaoqiao], one thing to note is that the rpc processing time

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742297#comment-16742297 ] Kihwal Lee commented on HDFS-14186: --- bq. Do you know what's the issue with lifeline? Lifeline is more

[jira] [Commented] (HDFS-14197) Invalid exit codes for invalid fsck report

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742185#comment-16742185 ] Hadoop QA commented on HDFS-14197: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-14192) Track Missing DFS Operations in Statistics And StorageStatistics

2019-01-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14192: Status: Patch Available (was: Open) > Track Missing DFS Operations in Statistics And

[jira] [Commented] (HDFS-14192) Track Missing DFS Operations in Statistics And StorageStatistics

2019-01-14 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742223#comment-16742223 ] Ayush Saxena commented on HDFS-14192: - Attached patch v1. Pls Review!!! > Track Missing DFS

[jira] [Updated] (HDFS-14103) Review Logging of BlockPlacementPolicyDefault

2019-01-14 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-14103: --- Attachment: HDFS-14103.2.patch > Review Logging of BlockPlacementPolicyDefault >

[jira] [Updated] (HDFS-14103) Review Logging of BlockPlacementPolicyDefault

2019-01-14 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-14103: --- Status: Patch Available (was: Open) > Review Logging of BlockPlacementPolicyDefault >

[jira] [Commented] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742259#comment-16742259 ] Hadoop QA commented on HDFS-14202: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742353#comment-16742353 ] Íñigo Goiri commented on HDFS-14186: {quote} Lifeline is more for working around datanode

[jira] [Commented] (HDFS-14192) Track Missing DFS Operations in Statistics And StorageStatistics

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742391#comment-16742391 ] Hadoop QA commented on HDFS-14192: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13507) RBF: Remove update functionality from routeradmin's add cmd

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742406#comment-16742406 ] Hadoop QA commented on HDFS-13507: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14103) Review Logging of BlockPlacementPolicyDefault

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742408#comment-16742408 ] Hadoop QA commented on HDFS-14103: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-14205) Backport HDFS-6440 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14205: - Summary: Backport HDFS-6440 to branch-2 Key: HDFS-14205 URL: https://issues.apache.org/jira/browse/HDFS-14205 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-14196) ArrayIndexOutOfBoundsException in JN metrics makes JN out of sync

2019-01-14 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742368#comment-16742368 ] Surendra Singh Lilhore commented on HDFS-14196: --- Thanks [~ste...@apache.org].

[jira] [Commented] (HDFS-14196) ArrayIndexOutOfBoundsException in JN metrics makes JN out of sync

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742491#comment-16742491 ] Steve Loughran commented on HDFS-14196: --- {{synchronized}} is a barrier: things don't get cached

[jira] [Commented] (HDFS-14083) libhdfs logs errors when opened FS doesn't support ByteBufferReadable

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742487#comment-16742487 ] Steve Loughran commented on HDFS-14083: --- thanks. As usual, hit "cancel patch" and then "submit

[jira] [Updated] (HDFS-13507) RBF: Remove update functionality from routeradmin's add cmd

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13507: --- Attachment: HDFS-13507-HDFS-13891.004.patch > RBF: Remove update functionality from routeradmin's

[jira] [Created] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-14204: - Summary: Backport HDFS-12943 to branch-2 Key: HDFS-14204 URL: https://issues.apache.org/jira/browse/HDFS-14204 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-13507) RBF: Remove update functionality from routeradmin's add cmd

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13507: --- Hadoop Flags: Incompatible change > RBF: Remove update functionality from routeradmin's add cmd >

[jira] [Commented] (HDFS-13576) RBF: Add destination path length validation for add/update mount entry

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742377#comment-16742377 ] Íñigo Goiri commented on HDFS-13576: Can we add the unit test for this? > RBF: Add destination path

[jira] [Updated] (HDFS-14204) Backport HDFS-12943 to branch-2

2019-01-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-14204: -- External issue ID: hdfs-12943 > Backport HDFS-12943 to branch-2 > --- > >

[jira] [Commented] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742340#comment-16742340 ] Íñigo Goiri commented on HDFS-14202: The failed unit test seems to be related to

[jira] [Commented] (HDFS-13811) RBF: Race condition between router admin quota update and periodic quota update service

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742375#comment-16742375 ] Íñigo Goiri commented on HDFS-13811: [~dibyendu_hadoop] can you tackle [~linyiqun]'s comments? >

[jira] [Updated] (HDFS-13507) RBF: Remove update functionality from routeradmin's add cmd

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13507: --- Attachment: HDFS-13507-HDFS-13891.003.patch > RBF: Remove update functionality from routeradmin's

[jira] [Commented] (HDFS-13506) RBF: Create destination directory when adding mount entry using router admin cmds.

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742396#comment-16742396 ] Íñigo Goiri commented on HDFS-13506: HDFS-13326 is completed and I updated HDFS-13507 to see if we

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742577#comment-16742577 ] Hadoop QA commented on HDDS-960: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDDS-977) Exclude dependency-reduced-pom.xml from ozone rat check

2019-01-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-977?focusedWorklogId=185055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185055 ] ASF GitHub Bot logged work on HDDS-977: --- Author: ASF GitHub Bot

[jira] [Updated] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-960: Issue Type: Sub-task (was: New Feature) Parent: HDDS-4 > Add cli command option for

[jira] [Updated] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-960: Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742516#comment-16742516 ] Bharat Viswanadham commented on HDDS-960: - Thank You [~dineshchitlangia] for addressing the review

[jira] [Comment Edited] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742518#comment-16742518 ] Bharat Viswanadham edited comment on HDDS-960 at 1/14/19 9:45 PM: -- Hi

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742540#comment-16742540 ] Dinesh Chitlangia commented on HDDS-960: [~bharatviswa] Attached patch 05 with docs. > Add cli

[jira] [Work logged] (HDDS-977) Exclude dependency-reduced-pom.xml from ozone rat check

2019-01-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-977?focusedWorklogId=185054=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185054 ] ASF GitHub Bot logged work on HDDS-977: --- Author: ASF GitHub Bot

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742601#comment-16742601 ] Bharat Viswanadham commented on HDDS-960: - +1 LGTM. A minor comment in the doc, user must should

[jira] [Comment Edited] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742601#comment-16742601 ] Bharat Viswanadham edited comment on HDDS-960 at 1/15/19 12:04 AM: --- +1

[jira] [Commented] (HDDS-977) Exclude dependency-reduced-pom.xml from ozone rat check

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742612#comment-16742612 ] Bharat Viswanadham commented on HDDS-977: - +1 LGTM. I will commit this shortly. > Exclude

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742518#comment-16742518 ] Bharat Viswanadham commented on HDDS-960: - Hi [~dineshchitlangia] One thing is missed in this Jira,

[jira] [Updated] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-960: --- Attachment: HDDS-960-HDDS-4.05.patch > Add cli command option for getS3Secret >

[jira] [Commented] (HDFS-13507) RBF: Remove update functionality from routeradmin's add cmd

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742544#comment-16742544 ] Hadoop QA commented on HDFS-13507: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDDS-977) Exclude dependency-reduced-pom.xml from ozone rat check

2019-01-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-977: Resolution: Fixed Fix Version/s: 0.4.0 Status: Resolved (was: Patch

[jira] [Commented] (HDDS-960) Add cli command option for getS3Secret

2019-01-14 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742651#comment-16742651 ] Dinesh Chitlangia commented on HDDS-960: Thanks all for review and [~bharatviswa] for commit. >

[jira] [Updated] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiangheng updated HDFS-14130: - Attachment: (was: HDFS-14130-HDFS-12943.002.patch) > Make ZKFC ObserverNode aware >

[jira] [Updated] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiangheng updated HDFS-14130: - Attachment: HDFS-14130-HDFS-12943.002.patch > Make ZKFC ObserverNode aware >

[jira] [Updated] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiangheng updated HDFS-14130: - Attachment: HDFS-14130-HDFS-12943.004.patch > Make ZKFC ObserverNode aware >

[jira] [Comment Edited] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742706#comment-16742706 ] xiangheng edited comment on HDFS-14130 at 1/15/19 3:28 AM: --- hey [~shv],I'm

[jira] [Commented] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742710#comment-16742710 ] Hadoop QA commented on HDFS-14206: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742740#comment-16742740 ] He Xiaoqiao commented on HDFS-14186: some more information, when I try to set

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14206: --- Description: The quota part needs some cleanup. > RBF: Cleanup quota modules >

[jira] [Created] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
Íñigo Goiri created HDFS-14206: -- Summary: RBF: Cleanup quota modules Key: HDFS-14206 URL: https://issues.apache.org/jira/browse/HDFS-14206 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Assigned] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HDFS-14206: -- Assignee: Íñigo Goiri > RBF: Cleanup quota modules > -- > >

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14206: --- Attachment: HDFS-14206-HDFS-13891.000.patch > RBF: Cleanup quota modules >

[jira] [Commented] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742692#comment-16742692 ] Yiqun Lin commented on HDFS-14206: -- Thanks [~elgoiri] for the clean-up work! Almost looks good to me,

[jira] [Commented] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742719#comment-16742719 ] Íñigo Goiri commented on HDFS-14206: Thanks [~linyiqun] for checking; uploaded

[jira] [Commented] (HDDS-977) Exclude dependency-reduced-pom.xml from ozone rat check

2019-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742623#comment-16742623 ] Hudson commented on HDDS-977: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15772 (See

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14206: --- Attachment: HDFS-14206-HDFS-13891.001.patch > RBF: Cleanup quota modules >

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14206: --- Status: Patch Available (was: Open) > RBF: Cleanup quota modules > -- > >

[jira] [Commented] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742706#comment-16742706 ] xiangheng commented on HDFS-14130: -- hey [~shv],I'm sorry I'm sick these days.Thanks for your

[jira] [Updated] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread xiangheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiangheng updated HDFS-14130: - Attachment: HDFS-14130-HDFS-12943.005.patch > Make ZKFC ObserverNode aware >

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14206: --- Attachment: HDFS-14206-HDFS-13891.002.patch > RBF: Cleanup quota modules >

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742738#comment-16742738 ] He Xiaoqiao commented on HDFS-14186: Thanks further discussing. I would like to answer some doubts

[jira] [Commented] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742746#comment-16742746 ] Hadoop QA commented on HDFS-14206: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14130) Make ZKFC ObserverNode aware

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742749#comment-16742749 ] Hadoop QA commented on HDFS-14130: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742816#comment-16742816 ] He Xiaoqiao commented on HDFS-14186: [~elgoiri] Thanks for your comments. sorry for missing

[jira] [Work logged] (HDDS-764) Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-764?focusedWorklogId=185137=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185137 ] ASF GitHub Bot logged work on HDDS-764: --- Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-764) Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-764?focusedWorklogId=185139=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185139 ] ASF GitHub Bot logged work on HDDS-764: --- Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-764) Run S3 smoke tests with replication STANDARD.

2019-01-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-764?focusedWorklogId=185138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-185138 ] ASF GitHub Bot logged work on HDDS-764: --- Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14186) blockreport storm slow down namenode restart seriously in large cluster

2019-01-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742785#comment-16742785 ] Íñigo Goiri commented on HDFS-14186: For my own sanity, the path for the lifeline is the following: #

[jira] [Commented] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742780#comment-16742780 ] Yiqun Lin commented on HDFS-14206: -- LGTM, +1. Committing... > RBF: Cleanup quota modules >

[jira] [Updated] (HDFS-14206) RBF: Cleanup quota modules

2019-01-14 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-14206: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-13891 Status:

[jira] [Resolved] (HDFS-14014) Unable to change the state of DN to maintenance using dfs.hosts.maintenance

2019-01-14 Thread venkata ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata ramkumar resolved HDFS-14014. - Resolution: Not A Bug The property dfs.hosts.maintenance was given only in design

[jira] [Commented] (HDFS-13762) Support non-volatile storage class memory(SCM) in HDFS cache directives

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741865#comment-16741865 ] Hadoop QA commented on HDFS-13762: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14129) RBF: Create new policy provider for router

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741877#comment-16741877 ] Hadoop QA commented on HDFS-14129: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14061) Check if the cluster topology supports the EC policy before setting, enabling or adding it

2019-01-14 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kitti Nanasi updated HDFS-14061: Attachment: HDFS-14061.005.patch > Check if the cluster topology supports the EC policy before

[jira] [Updated] (HDFS-14197) Invalid exit codes for invalid fsck report

2019-01-14 Thread venkata ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata ramkumar updated HDFS-14197: Status: Patch Available (was: Open) > Invalid exit codes for invalid fsck report >

[jira] [Commented] (HDFS-14196) ArrayIndexOutOfBoundsException in JN metrics makes JN out of sync

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742004#comment-16742004 ] Ranith Sardar commented on HDFS-14196: -- [~daryn] , [~ste...@apache.org] , Please check it once. >

[jira] [Commented] (HDFS-14061) Check if the cluster topology supports the EC policy before setting, enabling or adding it

2019-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742022#comment-16742022 ] Hadoop QA commented on HDFS-14061: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14196) ArrayIndexOutOfBoundsException in JN metrics makes JN out of sync

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742070#comment-16742070 ] Steve Loughran commented on HDFS-14196: --- [~surendrasingh], [~RANith] what is your reasoning behind

[jira] [Commented] (HDFS-14201) Ability to disallow safemode NN to become active

2019-01-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741953#comment-16741953 ] Steve Loughran commented on HDFS-14201: --- Yetus & github PRs is really close to shipping, will need

[jira] [Commented] (HDFS-14195) OIV: print out storage policy id in oiv Delimited output

2019-01-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742009#comment-16742009 ] Adam Antal commented on HDFS-14195: --- Thanks for the patch [~suxingfate], good job. I have some general

[jira] [Created] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
Ranith Sardar created HDFS-14202: Summary: "dfs.disk.balancer.max.disk.throughputInMBperSec" property is working as per set value. Key: HDFS-14202 URL: https://issues.apache.org/jira/browse/HDFS-14202

[jira] [Commented] (HDFS-14203) Refactor OIV Delimited output entry building mechanism

2019-01-14 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741967#comment-16741967 ] Adam Antal commented on HDFS-14203: --- The proposed EntryBuilder can work the same as 

[jira] [Updated] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranith Sardar updated HDFS-14202: - Summary: "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set

[jira] [Commented] (HDFS-14197) Invalid exit codes for invalid fsck report

2019-01-14 Thread venkata ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741995#comment-16741995 ] venkata ramkumar commented on HDFS-14197: - Added the initial patch. Please review it. > Invalid

[jira] [Commented] (HDFS-14200) Add emptyTrash option to purge trash immediately

2019-01-14 Thread Stephen O'Donnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741970#comment-16741970 ] Stephen O'Donnell commented on HDFS-14200: -- Thinking about the listEncryptionZone issue, I see

[jira] [Commented] (HDFS-14061) Check if the cluster topology supports the EC policy before setting, enabling or adding it

2019-01-14 Thread Kitti Nanasi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741918#comment-16741918 ] Kitti Nanasi commented on HDFS-14061: - Thanks for the review [~jojochuang]! I will clean up the log

[jira] [Created] (HDFS-14203) Refactor OIV Delimited output entry building mechanism

2019-01-14 Thread Adam Antal (JIRA)
Adam Antal created HDFS-14203: - Summary: Refactor OIV Delimited output entry building mechanism Key: HDFS-14203 URL: https://issues.apache.org/jira/browse/HDFS-14203 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-14197) Invalid exit codes for invalid fsck report

2019-01-14 Thread venkata ramkumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] venkata ramkumar updated HDFS-14197: Attachment: HDFS-14197.001.patch > Invalid exit codes for invalid fsck report >

[jira] [Updated] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranith Sardar updated HDFS-14202: - Attachment: HDFS-14202.001.patch > "dfs.disk.balancer.max.disk.throughputInMBperSec" property is

[jira] [Commented] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742052#comment-16742052 ] Ranith Sardar commented on HDFS-14202: -- In DiskBalancer#copyBlocks method, "timeUsed" is calculated

[jira] [Comment Edited] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742052#comment-16742052 ] Ranith Sardar edited comment on HDFS-14202 at 1/14/19 1:17 PM: --- In

[jira] [Updated] (HDFS-14202) "dfs.disk.balancer.max.disk.throughputInMBperSec" property is not working as per set value.

2019-01-14 Thread Ranith Sardar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranith Sardar updated HDFS-14202: - Status: Patch Available (was: Open) > "dfs.disk.balancer.max.disk.throughputInMBperSec"