[jira] [Updated] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14697: --- Fix Version/s: 3.1.3 3.0.4 > Backport HDFS-14513 to branch-2 > ---

[jira] [Comment Edited] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901229#comment-16901229 ] Erik Krogen edited comment on HDFS-14697 at 8/6/19 4:51 PM: I

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901267#comment-16901267 ] Erik Krogen commented on HDFS-14513: I backported this to branch-3.2, and used the br

[jira] [Updated] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14513: --- Fix Version/s: 3.1.3 3.2.1 3.0.4 2.10.0 > FS

[jira] [Updated] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14697: --- Resolution: Fixed Fix Version/s: 2.10.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-14697) Backport HDFS-14513 to branch-2

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901229#comment-16901229 ] Erik Krogen commented on HDFS-14697: It looks like your build ran into some resource

[jira] [Commented] (HDFS-14694) Call recoverLease on DFSOutputStream close exception

2019-08-06 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901181#comment-16901181 ] Erik Krogen commented on HDFS-14694: I don't have cycles for a detailed review, but t

[jira] [Commented] (HDFS-14513) FSImage which is saving should be clean while NameNode shutdown

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899206#comment-16899206 ] Erik Krogen commented on HDFS-14513: [~elgoiri] [~hexiaoqiao] do you think this is a

[jira] [Comment Edited] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899147#comment-16899147 ] Erik Krogen edited comment on HDFS-14462 at 8/2/19 7:05 PM: T

[jira] [Updated] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14462: --- Resolution: Fixed Fix Version/s: 3.1.3 3.2.1 3.3.0

[jira] [Comment Edited] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899090#comment-16899090 ] Erik Krogen edited comment on HDFS-14370 at 8/2/19 5:58 PM: T

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899090#comment-16899090 ] Erik Krogen commented on HDFS-14370: Thanks [~vagarychen]! The description did mentio

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-08-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.003.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Commented] (HDFS-14281) Dynamometer Phase 2

2019-08-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898385#comment-16898385 ] Erik Krogen commented on HDFS-14281: Thanks [~pingsutw]! This is a great point. I'll

[jira] [Updated] (HDFS-14638) [Dynamometer] Fix scripts to refer to current build structure

2019-08-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14638: --- Description: The scripts within the Dynamometer build dirs all refer to the old distribution structu

[jira] [Commented] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-08-01 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898145#comment-16898145 ] Erik Krogen commented on HDFS-14462: {quote}With regards to item #6, try with resourc

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897456#comment-16897456 ] Erik Krogen commented on HDFS-14370: Uploaded v002 patch to address the checkstyle is

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.002.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897450#comment-16897450 ] Erik Krogen commented on HDFS-14034: [~csun] I looked quickly at the branch-2 backpor

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897319#comment-16897319 ] Erik Krogen commented on HDFS-14370: I don't really like treating empty values specia

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.001.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Commented] (HDFS-14662) Document the usage of the new Balancer "asService" parameter

2019-07-31 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897277#comment-16897277 ] Erik Krogen commented on HDFS-14662: [~zhangchen] thanks for tackling this! Can we al

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13783: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) I j

[jira] [Updated] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13783: --- Release Note: Adds a new parameter to the Balancer CLI, "-asService", to enable the process to be lon

[jira] [Comment Edited] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-07-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896462#comment-16896462 ] Erik Krogen edited comment on HDFS-14462 at 7/30/19 7:58 PM: -

[jira] [Commented] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-07-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896462#comment-16896462 ] Erik Krogen commented on HDFS-14462: Good find, thanks [~simbadzina]. I took a look a

[jira] [Commented] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895614#comment-16895614 ] Erik Krogen commented on HDFS-14370: Hey [~ayushtkn], thanks for taking a look. You r

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895611#comment-16895611 ] Erik Krogen commented on HDFS-12703: Marked the fix version of 2.10 here as this was

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14672: --- Fix Version/s: 2.10.0 > Backport HDFS-12703 to branch-2 > --- > >

[jira] [Updated] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14672: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Backport HDFS-12703 to branch-2

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895610#comment-16895610 ] Erik Krogen commented on HDFS-14672: Thanks [~hexiaoqiao] and [~elgoiri]! I just comm

[jira] [Updated] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12703: --- Fix Version/s: 3.0.4 2.10.0 > Exceptions are fatal to decommissioning monitor > --

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895609#comment-16895609 ] Erik Krogen commented on HDFS-13783: LGTM! Last ping for any of the watchers to take

[jira] [Updated] (HDFS-14639) [Dynamometer] Unnecessary duplicate bin directory appears in dist layout

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14639: --- Fix Version/s: 3.3.0 > [Dynamometer] Unnecessary duplicate bin directory appears in dist layout > ---

[jira] [Updated] (HDFS-14639) [Dynamometer] Unnecessary duplicate bin directory appears in dist layout

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14639: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Dynamometer] Unnecessary duplic

[jira] [Comment Edited] (HDFS-14639) [Dynamometer] Unnecessary duplicate bin directory appears in dist layout

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895574#comment-16895574 ] Erik Krogen edited comment on HDFS-14639 at 7/29/19 8:50 PM: -

[jira] [Commented] (HDFS-14639) [Dynamometer] Unnecessary duplicate bin directory appears in dist layout

2019-07-29 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16895574#comment-16895574 ] Erik Krogen commented on HDFS-14639: Thanks [~jojochuang]! > [Dynamometer] Unnecessa

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894132#comment-16894132 ] Erik Krogen commented on HDFS-14672: [~elgoiri] I wonder if you're interested in help

[jira] [Updated] (HDFS-14135) TestWebHdfsTimeouts Fails intermittently in trunk

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14135: --- Fix Version/s: (was: 3.1.3) (was: 3.2.1) > TestWebHdfsTimeouts Fails inter

[jira] [Commented] (HDFS-14135) TestWebHdfsTimeouts Fails intermittently in trunk

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894049#comment-16894049 ] Erik Krogen commented on HDFS-14135: Actually this broke all branches besides trunk.

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893983#comment-16893983 ] Erik Krogen commented on HDFS-13783: It looks like {{TestDirectoryScanner}} is alread

[jira] [Commented] (HDFS-14672) Backport HDFS-12703 to branch-2

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893911#comment-16893911 ] Erik Krogen commented on HDFS-14672: HDFS-14135 broke the build; I just reverted it,

[jira] [Updated] (HDFS-14135) TestWebHdfsTimeouts Fails intermittently in trunk

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14135: --- Fix Version/s: (was: 2.10.0) > TestWebHdfsTimeouts Fails intermittently in trunk > --

[jira] [Commented] (HDFS-14135) TestWebHdfsTimeouts Fails intermittently in trunk

2019-07-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893906#comment-16893906 ] Erik Krogen commented on HDFS-14135: [~iwasakims] and [~ayushtkn], this broke the bra

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893146#comment-16893146 ] Erik Krogen commented on HDFS-13783: [~zhangchen], thanks for the changes, it's looki

[jira] [Commented] (HDFS-12703) Exceptions are fatal to decommissioning monitor

2019-07-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893110#comment-16893110 ] Erik Krogen commented on HDFS-12703: Hey folks, this seems like an issue with pretty

[jira] [Commented] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-07-25 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16893021#comment-16893021 ] Erik Krogen commented on HDFS-14462: Looks like when I thought I verified that it exi

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.000.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Status: Patch Available (was: Open) I just attached a v000 patch for this. It doesn't have a test ye

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: (was: HDFS-14370.000.patch) > Edit log tailing fast-path should allow for backoff > -

[jira] [Updated] (HDFS-14370) Edit log tailing fast-path should allow for backoff

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14370: --- Attachment: HDFS-14370.000.patch > Edit log tailing fast-path should allow for backoff >

[jira] [Comment Edited] (HDFS-14276) [SBN read] Reduce tailing overhead

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892239#comment-16892239 ] Erik Krogen edited comment on HDFS-14276 at 7/24/19 10:24 PM: -

[jira] [Commented] (HDFS-14276) [SBN read] Reduce tailing overhead

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892239#comment-16892239 ] Erik Krogen commented on HDFS-14276: [~ayushtkn] or [~jojochuang] are either of you i

[jira] [Updated] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14667: --- Description: We would like to target pulling HDFS-14403, an important operability enhancement, into

[jira] [Created] (HDFS-14667) Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2

2019-07-24 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-14667: -- Summary: Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2 Key: HDFS-14667 URL: https://issues.apache.org/jira/browse/HDFS-14667 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-12342) Differentiate webhdfs vs. swebhdfs calls in audit log

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-12342: -- Assignee: Chen Liang (was: Erik Krogen) > Differentiate webhdfs vs. swebhdfs calls in audit l

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891969#comment-16891969 ] Erik Krogen commented on HDFS-14657: Hey [~zhangchen], your idea expressed in the v2

[jira] [Comment Edited] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891964#comment-16891964 ] Erik Krogen edited comment on HDFS-13783 at 7/24/19 4:06 PM: -

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891964#comment-16891964 ] Erik Krogen commented on HDFS-13783: Hi [~zhangchen], things are looking good! {quote

[jira] [Commented] (HDFS-14034) Support getQuotaUsage API in WebHDFS

2019-07-24 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891945#comment-16891945 ] Erik Krogen commented on HDFS-14034: I'm not familiar with HttpFS so I would prefer i

[jira] [Assigned] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14462: -- Assignee: Simbarashe Dzinamarira > WebHDFS throws "Error writing request body to server" inste

[jira] [Updated] (HDFS-14462) WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14462: --- Summary: WebHDFS throws "Error writing request body to server" instead of DSQuotaExceededException (

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16891108#comment-16891108 ] Erik Krogen commented on HDFS-14509: Great, I will mark them all as blockers for a 2.

[jira] [Updated] (HDFS-14551) NN throws NPE if downgrade it during rolling upgrade from 3.x to 2.x

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14551: --- Target Version/s: 2.10.0 Priority: Blocker (was: Major) > NN throws NPE if downgrade it

[jira] [Updated] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13596: --- Target Version/s: 2.10.0 > NN restart fails after RollingUpgrade from 2.x to 3.x > --

[jira] [Updated] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13596: --- Priority: Blocker (was: Critical) > NN restart fails after RollingUpgrade from 2.x to 3.x >

[jira] [Updated] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-07-23 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14509: --- Target Version/s: 2.10.0 Priority: Blocker (was: Major) > DN throws InvalidToken due to

[jira] [Comment Edited] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890513#comment-16890513 ] Erik Krogen edited comment on HDFS-14655 at 7/22/19 10:37 PM: -

[jira] [Assigned] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14655: -- Assignee: Ayush Saxena > SBN : Namenode crashes if one of The JN is down > ---

[jira] [Commented] (HDFS-14655) SBN : Namenode crashes if one of The JN is down

2019-07-22 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890513#comment-16890513 ] Erik Krogen commented on HDFS-14655: Great discussion here. [~ayushtkn], particularly

[jira] [Commented] (HDFS-14509) DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x

2019-07-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888943#comment-16888943 ] Erik Krogen commented on HDFS-14509: [~John Smith] and [~brahmareddy], thanks for loo

[jira] [Commented] (HDFS-14657) Refine NameSystem lock usage during processing FBR

2019-07-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888936#comment-16888936 ] Erik Krogen commented on HDFS-14657: This seems like a nice middle ground between the

[jira] [Commented] (HDFS-14660) [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider

2019-07-19 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888931#comment-16888931 ] Erik Krogen commented on HDFS-14660: {quote} In this case we just need to check wheth

[jira] [Commented] (HDFS-10927) Lease Recovery: File not getting closed on HDFS when block write operation fails

2019-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888151#comment-16888151 ] Erik Krogen commented on HDFS-10927: I only took a quick look at this, but I agree th

[jira] [Commented] (HDFS-14660) [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider

2019-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888039#comment-16888039 ] Erik Krogen commented on HDFS-14660: Hey [~ayushtkn], thanks for pinging me and sorry

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-18 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16888037#comment-16888037 ] Erik Krogen commented on HDFS-13783: {quote} BTW, should I update document in a separ

[jira] [Commented] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887263#comment-16887263 ] Erik Krogen commented on HDFS-13783: Hey [~zhangchen], the idea is good, but I think

[jira] [Comment Edited] (HDFS-13783) Balancer: make balancer to be a long service process for easy to monitor it.

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887263#comment-16887263 ] Erik Krogen edited comment on HDFS-13783 at 7/17/19 5:19 PM: -

[jira] [Commented] (HDFS-13709) Report bad block to NN when transfer block encounter EIO exception

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887218#comment-16887218 ] Erik Krogen commented on HDFS-13709: I don't know much about this area, I would prefe

[jira] [Comment Edited] (HDFS-14643) [Dynamometer] Merge extra commits from GitHub to Hadoop

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887173#comment-16887173 ] Erik Krogen edited comment on HDFS-14643 at 7/17/19 3:34 PM: -

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887171#comment-16887171 ] Erik Krogen commented on HDFS-13671: [~linyiqun], [~daryn], [~kihwal], is there still

[jira] [Commented] (HDFS-14643) [Dynamometer] Merge extra commits from GitHub to Hadoop

2019-07-17 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16887173#comment-16887173 ] Erik Krogen commented on HDFS-14643: There are also a couple of outstanding PRs which

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886457#comment-16886457 ] Erik Krogen commented on HDFS-12979: Great, thanks [~vagarychen]. +1 pending Jenkins

[jira] [Comment Edited] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886385#comment-16886385 ] Erik Krogen edited comment on HDFS-12979 at 7/16/19 7:01 PM: -

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886385#comment-16886385 ] Erik Krogen commented on HDFS-12979: Looks like {{MiniDFSCluster}} L989 is still usin

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886346#comment-16886346 ] Erik Krogen commented on HDFS-12979: The logic in v13 patch looks clean to me; the us

[jira] [Commented] (HDFS-14639) [Dynamometer] Unnecessary duplicate bin directory appears in dist layout

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886331#comment-16886331 ] Erik Krogen commented on HDFS-14639: Hey [~jojochuang] or [~linyiqun], can either of

[jira] [Updated] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14547: --- Fix Version/s: 2.9.3 2.10.0 > DirectoryWithQuotaFeature.quota costs additional mem

[jira] [Updated] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-07-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14547: --- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed the branch-2.9 pa

[jira] [Commented] (HDFS-14646) Standby NameNode should terminate the FsImage put process immediately if the peer NN is not in the appropriate state to receive an image.

2019-07-15 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885341#comment-16885341 ] Erik Krogen commented on HDFS-14646: [~xudongcao] thanks for reporting this, it seems

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-07-15 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885339#comment-16885339 ] Erik Krogen commented on HDFS-14547: Hey [~LiJinglun], you can also remove the {{thro

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2019-07-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884093#comment-16884093 ] Erik Krogen commented on HDFS-12746: Cool, thanks for the updates [~anu] and [~dinesh

[jira] [Commented] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-07-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883891#comment-16883891 ] Erik Krogen commented on HDFS-14547: Besides fixing up the checkstyle and Java 7 comp

[jira] [Commented] (HDFS-14410) Make Dynamometer documentation properly compile onto the Hadoop site

2019-07-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883117#comment-16883117 ] Erik Krogen commented on HDFS-14410: Great, thanks for the help [~linyiqun]! > Make

[jira] [Commented] (HDFS-14640) [Dynamometer] Fix TestDynamometerInfra failures

2019-07-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16883100#comment-16883100 ] Erik Krogen commented on HDFS-14640: Thanks [~iwasakims]! I uploaded a v001 patch whi

[jira] [Updated] (HDFS-14640) [Dynamometer] Fix TestDynamometerInfra failures

2019-07-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14640: --- Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch Available) > [

[jira] [Updated] (HDFS-14640) [Dynamometer] Fix TestDynamometerInfra failures

2019-07-11 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14640: --- Attachment: HDFS-14640.001.patch > [Dynamometer] Fix TestDynamometerInfra failures >

[jira] [Updated] (HDFS-14410) Make Dynamometer documentation properly compile onto the Hadoop site

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14410: --- Attachment: HDFS-14410.002.patch > Make Dynamometer documentation properly compile onto the Hadoop si

[jira] [Commented] (HDFS-14410) Make Dynamometer documentation properly compile onto the Hadoop site

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882331#comment-16882331 ] Erik Krogen commented on HDFS-14410: Rebased for v002 > Make Dynamometer documentati

[jira] [Commented] (HDFS-14640) [Dynamometer] Fix TestDynamometerInfra failures

2019-07-10 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882324#comment-16882324 ] Erik Krogen commented on HDFS-14640: The issue was being caused by how {{find}} works

<    1   2   3   4   5   6   7   8   9   10   >