[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973-branch-2.004.patch > Balancer getBlocks RPC dispersal does not function proper

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976854#comment-16976854 ] Erik Krogen commented on HDFS-14973: Attach v004 patch for branch-2 addressing the ch

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16976729#comment-16976729 ] Erik Krogen commented on HDFS-14973: Just attached a branch-2 patch. There are two ch

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973-branch-2.003.patch > Balancer getBlocks RPC dispersal does not function proper

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975444#comment-16975444 ] Erik Krogen commented on HDFS-14442: Hi [~Sushma_28], I took last look at this before

[jira] [Comment Edited] (HDFS-14991) Backport HDFS-14346 Better time precision in getTimeDuration to branch-2

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975419#comment-16975419 ] Erik Krogen edited comment on HDFS-14991 at 11/15/19 9:38 PM: -

[jira] [Commented] (HDFS-14991) Backport HDFS-14346 Better time precision in getTimeDuration to branch-2

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975419#comment-16975419 ] Erik Krogen commented on HDFS-14991: HDFS-14630 is currently only present in trunk, i

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Fix Version/s: 3.1.4 > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Comment Edited] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975299#comment-16975299 ] Erik Krogen edited comment on HDFS-14973 at 11/15/19 8:19 PM: -

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975299#comment-16975299 ] Erik Krogen commented on HDFS-14973: Thanks for the review [~shv]. Just committed to

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Fix Version/s: 3.2.2 3.3.0 > Balancer getBlocks RPC dispersal does not function pr

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-14 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974418#comment-16974418 ] Erik Krogen commented on HDFS-14973: Thanks for the comments [~shv], all great points

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-14 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973.003.patch > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Comment Edited] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973732#comment-16973732 ] Erik Krogen edited comment on HDFS-14973 at 11/13/19 9:55 PM: -

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973732#comment-16973732 ] Erik Krogen commented on HDFS-14973: For (1), if we do this it will force the {{Exter

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973.002.patch > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Observer Node] Balancer should

[jira] [Comment Edited] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973656#comment-16973656 ] Erik Krogen edited comment on HDFS-14979 at 11/13/19 8:10 PM: -

[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Fix Version/s: 2.11.0 2.10.1 3.2.2 3.1.4

[jira] [Commented] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973656#comment-16973656 ] Erik Krogen commented on HDFS-14979: Committed this down to branch-2.10 (trunk, branc

[jira] [Commented] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973543#comment-16973543 ] Erik Krogen commented on HDFS-14969: I agree that adjusting the logging depending on

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973507#comment-16973507 ] Erik Krogen commented on HDFS-14442: v003 patch LGTM, I will commit once I get a chan

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-11-13 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973496#comment-16973496 ] Erik Krogen commented on HDFS-14655: [~vagarychen] is that different from the issue r

[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Status: Patch Available (was: Open) Attached v000 patch. The fix is simply to add the {{@ReadOnly}}

[jira] [Comment Edited] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971889#comment-16971889 ] Erik Krogen edited comment on HDFS-14979 at 11/11/19 10:47 PM:

[jira] [Created] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-11 Thread Erik Krogen (Jira)
Erik Krogen created HDFS-14979: -- Summary: [Observer Node] Balancer should submit getBlocks to Observer Node when possible Key: HDFS-14979 URL: https://issues.apache.org/jira/browse/HDFS-14979 Project: Ha

[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible

2019-11-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Attachment: HDFS-14979.000.patch > [Observer Node] Balancer should submit getBlocks to Observer Node

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973.001.patch > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-11 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971813#comment-16971813 ] Erik Krogen commented on HDFS-14973: Thanks for taking a look [~shv]! {quote}The next

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Description: In HDFS-11384, a mechanism was added to make the {{getBlocks}} RPC calls issued by the

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970560#comment-16970560 ] Erik Krogen commented on HDFS-14973: Attached v000 patch with a fix. Conveniently, Gu

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973.000.patch > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Status: Patch Available (was: Open) > Balancer getBlocks RPC dispersal does not function properly >

[jira] [Commented] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970500#comment-16970500 ] Erik Krogen commented on HDFS-14973: I have attached [^HDFS-14973.test.patch] which

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Attachment: HDFS-14973.test.patch > Balancer getBlocks RPC dispersal does not function properly > ---

[jira] [Updated] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14973: --- Description: In HDFS-11384, a mechanism was added to make the {{getBlocks}} RPC calls issued by the

[jira] [Created] (HDFS-14973) Balancer getBlocks RPC dispersal does not function properly

2019-11-08 Thread Erik Krogen (Jira)
Erik Krogen created HDFS-14973: -- Summary: Balancer getBlocks RPC dispersal does not function properly Key: HDFS-14973 URL: https://issues.apache.org/jira/browse/HDFS-14973 Project: Hadoop HDFS

[jira] [Commented] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970373#comment-16970373 ] Erik Krogen commented on HDFS-14969: [~vagarychen] and [~shv] as FYI > Fix HDFS clie

[jira] [Comment Edited] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970371#comment-16970371 ] Erik Krogen edited comment on HDFS-14969 at 11/8/19 4:27 PM: -

[jira] [Comment Edited] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970371#comment-16970371 ] Erik Krogen edited comment on HDFS-14969 at 11/8/19 4:27 PM: -

[jira] [Commented] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16970371#comment-16970371 ] Erik Krogen commented on HDFS-14969: +1 on this. It has been an issue ever since the

[jira] [Updated] (HDFS-14969) Fix HDFS client unnecessary failover log printing

2019-11-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14969: --- Description: In multi-NameNodes scenario, suppose there are 3 NNs and the 3rd is ANN, and then a cli

[jira] [Commented] (HDFS-14963) Add HDFS Client machine caching active namenode index mechanism.

2019-11-07 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969457#comment-16969457 ] Erik Krogen commented on HDFS-14963: Very interesting proposal [~xudongcao]! For the

[jira] [Commented] (HDFS-14961) TestDFSZKFailoverController fails consistently

2019-11-07 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969398#comment-16969398 ] Erik Krogen commented on HDFS-14961: I don't have any experience in the ZKFC area, ma

[jira] [Commented] (HDFS-14954) [Dynamometer] create-slim-hadoop-tar.sh accidentally removes junit jar from tarball

2019-11-06 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968475#comment-16968475 ] Erik Krogen commented on HDFS-14954: Thanks for reporting this [~tasanuma]! I really

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-11-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967903#comment-16967903 ] Erik Krogen commented on HDFS-14884: [~weichiu] any chance you can review the branch-

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-11-05 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16967617#comment-16967617 ] Erik Krogen commented on HDFS-14775: +1 thanks [~zhangchen]! > Add Timestamp for lon

[jira] [Commented] (HDFS-14806) Bootstrap standby may fail if used in-progress tailing

2019-11-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966967#comment-16966967 ] Erik Krogen commented on HDFS-14806: Hi [~vagarychen] I am +1 on this patch besides t

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-11-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16966797#comment-16966797 ] Erik Krogen commented on HDFS-14442: Hi [~Sushma_28], thanks for attaching a v2 patch

[jira] [Assigned] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-11-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-14442: -- Assignee: Ravuri Sushma sree > Disagreement between HAUtil.getAddressOfActive and > RpcInvoca

[jira] [Updated] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-11-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14442: --- Status: Patch Available (was: Open) > Disagreement between HAUtil.getAddressOfActive and > RpcInvoc

[jira] [Updated] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14824: --- Fix Version/s: 3.3.0 > [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the > be

[jira] [Updated] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14824: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Dynamometer] Dynamometer in org

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-11-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964955#comment-16964955 ] Erik Krogen commented on HDFS-14824: Thanks [~tasanuma]! Just committed this to trunk

[jira] [Assigned] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

2019-10-31 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-13689: -- Assignee: (was: Erik Krogen) > NameNodeRpcServer getEditsFromTxid assumes it is run on act

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-10-30 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963152#comment-16963152 ] Erik Krogen commented on HDFS-14824: Hi [~tasanuma], the changes LGTM, but I think we

[jira] [Commented] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-10-29 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962124#comment-16962124 ] Erik Krogen commented on HDFS-14824: Hi [~tasanuma], if you took this up it would be

[jira] [Commented] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-29 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962122#comment-16962122 ] Erik Krogen commented on HDFS-14907: I just committed this to trunk. Thanks for the c

[jira] [Updated] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-29 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14907: --- Fix Version/s: 3.3.0 > [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary > -

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Release Note: This adds an extension to the IPC FairCallQueue which allows for the consideration of

[jira] [Updated] (HDFS-14403) Cost-Based RPC FairCallQueue

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14403: --- Fix Version/s: 2.10.0 > Cost-Based RPC FairCallQueue > > >

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-28 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961151#comment-16961151 ] Erik Krogen commented on HDFS-14937: FYI [~shv] [~vagarychen] [~csun] > [SBN read] O

[jira] [Commented] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-25 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959833#comment-16959833 ] Erik Krogen commented on HDFS-14907: We already have some classpath manipulation in

[jira] [Commented] (HDFS-14775) Add Timestamp for longest FSN write/read lock held log

2019-10-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16959206#comment-16959206 ] Erik Krogen commented on HDFS-14775: I only took a quick look but it seems like a goo

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-10-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954964#comment-16954964 ] Erik Krogen commented on HDFS-14442: Hi [~Sushma_28], I think your patch is a diff be

[jira] [Commented] (HDFS-14907) [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

2019-10-15 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952065#comment-16952065 ] Erik Krogen commented on HDFS-14907: Thanks for reporting this [~tasanuma]. We partia

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Fix Version/s: 2.10.0 > Balancer should work with ObserverNode >

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Balancer should work with Observ

[jira] [Resolved] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen resolved HDFS-14245. Resolution: Fixed > Class cast error in GetGroups with ObserverReadProxyProvider >

[jira] [Updated] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14245: --- Fix Version/s: 2.10.0 > Class cast error in GetGroups with ObserverReadProxyProvider > --

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948743#comment-16948743 ] Erik Krogen commented on HDFS-14245: Just committed to branch-2; it was a clean backp

[jira] [Commented] (HDFS-14162) Balancer should work with ObserverNode

2019-10-10 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948733#comment-16948733 ] Erik Krogen commented on HDFS-14162: Just committed this to branch-2 based on Konstan

[jira] [Commented] (HDFS-14162) Balancer should work with ObserverNode

2019-10-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947883#comment-16947883 ] Erik Krogen commented on HDFS-14162: Attached v005 patch fixing the 1 checkstyle warn

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-09 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Attachment: HDFS-14162-branch-2.005.patch > Balancer should work with ObserverNode >

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-10-08 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947051#comment-16947051 ] Erik Krogen commented on HDFS-14655: Thanks [~ayushtkn]! > [SBN Read] Namenode crash

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-07 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Status: Patch Available (was: Reopened) > Balancer should work with ObserverNode > -

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-10-07 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945995#comment-16945995 ] Erik Krogen commented on HDFS-14655: Got it. +1 from me on the branch-2 patch but can

[jira] [Updated] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14245: --- Fix Version/s: 3.2.2 3.1.4 > Class cast error in GetGroups with ObserverReadProxyP

[jira] [Commented] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944751#comment-16944751 ] Erik Krogen commented on HDFS-14245: Backported to 3.2 and 3.1, but this depends on H

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Attachment: HDFS-14162-branch-2.004.patch > Balancer should work with ObserverNode >

[jira] [Commented] (HDFS-14162) Balancer should work with ObserverNode

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944735#comment-16944735 ] Erik Krogen commented on HDFS-14162: Backported to branch-3.2 and branch-3.1. Attachi

[jira] [Updated] (HDFS-14162) Balancer should work with ObserverNode

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14162: --- Fix Version/s: 3.2.2 3.1.4 > Balancer should work with ObserverNode >

[jira] [Reopened] (HDFS-14162) Balancer should work with ObserverNode

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reopened HDFS-14162: Re-opening for backport to older branches which should have been done from the start. > Balancer shou

[jira] [Reopened] (HDFS-14245) Class cast error in GetGroups with ObserverReadProxyProvider

2019-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reopened HDFS-14245: Re-opening for backport to other branches, which should have been done from the start. > Class cast e

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-10-03 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944029#comment-16944029 ] Erik Krogen commented on HDFS-14090: Hey [~crh], strong apologies for my 1-2 days to

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-10-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942305#comment-16942305 ] Erik Krogen commented on HDFS-14655: Thanks [~ayushtkn]! Would you mind explaining an

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-10-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942108#comment-16942108 ] Erik Krogen commented on HDFS-14655: Hi [~ayushtkn], are you still working on the bac

[jira] [Commented] (HDFS-14872) Read HDFS Blocks in Random Order

2019-10-01 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942067#comment-16942067 ] Erik Krogen commented on HDFS-14872: +1 on this idea from me, we have considered buil

[jira] [Commented] (HDFS-14853) NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present

2019-09-25 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937966#comment-16937966 ] Erik Krogen commented on HDFS-14853: Hi [~ayushtkn] and [~RANith], this seems like a

[jira] [Commented] (HDFS-14798) Synchronize invalidateBlocks in DatanodeDescriptor

2019-09-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937195#comment-16937195 ] Erik Krogen commented on HDFS-14798: Hey folks, is this worth backporting into older

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-24 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937151#comment-16937151 ] Erik Krogen commented on HDFS-14655: Thank you [~ayushtkn]! Would you be open to help

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-09-23 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935991#comment-16935991 ] Erik Krogen commented on HDFS-14442: I see. So we have this block: {code} private U

[jira] [Commented] (HDFS-14442) Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId

2019-09-23 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935934#comment-16935934 ] Erik Krogen commented on HDFS-14442: Hi [~Sushma_28], can you describe your use case

[jira] [Commented] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933647#comment-16933647 ] Erik Krogen commented on HDFS-14617: Hi [~sodonnell], thanks for working on this JIRA

[jira] [Comment Edited] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933644#comment-16933644 ] Erik Krogen edited comment on HDFS-14771 at 9/19/19 6:13 PM: -

[jira] [Updated] (HDFS-14617) Improve fsimage load time by writing sub-sections to the fsimage index

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14617: --- Fix Version/s: 2.10.0 > Improve fsimage load time by writing sub-sections to the fsimage index >

[jira] [Commented] (HDFS-14771) Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index)

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933644#comment-16933644 ] Erik Krogen commented on HDFS-14771: [~hexiaoqiao] I think release notes are warrante

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933623#comment-16933623 ] Erik Krogen commented on HDFS-14090: I am +1 on overall implementation (have at least

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-19 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933556#comment-16933556 ] Erik Krogen commented on HDFS-14655: [~shv] I previously tried the same (revert the p

[jira] [Commented] (HDFS-14655) [SBN Read] Namenode crashes if one of The JN is down

2019-09-18 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932879#comment-16932879 ] Erik Krogen commented on HDFS-14655: Awesome! +1 from me. [~shv], does it look okay t

<    1   2   3   4   5   6   7   8   9   10   >