[jira] [Updated] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2020-12-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15308: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Updated] (HDFS-15380) RBF: Could not fetch real remote IP in RouterWebHdfsMethods

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15380: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15380) RBF: Could not fetch real remote IP in RouterWebHdfsMethods

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252609#comment-17252609 ] Ayush Saxena commented on HDFS-15380: - Committed to trunk. Thanx [~tomscut] for the contribution and

[jira] [Commented] (HDFS-15730) Erasure Coding: Fix unit test bug of TestAddOverReplicatedStripedBlocks.testProcessOverReplicatedAndCorruptStripedBlock.

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252607#comment-17252607 ] Ayush Saxena commented on HDFS-15730: - I am not saying if. there are two b0 and one is corrupt. Say,

[jira] [Commented] (HDFS-15738) Forbid the transition to Observer state when NameNode is in StartupSafeMode

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252478#comment-17252478 ] Ayush Saxena commented on HDFS-15738: - Well I wouldn't prefer going towards an incompatible change in

[jira] [Updated] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15655: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252477#comment-17252477 ] Ayush Saxena commented on HDFS-15655: - Committed to trunk. Thanx [~hadoop_yangyun] for the

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252475#comment-17252475 ] Ayush Saxena commented on HDFS-15655: - Test failures seems unrelated. +1 on v009 > Add option to

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252388#comment-17252388 ] Ayush Saxena commented on HDFS-15308: - What is the relation between EC reconstruction and

[jira] [Updated] (HDFS-15308) TestReconstructStripedFile#testNNSendsErasureCodingTasks fails intermittently

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15308: Priority: Major (was: Blocker) > TestReconstructStripedFile#testNNSendsErasureCodingTasks fails

[jira] [Commented] (HDFS-15380) RBF: Could not fetch real remote IP in RouterWebHdfsMethods

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252387#comment-17252387 ] Ayush Saxena commented on HDFS-15380: - The build is green. v001 LGTM +1 [~elgoiri] any objections

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252386#comment-17252386 ] Ayush Saxena commented on HDFS-15655: - I take that back, had a quick recheck before committing  Need

[jira] [Updated] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15733: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252384#comment-17252384 ] Ayush Saxena commented on HDFS-15733: - Committed to trunk. Thanx [~huanghaibin] for the contribution

[jira] [Updated] (HDFS-15116) Correct spelling of comments for NNStorage.setRestoreFailedStorage

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15116: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-15116) Correct spelling of comments for NNStorage.setRestoreFailedStorage

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15116: Priority: Trivial (was: Minor) > Correct spelling of comments for

[jira] [Commented] (HDFS-15116) Correct spelling of comments for NNStorage.setRestoreFailedStorage

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252380#comment-17252380 ] Ayush Saxena commented on HDFS-15116: - +1 > Correct spelling of comments for

[jira] [Updated] (HDFS-13998) ECAdmin NPE with -setPolicy -replicate

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-13998: Resolution: Abandoned Status: Resolved (was: Patch Available) Closing this, HDFS-13732 is

[jira] [Commented] (HDFS-15380) RBF: Could not fetch real remote IP in RouterWebHdfsMethods

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252358#comment-17252358 ] Ayush Saxena commented on HDFS-15380: - Changes seems fair enough, doesn't look like can break

[jira] [Commented] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252357#comment-17252357 ] Ayush Saxena commented on HDFS-15662: - Thanx [~LiJinglun] for the patch. I have retriggered the

[jira] [Commented] (HDFS-15723) RBF: invokeConcurrent may run unexpected when enable standby read

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252356#comment-17252356 ] Ayush Saxena commented on HDFS-15723: - Thanx [~hexiaoqiao] for the patch. Changes Looks good, Plans

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252353#comment-17252353 ] Ayush Saxena commented on HDFS-15655: - Thanx [~hadoop_yangyun] for the updates. v008 LGTM +1 > Add

[jira] [Commented] (HDFS-15730) Erasure Coding: Fix unit test bug of TestAddOverReplicatedStripedBlocks.testProcessOverReplicatedAndCorruptStripedBlock.

2020-12-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252352#comment-17252352 ] Ayush Saxena commented on HDFS-15730: - Do you think it is correct for the excess block to get deleted

[jira] [Commented] (HDFS-15738) Forbid the transition to Observer state when NameNode is in StartupSafeMode

2020-12-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252350#comment-17252350 ] Ayush Saxena commented on HDFS-15738: - I don't think forbiding the conversion to observer is a good

[jira] [Commented] (HDFS-15733) Add seqno in log when BlockReceiver receive packet

2020-12-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252349#comment-17252349 ] Ayush Saxena commented on HDFS-15733: - v002 LGTM +1 > Add seqno in log when BlockReceiver receive

[jira] [Commented] (HDFS-15735) NameNode memory Leak on frequent execution of fsck

2020-12-17 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251243#comment-17251243 ] Ayush Saxena commented on HDFS-15735: - Is that Tracer used somewhere? I guess HDFS-13702, removed the

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249504#comment-17249504 ] Ayush Saxena commented on HDFS-15170: - Thanx [~weichiu] for the commit. This broke the compilation

[jira] [Commented] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249502#comment-17249502 ] Ayush Saxena commented on HDFS-15200: - backported to 3.2 and 3.1 > Delete Corrupt Replica

[jira] [Updated] (HDFS-15200) Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15200: Fix Version/s: 3.2.3 3.1.5 > Delete Corrupt Replica Immediately Irrespective of

[jira] [Updated] (HDFS-15187) CORRUPT replica mismatch between namenodes after failover

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15187: Fix Version/s: 3.2.3 3.1.5 > CORRUPT replica mismatch between namenodes after

[jira] [Commented] (HDFS-15187) CORRUPT replica mismatch between namenodes after failover

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249500#comment-17249500 ] Ayush Saxena commented on HDFS-15187: - Cherry-picked to 3.2 and 3.1 > CORRUPT replica mismatch

[jira] [Commented] (HDFS-15728) Update description of dfs.datanode.handler.count in hdfs-default.xml

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249479#comment-17249479 ] Ayush Saxena commented on HDFS-15728: - Merged PR to trunk > Update description of

[jira] [Resolved] (HDFS-15728) Update description of dfs.datanode.handler.count in hdfs-default.xml

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-15728. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Update description

[jira] [Updated] (HDFS-15728) Update description of dfs.datanode.handler.count in hdfs-default.xml

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15728: Summary: Update description of dfs.datanode.handler.count in hdfs-default.xml (was: Updating

[jira] [Assigned] (HDFS-15728) Updating definition to dfs.datanode.handler.count documentation description.

2020-12-14 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15728: --- Assignee: liuyan > Updating definition to dfs.datanode.handler.count documentation

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246938#comment-17246938 ] Ayush Saxena commented on HDFS-15170: - {quote}this line is not needed if

[jira] [Comment Edited] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246874#comment-17246874 ] Ayush Saxena edited comment on HDFS-15170 at 12/9/20, 11:08 PM: IIRC In

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246874#comment-17246874 ] Ayush Saxena commented on HDFS-15170: - IIRC In case of EC blocks, if one block is corrupt, the block

[jira] [Comment Edited] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246486#comment-17246486 ] Ayush Saxena edited comment on HDFS-15170 at 12/9/20, 12:33 PM: Thanx

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246486#comment-17246486 ] Ayush Saxena commented on HDFS-15170: - Thanx [~hexiaoqiao] Yeps, that is expected, since initially

[jira] [Commented] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246455#comment-17246455 ] Ayush Saxena commented on HDFS-15170: - Hey [~hexiaoqiao], With HDFS-15200 in, this won't pitch in

[jira] [Updated] (HDFS-15170) EC: Block gets marked as CORRUPT in case of failover and pipeline recovery

2020-12-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15170: Attachment: HDFS-15170-03.patch > EC: Block gets marked as CORRUPT in case of failover and

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245103#comment-17245103 ] Ayush Saxena commented on HDFS-15655: - Thanx [~hadoop_yangyun] for the patch. I had a quick look,

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245099#comment-17245099 ] Ayush Saxena commented on HDFS-15221: - Committed to trunk. Thanx Everyone for the work here!!! > Add

[jira] [Updated] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-07 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15221: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244527#comment-17244527 ] Ayush Saxena commented on HDFS-15221: - v13 LGTM +1, Will commit later today, if no further comments

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244467#comment-17244467 ] Ayush Saxena commented on HDFS-15655: - Test failures looks related, Atleas the router ones are. >

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244466#comment-17244466 ] Ayush Saxena commented on HDFS-15221: - Thanx [~hadoop_yangyun], I think I couldn't express properly,

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244411#comment-17244411 ] Ayush Saxena commented on HDFS-15221: - Thanx [~hadoop_yangyun] for the patch. {code:java}

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244170#comment-17244170 ] Ayush Saxena commented on HDFS-15655: - Thanx [~hadoop_yangyun] for the patch, I think the test

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244163#comment-17244163 ] Ayush Saxena commented on HDFS-15221: - Thanx [~hadoop_yangyun] for the patch. In case of any

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244158#comment-17244158 ] Ayush Saxena commented on HDFS-14090: - Committed to trunk. Thanx [~fengnanli] and [~crh] for the

[jira] [Updated] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14090: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243964#comment-17243964 ] Ayush Saxena commented on HDFS-15442: - [~AMC-team] there are checkstyle warnings, can you fix them

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-12-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243932#comment-17243932 ] Ayush Saxena commented on HDFS-15221: - Thanx [~hadoop_yangyun] for the patch. Had a quick look Minor

[jira] [Commented] (HDFS-15442) Image upload may fail if dfs.image.transfer.chunksize wrongly set to negative value

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243799#comment-17243799 ] Ayush Saxena commented on HDFS-15442: - Thanx [~AMC-team] for the patch. The build results weren't

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243796#comment-17243796 ] Ayush Saxena commented on HDFS-15516: - [~jianghuazhu] can you update the patch as suggested above,

[jira] [Commented] (HDFS-14431) RBF: Rename with multiple subclusters should fail if no eligible locations

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243793#comment-17243793 ] Ayush Saxena commented on HDFS-14431: - Thanx [~LiJinglun] for the response, Sorry, I missed the

[jira] [Commented] (HDFS-15631) RBF: dfsadmin -report multiple capacity and used info

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243790#comment-17243790 ] Ayush Saxena commented on HDFS-15631: - Thanx [~shenyinjie] for the patch. Seems the introduced tests

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243788#comment-17243788 ] Ayush Saxena commented on HDFS-14090: - Looks this is concluded, [~elgoiri] do you want to hold it

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243784#comment-17243784 ] Ayush Saxena commented on HDFS-15655: - Thanx [~hadoop_yangyun] for the patch. Looks good overall.

[jira] [Commented] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-12-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243752#comment-17243752 ] Ayush Saxena commented on HDFS-15645: - bq. The DatanodeManager#getNumOfDataNodes() is used when

[jira] [Updated] (HDFS-15705) Fix a typo in SecondaryNameNode.java

2020-12-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15705: Status: Patch Available (was: Open) > Fix a typo in SecondaryNameNode.java >

[jira] [Updated] (HDFS-15705) Fix a typo in SecondaryNameNode.java

2020-12-02 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15705: Priority: Trivial (was: Minor) > Fix a typo in SecondaryNameNode.java >

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-27 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239650#comment-17239650 ] Ayush Saxena commented on HDFS-15680: - Thanx [~hexiaoqiao], I am also in the same boat with no idea

[jira] [Commented] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2020-11-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236840#comment-17236840 ] Ayush Saxena commented on HDFS-15690: - Have added [~viirya]  as HDFS Contributor. Thanx guys for

[jira] [Assigned] (HDFS-15690) Add lz4-java as hadoop-hdfs test dependency

2020-11-21 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15690: --- Assignee: L. C. Hsieh > Add lz4-java as hadoop-hdfs test dependency >

[jira] [Commented] (HDFS-15655) Add option to make balancer prefer to get cold blocks

2020-11-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236121#comment-17236121 ] Ayush Saxena commented on HDFS-15655: - {quote}. But I am interested what exception dfsclient meets

[jira] [Updated] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2020-11-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15659: Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Comment Edited] (HDFS-15680) Disable Broken Azure Junits

2020-11-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235883#comment-17235883 ] Ayush Saxena edited comment on HDFS-15680 at 11/20/20, 4:03 AM: If

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235883#comment-17235883 ] Ayush Saxena commented on HDFS-15680: - If you confirm everything is good at prod side, then I think

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-13 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231804#comment-17231804 ] Ayush Saxena commented on HDFS-15680: - Thanx [~ste...@apache.org] for volunteering. Always better to

[jira] [Commented] (HDFS-15680) Disable Broken Azure Junits

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229667#comment-17229667 ] Ayush Saxena commented on HDFS-15680: - Have linked the related Jiras. HADOOP-17223 is causing it,

[jira] [Updated] (HDFS-15669) RBF: Incorrect GetQuota caused by different implementation of HashSet

2020-11-05 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15669: Summary: RBF: Incorrect GetQuota caused by different implementation of HashSet (was: [HDFS]

[jira] [Commented] (HDFS-15654) TestBPOfferService#testMissBlocksWhenReregister fails intermittently

2020-11-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226334#comment-17226334 ] Ayush Saxena commented on HDFS-15654: - This tends to fail now as well :

[jira] [Commented] (HDFS-15459) TestBlockTokenWithDFSStriped fails intermittently

2020-11-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226331#comment-17226331 ] Ayush Saxena commented on HDFS-15459: - [~ahussein]/[~elgoiri]  This same tests fails now also,

[jira] [Commented] (HDFS-15608) Reset the DistCp#CLEANUP variable definition.

2020-11-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226238#comment-17226238 ] Ayush Saxena commented on HDFS-15608: - I didn't actually catch this. Where is the reset in the patch,

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-11-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225847#comment-17225847 ] Ayush Saxena commented on HDFS-15643: - {quote}Is there something that can be done for the OOM errors

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-11-03 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Fix Version/s: 3.2.3 3.1.5 3.4.0 3.3.1

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223829#comment-17223829 ] Ayush Saxena commented on HDFS-15659: - In general you can't even revert a released Jira, but if we

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223800#comment-17223800 ] Ayush Saxena commented on HDFS-15643: - Though the build failed, but the test passed. :P

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Attachment: HDFS-15643-01.patch > EC: Fix checksum computation in case of native encoders >

[jira] [Updated] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15624: Labels: pull-request-available release-blocker (was: pull-request-available) > Fix the

[jira] [Updated] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15624: Affects Version/s: 3.4.0 > Fix the SetQuotaByStorageTypeOp problem after updating hadoop >

[jira] [Commented] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223575#comment-17223575 ] Ayush Saxena commented on HDFS-15643: - Thanx [~aajisaka], I made the change to reduce one copy

[jira] [Updated] (HDFS-15643) EC: Fix checksum computation in case of native encoders

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Summary: EC: Fix checksum computation in case of native encoders (was:

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223521#comment-17223521 ] Ayush Saxena commented on HDFS-15643: - A simple change could be at L143 : {code:java} -     

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-30 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223456#comment-17223456 ] Ayush Saxena commented on HDFS-15643: - {quote}I tried the patch in 

[jira] [Updated] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Status: Patch Available (was: Open) > TestFileChecksumCompositeCrc fails intermittently >

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223204#comment-17223204 ] Ayush Saxena commented on HDFS-15643: - Yeps, That is quite old, but in EC, if you don't have the

[jira] [Commented] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223163#comment-17223163 ] Ayush Saxena commented on HDFS-15643: - [~aajisaka] can you try the patch. I think there is an issue

[jira] [Updated] (HDFS-15643) TestFileChecksumCompositeCrc fails intermittently

2020-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15643: Attachment: Test-Fix-01.patch > TestFileChecksumCompositeCrc fails intermittently >

[jira] [Commented] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-29 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222863#comment-17222863 ] Ayush Saxena commented on HDFS-15624: - No, I didn't try. I just saw the code and thought it would be

[jira] [Commented] (HDFS-15624) Fix the SetQuotaByStorageTypeOp problem after updating hadoop

2020-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1773#comment-1773 ] Ayush Saxena commented on HDFS-15624: - HDFS-15660 is handling a different issue, things getting fixed

[jira] [Commented] (HDFS-15659) Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

2020-10-28 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222090#comment-17222090 ] Ayush Saxena commented on HDFS-15659: - [~aajisaka] IIRC couple of days back you had objections having

[jira] [Created] (HDFS-15647) Beeline with property-file and -e parameter is failing

2020-10-23 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15647: --- Summary: Beeline with property-file and -e parameter is failing Key: HDFS-15647 URL: https://issues.apache.org/jira/browse/HDFS-15647 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15468) Active namenode crashed when no edit recover

2020-10-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219593#comment-17219593 ] Ayush Saxena commented on HDFS-15468: - Got some time to think about this. I think this can be chased.

[jira] [Commented] (HDFS-15461) TestDFSClientRetries#testGetFileChecksum fails intermittently

2020-10-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219447#comment-17219447 ] Ayush Saxena commented on HDFS-15461: - If the {{NODE_TOO_BUSY}} doesn't have any role in the test.

[jira] [Commented] (HDFS-15646) Track failing tests in HDFS

2020-10-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219203#comment-17219203 ] Ayush Saxena commented on HDFS-15646: - Well I think it is high time we should handle these. As a

[jira] [Commented] (HDFS-15642) EC:radmon error when enable ec policy on hbase data

2020-10-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217272#comment-17217272 ] Ayush Saxena commented on HDFS-15642: - Then the total missing blocks are 3? Which should fail only,

<    3   4   5   6   7   8   9   10   11   12   >