[jira] [Work logged] (HDFS-15568) namenode start failed to start when dfs.namenode.snapshot.max.limit set

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15568?focusedWorklogId=484946=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484946 ] ASF GitHub Bot logged work on HDFS-15568: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15568) namenode start failed to start when dfs.namenode.snapshot.max.limit set

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15568?focusedWorklogId=484944=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484944 ] ASF GitHub Bot logged work on HDFS-15568: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196662#comment-17196662 ] Hadoop QA commented on HDFS-15578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484910=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484910 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484898=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484898 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?focusedWorklogId=484897=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484897 ] ASF GitHub Bot logged work on HDFS-15237: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?focusedWorklogId=484881=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484881 ] ASF GitHub Bot logged work on HDFS-15237: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?focusedWorklogId=484874=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484874 ] ASF GitHub Bot logged work on HDFS-15516: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?focusedWorklogId=484875=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484875 ] ASF GitHub Bot logged work on HDFS-15516: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?focusedWorklogId=484857=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484857 ] ASF GitHub Bot logged work on HDFS-15329: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-15 Thread Janus Chow (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196614#comment-17196614 ] Janus Chow commented on HDFS-15579: --- There is already some instruction for this constructor.

[jira] [Work logged] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?focusedWorklogId=484821=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484821 ] ASF GitHub Bot logged work on HDFS-15329: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-09-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15289: --- Target Version/s: 3.3.1, 3.4.0, 3.1.5, 3.2.3 (was: 3.2.2, 3.3.1, 3.4.0, 3.1.5) >

[jira] [Commented] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

2020-09-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196589#comment-17196589 ] Uma Maheswara Rao G commented on HDFS-15289: [~hexiaoqiao], Thanks for ping. Sure we can set

[jira] [Work logged] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15329?focusedWorklogId=484816=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484816 ] ASF GitHub Bot logged work on HDFS-15329: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484812=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484812 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196583#comment-17196583 ] Hadoop QA commented on HDFS-15578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196562#comment-17196562 ] Hadoop QA commented on HDFS-15574: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15569) Speed up the Storage#doRecover during datanode rolling upgrade

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196554#comment-17196554 ] Hadoop QA commented on HDFS-15569: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196515#comment-17196515 ] Íñigo Goiri commented on HDFS-15516: Regarding [^HDFS-15516.004.patch], if we do + we don't need to

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196477#comment-17196477 ] Hadoop QA commented on HDFS-15415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?focusedWorklogId=484667=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484667 ] ASF GitHub Bot logged work on HDFS-15516: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15543) RBF: Write Should allow, when a subcluster is unavailable for RANDOM mount points with fault Tolerance enabled.

2020-09-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196412#comment-17196412 ] Íñigo Goiri commented on HDFS-15543: I'm surprised that it still applies. Anyway, to make it a little

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196410#comment-17196410 ] Chao Sun commented on HDFS-15516: - I think this makes sense given that we already record flags for

[jira] [Commented] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-15 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196406#comment-17196406 ] Íñigo Goiri commented on HDFS-15579: Yes, let's add a javadoc. > RBF: The constructor of

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.2.002.patch > Remove unnecessary sort of block list in

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196286#comment-17196286 ] Hadoop QA commented on HDFS-15574: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15576: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196282#comment-17196282 ] Takanobu Asanuma commented on HDFS-15576: - The failed tests are not related to the patch. >

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484568=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484568 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196232#comment-17196232 ] Stephen O'Donnell commented on HDFS-15415: -- [~weichiu] Thanks for the review. You are correct -

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.004.patch > Reduce locking in Datanode DirectoryScanner >

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484557=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484557 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484555=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484555 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15539) When disallowing snapshot on a dir, throw exception if its trash root is not empty

2020-09-15 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15539: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) >

[jira] [Work logged] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?focusedWorklogId=484551=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484551 ] ASF GitHub Bot logged work on HDFS-15578: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15578: -- Labels: pull-request-available (was: ) > Fix the rename issues with fallback fs enabled >

[jira] [Work logged] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?focusedWorklogId=484552=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484552 ] ASF GitHub Bot logged work on HDFS-15237: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-1558) Optimize FSNamesystem.startFileInternal

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1558?focusedWorklogId=484537=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484537 ] ASF GitHub Bot logged work on HDFS-1558: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196185#comment-17196185 ] Wei-Chiu Chuang commented on HDFS-15415: {code} try (AutoCloseableLock lock =

[jira] [Commented] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196162#comment-17196162 ] Hadoop QA commented on HDFS-15415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196150#comment-17196150 ] jianghua zhu edited comment on HDFS-15516 at 9/15/20, 1:47 PM: --- Hi

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196158#comment-17196158 ] Hadoop QA commented on HDFS-15576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196144#comment-17196144 ] Stephen O'Donnell commented on HDFS-15574: -- I'm not sure - I think I got jenkins to run with

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Anonymous (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anonymous updated HDFS-15574: - Status: Patch Available (was: Reopened) > Remove unnecessary sort of block list in DirectoryScanner >

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196150#comment-17196150 ] jianghua zhu commented on HDFS-15516: - Hi [~elgoiri] , [~hexiaoqiao] , here I have submitted a new

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196140#comment-17196140 ] Hemanth Boyina commented on HDFS-15574: --- tried to cherry pick to branch 3.3 , due to conflicts

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-12090: -- Labels: pull-request-available (was: ) > Handling writes from HDFS to Provided storages >

[jira] [Work logged] (HDFS-12090) Handling writes from HDFS to Provided storages

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12090?focusedWorklogId=484466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484466 ] ASF GitHub Bot logged work on HDFS-12090: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?focusedWorklogId=484461=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484461 ] ASF GitHub Bot logged work on HDFS-15516: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196097#comment-17196097 ] Hadoop QA commented on HDFS-15516: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196095#comment-17196095 ] Takanobu Asanuma commented on HDFS-15576: - Thanks for updating the patch. +1 on 

[jira] [Commented] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196090#comment-17196090 ] Zhao Yi Ming commented on HDFS-15237: - [~zhengchenyu] Thanks! We will port those 2 issues into our

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:59 AM:

[jira] [Assigned] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu reassigned HDFS-15237: -- Assignee: zhengchenyu > Get checksum of EC file failed, when some block is missing or corrupt

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196089#comment-17196089 ] zhengchenyu edited comment on HDFS-15237 at 9/15/20, 11:59 AM: --- [~zhaoyim]

[jira] [Commented] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread zhengchenyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196089#comment-17196089 ] zhengchenyu commented on HDFS-15237:  Yeah! This issue slove this problem. Also I advise you use 

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:53 AM:

[jira] [Comment Edited] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196087#comment-17196087 ] Zhao Yi Ming edited comment on HDFS-15237 at 9/15/20, 11:52 AM:

[jira] [Commented] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread Zhao Yi Ming (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196087#comment-17196087 ] Zhao Yi Ming commented on HDFS-15237: - zhengchenyu  Thanks for your patch! It can fix this issue.

[jira] [Updated] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15237: -- Labels: pull-request-available (was: ) > Get checksum of EC file failed, when some block is

[jira] [Work logged] (HDFS-15237) Get checksum of EC file failed, when some block is missing or corrupt

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15237?focusedWorklogId=48=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-48 ] ASF GitHub Bot logged work on HDFS-15237: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15579) RBF: The constructor of PathLocation may got some misunderstanding

2020-09-15 Thread Janus Chow (Jira)
Janus Chow created HDFS-15579: - Summary: RBF: The constructor of PathLocation may got some misunderstanding Key: HDFS-15579 URL: https://issues.apache.org/jira/browse/HDFS-15579 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15415) Reduce locking in Datanode DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15415: - Attachment: HDFS-15415.003.patch > Reduce locking in Datanode DirectoryScanner >

[jira] [Commented] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196006#comment-17196006 ] Fei Hui commented on HDFS-15576: Change the caption and upload v002 patch > Erasure Coding: Add rs and

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Description: * Add rs and rs-legacy codec test for TestErasureCodingCLI * Add comments for failed test RS *

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Attachment: HDFS-15576.002.patch > Erasure Coding: Add rs and rs-legacy codec test for addPolicies >

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Description: * Add rs and rs-legacy codec test for TestErasureCodingCLI * Add comments for failed test *

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs and rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Summary: Erasure Coding: Add rs and rs-legacy codec test for addPolicies (was: Erasure Coding: Add rs &

[jira] [Updated] (HDFS-15576) Erasure Coding: Add rs & rs-legacy codec test for addPolicies

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-15576: --- Summary: Erasure Coding: Add rs & rs-legacy codec test for addPolicies (was: Erasure Coding: Add test

[jira] [Updated] (HDFS-15516) Add info for create flags in NameNode audit logs

2020-09-15 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15516: Attachment: HDFS-15516.004.patch > Add info for create flags in NameNode audit logs >

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195973#comment-17195973 ] Fei Hui commented on HDFS-15576: [~tasanuma] Thanks a lot, get it! Will try it with your suggestions In

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.2.001.patch > Remove unnecessary sort of block list in

[jira] [Updated] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15574: - Attachment: HDFS-15574.branch-3.3.001.patch > Remove unnecessary sort of block list in

[jira] [Reopened] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell reopened HDFS-15574: -- Reopening to backport to earlier branches. > Remove unnecessary sort of block list in

[jira] [Commented] (HDFS-15574) Remove unnecessary sort of block list in DirectoryScanner

2020-09-15 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195940#comment-17195940 ] Stephen O'Donnell commented on HDFS-15574: -- [~hemanthboyina] Thanks for committing this. I think

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195936#comment-17195936 ] Takanobu Asanuma commented on HDFS-15576: - Thanks for your patch, [~ferhui]. Thanks for pinging

[jira] [Updated] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15578: --- Status: Patch Available (was: Open) > Fix the rename issues with fallback fs

[jira] [Work logged] (HDFS-1558) Optimize FSNamesystem.startFileInternal

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1558?focusedWorklogId=484331=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484331 ] ASF GitHub Bot logged work on HDFS-1558: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-1558) Optimize FSNamesystem.startFileInternal

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-1558: - Labels: pull-request-available (was: ) > Optimize FSNamesystem.startFileInternal >

[jira] [Updated] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15578: --- Description: When we enable fallback, rename should success if the src.parent or

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195914#comment-17195914 ] Akira Ajisaka commented on HDFS-15576: -- Cc: [~tasanuma] > Erasure Coding: Add test addPolicies to

[jira] [Created] (HDFS-15578) Fix the rename issues with fallback fs enabled

2020-09-15 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15578: -- Summary: Fix the rename issues with fallback fs enabled Key: HDFS-15578 URL: https://issues.apache.org/jira/browse/HDFS-15578 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195906#comment-17195906 ] Fei Hui commented on HDFS-15576: Failed Tests are unrelated. [~hexiaoqiao][~weichiu] [~aajisaka] Could

[jira] [Work logged] (HDFS-15577) Refactor TestTracing

2020-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15577?focusedWorklogId=484312=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-484312 ] ASF GitHub Bot logged work on HDFS-15577: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15576) Erasure Coding: Add test addPolicies to ECAdmin

2020-09-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195891#comment-17195891 ] Hadoop QA commented on HDFS-15576: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||