[jira] [Commented] (HDFS-15168) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044177#comment-17044177 ] Hadoop QA commented on HDFS-15168: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044148#comment-17044148 ] Yao Guangdong commented on HDFS-15186: -- [~ferhui]， Thanks for your review and advice. I have been

[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yao Guangdong updated HDFS-15186: - Attachment: HDFS-15186.003.patch > Erasure Coding: Decommission may generate the parity block's

[jira] [Commented] (HDFS-15168) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044135#comment-17044135 ] Hadoop QA commented on HDFS-15168: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044123#comment-17044123 ] Fei Hui commented on HDFS-15186: [~yaoguangdong] Thanks for your patch HDFS-15186.002.patch the whole fix

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044114#comment-17044114 ] Yang Yun commented on HDFS-15039: - Done, Thanks for review! > Cache meta file length of FinalizedReplica

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Status: Open (was: Patch Available) > Cache meta file length of FinalizedReplica to reduce call

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044110#comment-17044110 ] Lisheng Sun commented on HDFS-15039: hi [~hadoop_yangyun] It is recommended not to make unrelated

[jira] [Comment Edited] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043133#comment-17043133 ] Yao Guangdong edited comment on HDFS-15186 at 2/25/20 3:08 AM: --- [~ferhui], 

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044085#comment-17044085 ] Yao Guangdong commented on HDFS-15186: -- [~ferhui], [~ayushtkn], [~gjhkael], [~marvelrock], I have

[jira] [Updated] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yao Guangdong updated HDFS-15186: - Attachment: HDFS-15186.002.patch > Erasure Coding: Decommission may generate the parity block's

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch Status: Patch Available (was: Open) > Cache meta file length of

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Attachment: HDFS-15039.patch > Cache meta file length of FinalizedReplica to reduce call File.length() >

[jira] [Updated] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15039: Status: Open (was: Patch Available) > Cache meta file length of FinalizedReplica to reduce call

[jira] [Commented] (HDFS-15154) Allow only hdfs superusers the ability to assign HDFS storage policies

[ https://issues.apache.org/jira/browse/HDFS-15154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043905#comment-17043905 ] Hadoop QA commented on HDFS-15154: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043895#comment-17043895 ] Hudson commented on HDFS-15174: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17988 (See

[jira] [Commented] (HDFS-15039) Cache meta file length of FinalizedReplica to reduce call File.length()

[ https://issues.apache.org/jira/browse/HDFS-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043894#comment-17043894 ] Wei-Chiu Chuang commented on HDFS-15039: Patch has a conflict so submit a new patch and let it

[jira] [Commented] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043891#comment-17043891 ] Hadoop QA commented on HDFS-15190: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Resolution: Fixed Status: Resolved (was: Patch Available) Patch applies cleanly in

[jira] [Updated] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

[ https://issues.apache.org/jira/browse/HDFS-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15174: --- Fix Version/s: 3.2.2 3.1.4 3.3.0 > Optimize

[jira] [Comment Edited] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043864#comment-17043864 ] Chen Liang edited comment on HDFS-15191 at 2/24/20 9:01 PM: There could be

[jira] [Commented] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

[ https://issues.apache.org/jira/browse/HDFS-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043864#comment-17043864 ] Chen Liang commented on HDFS-15191: --- There could be token compatibility issue though, if you only have

[jira] [Created] (HDFS-15191) EOF when reading legacy buffer in BlockTokenIdentifier

Steven Rand created HDFS-15191: -- Summary: EOF when reading legacy buffer in BlockTokenIdentifier Key: HDFS-15191 URL: https://issues.apache.org/jira/browse/HDFS-15191 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043729#comment-17043729 ] Íñigo Goiri commented on HDFS-15190: Thanks [~hemanthboyina] for bringing this up. What is the use

[jira] [Updated] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

[ https://issues.apache.org/jira/browse/HDFS-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15190: - Attachment: HDFS-15190.001.patch Status: Patch Available (was: Open) > HttpFS : Add

[jira] [Created] (HDFS-15190) HttpFS : Add Support for Storage Policy Satisfier

hemanthboyina created HDFS-15190: Summary: HttpFS : Add Support for Storage Policy Satisfier Key: HDFS-15190 URL: https://issues.apache.org/jira/browse/HDFS-15190 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15187) CORRUPT replica mismatch between namenodes after failover

[ https://issues.apache.org/jira/browse/HDFS-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043614#comment-17043614 ] Hudson commented on HDFS-15187: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17983 (See

[jira] [Commented] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043605#comment-17043605 ] Hudson commented on HDFS-15166: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17982 (See

[jira] [Commented] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043602#comment-17043602 ] Xieming Li commented on HDFS-15166: --- Thank you for the report and review! > Remove redundant field

[jira] [Commented] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043596#comment-17043596 ] Ayush Saxena commented on HDFS-15111: - [~shv] thoughts on v003 ? > stopStandbyServices() should log

[jira] [Commented] (HDFS-15187) CORRUPT replica mismatch between namenodes after failover

[ https://issues.apache.org/jira/browse/HDFS-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043594#comment-17043594 ] Ayush Saxena commented on HDFS-15187: - Committed to trunk. Thanx [~elgoiri] and [~vinayakumarb] for

[jira] [Updated] (HDFS-15187) CORRUPT replica mismatch between namenodes after failover

[ https://issues.apache.org/jira/browse/HDFS-15187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15187: Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043586#comment-17043586 ] Ayush Saxena commented on HDFS-15166: - Committed to trunk, 3.2, 3.1 and 2.10 Thanx [~risyomei] for

[jira] [Updated] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15166: Fix Version/s: 2.10.1 3.2.2 3.1.4 3.3.0

[jira] [Assigned] (HDFS-13393) Improve OOM logging

[ https://issues.apache.org/jira/browse/HDFS-13393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HDFS-13393: - Assignee: (was: Gabor Bota) > Improve OOM logging > --- > >

[jira] [Commented] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043568#comment-17043568 ] Ayush Saxena commented on HDFS-15166: - +1 > Remove redundant field fStream in ByteStringLog >

[jira] [Commented] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043459#comment-17043459 ] Hadoop QA commented on HDFS-15166: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043209#comment-17043209 ] Andrea edited comment on HDFS-15098 at 2/24/20 11:52 AM: - This patch can be used 

[jira] [Commented] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043443#comment-17043443 ] Hadoop QA commented on HDFS-15025: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15111) stopStandbyServices() should log which service state it is transitioning from.

[ https://issues.apache.org/jira/browse/HDFS-15111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043418#comment-17043418 ] Xieming Li commented on HDFS-15111: --- Sorry for not noticing the update for a long time. I am also ok

[jira] [Updated] (HDFS-15166) Remove redundant field fStream in ByteStringLog

[ https://issues.apache.org/jira/browse/HDFS-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xieming Li updated HDFS-15166: -- Attachment: HDFS-15166.000.patch Status: Patch Available (was: Open) > Remove redundant field

[jira] [Updated] (HDFS-15189) update jackon-databind version

[ https://issues.apache.org/jira/browse/HDFS-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated HDFS-15189: - Description: according to [CVE-2020-8840|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-8840],

[jira] [Commented] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043375#comment-17043375 ] Hadoop QA commented on HDFS-15025: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15189) update jackon-databind version

[ https://issues.apache.org/jira/browse/HDFS-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043376#comment-17043376 ] angerszhu commented on HDFS-15189: -- cc [~hexiaoqiao]  can you help to ping some one who familiar to

[jira] [Updated] (HDFS-15189) update jackon-databind version

[ https://issues.apache.org/jira/browse/HDFS-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated HDFS-15189: - Description: according to

[jira] [Created] (HDFS-15189) update jackon-databind version

angerszhu created HDFS-15189: Summary: update jackon-databind version Key: HDFS-15189 URL: https://issues.apache.org/jira/browse/HDFS-15189 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-15189) update jackon-databind version

[ https://issues.apache.org/jira/browse/HDFS-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated HDFS-15189: - Description: according to

[jira] [Updated] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hadoop_hdfs_hw updated HDFS-15025: -- Attachment: (was: HDFS-15025.001.patch) > Applying NVDIMM storage media to HDFS >

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043367#comment-17043367 ] Stephen O'Donnell commented on HDFS-14854: -- Hi [~ayushtkn] there are quite a few factors to

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043360#comment-17043360 ] Yao Guangdong commented on HDFS-15186: -- [~ayushtkn], Thank you very much. I will fix it as soon as

[jira] [Updated] (HDFS-15188) Add option to set Write/Read timeout extension for different StorageType

[ https://issues.apache.org/jira/browse/HDFS-15188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15188: Priority: Minor (was: Major) > Add option to set Write/Read timeout extension for different StorageType >

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043353#comment-17043353 ] Ayush Saxena commented on HDFS-15186: - [~yaoguangdong] he hasn't fixed this problem, he fixed a

[jira] [Comment Edited] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043286#comment-17043286 ] Yao Guangdong edited comment on HDFS-15186 at 2/24/20 10:06 AM:

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043286#comment-17043286 ] Yao Guangdong commented on HDFS-15186: -- [~ayushtkn], OK. Thanks  for your reply. [~gjhkael] had been

[jira] [Commented] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

[ https://issues.apache.org/jira/browse/HDFS-15120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043268#comment-17043268 ] Ayush Saxena commented on HDFS-15120: - Thanx [~LiJinglun] . Had a quick look. Couldn't check in full.

[jira] [Commented] (HDFS-15186) Erasure Coding: Decommission may generate the parity block's content with all 0 in some case

[ https://issues.apache.org/jira/browse/HDFS-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043266#comment-17043266 ] Ayush Saxena commented on HDFS-15186: - Decommissioning taking time is another aspect, we can't mix it

[jira] [Updated] (HDFS-15025) Applying NVDIMM storage media to HDFS

[ https://issues.apache.org/jira/browse/HDFS-15025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hadoop_hdfs_hw updated HDFS-15025: -- Attachment: HDFS-15025.001.patch Release Note: Adding the new storage media NVDIMM and

[jira] [Commented] (HDFS-14854) Create improved decommission monitor implementation

[ https://issues.apache.org/jira/browse/HDFS-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043257#comment-17043257 ] Ayush Saxena commented on HDFS-14854: - Tried decommissioning using this with 30 Lack blocks, 3

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17043209#comment-17043209 ] Andrea commented on HDFS-15098: --- This patch can be used whice  hadoop version  and openssl version ? > Add