[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Status: Open (was: Patch Available) > Add SM4 encryption method for HDFS > -- >

[jira] [Comment Edited] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111786#comment-17111786 ] Yang Yun edited comment on HDFS-15280 at 5/20/20, 5:19 AM: --- Thanks

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111786#comment-17111786 ] Yang Yun commented on HDFS-15280: - Thanks [~hexiaoqiao] for the information.  Yes, add a more

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111763#comment-17111763 ] Yang Yun commented on HDFS-15355: - Thanks [~elgoiri] for the review. Updated to HDFS-15355.010.patch

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.010.patch Status: Patch Available (was: Open) > Make the default block

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111744#comment-17111744 ] Xiaoqiao He commented on HDFS-13183: Hi [~weichiu],[~Jim_Brennan] I am sure the failed unit test

[jira] [Comment Edited] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111728#comment-17111728 ] liuyanyu edited comment on HDFS-15365 at 5/20/20, 3:58 AM: --- As I check the

[jira] [Comment Edited] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111728#comment-17111728 ] liuyanyu edited comment on HDFS-15365 at 5/20/20, 3:56 AM: --- As I check the

[jira] [Commented] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111728#comment-17111728 ] liuyanyu commented on HDFS-15365: - As I check the code, the part marked in the figure should use

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: image-2020-05-20-11-55-34-115.png > [RBF] findMatching method return wrong result >

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: (was: image-2020-05-20-11-48-20-257.png) > [RBF] findMatching method return wrong result >

[jira] [Commented] (HDFS-15168) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111725#comment-17111725 ] Hadoop QA commented on HDFS-15168: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: image-2020-05-20-11-48-20-257.png > [RBF] findMatching method return wrong result >

[jira] [Created] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
liuyanyu created HDFS-15365: --- Summary: [RBF] findMatching method return wrong result Key: HDFS-15365 URL: https://issues.apache.org/jira/browse/HDFS-15365 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111722#comment-17111722 ] Xiaoqiao He commented on HDFS-15280: Thanks [~weichiu] involve me here. [~hadoop_yangyun], Just have

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Description: SM4 (formerly SMS4)is a block cipher used in the Chinese National Standard for Wireless LAN WAPI

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111720#comment-17111720 ] zZtai commented on HDFS-15098: -- [~Andrea_Julianos_one] I think it's because the  default value of

[jira] [Issue Comment Deleted] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Comment: was deleted (was: add test cases) > Add SM4 encryption method for HDFS >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111707#comment-17111707 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] and [~Jim_Brennan] for your reminder, I will

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111704#comment-17111704 ] Yiqun Lin commented on HDFS-15346: -- Hi [~LiJinglun], HDFS-15340 is merged now.  I suggest you can split

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111703#comment-17111703 ] Hudson commented on HDFS-15340: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18278 (See

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15340: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111701#comment-17111701 ] Yiqun Lin commented on HDFS-15340: -- [~ayushtkn], [~elgoiri], thanks for your confirmation.  Committed

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111641#comment-17111641 ] Wei-Chiu Chuang commented on HDFS-15221: Kicking off a rebuild:

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111628#comment-17111628 ] Wei-Chiu Chuang commented on HDFS-13183: Thanks Jim [~hexiaoqiao] how do you think? I can revert

[jira] [Updated] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9376: --- Fix Version/s: 2.10.1 > TestSeveralNameNodes fails occasionally >

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111617#comment-17111617 ] Masatake Iwasaki commented on HDFS-9376: Thanks for pinging me [~Jim_Brennan]. I cherry-picked

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111586#comment-17111586 ] Jim Brennan commented on HDFS-13183: More importantly, because it will never return NO_MOVE_PROGRESS,

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111582#comment-17111582 ] Jim Brennan commented on HDFS-14960: I believe this failure is actually due to HDFS-13183.  I have

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111578#comment-17111578 ] Jim Brennan commented on HDFS-13183: [~weichiu], [~hexiaoqiao], I believe this change is causing

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

2020-05-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15293: --- Fix Version/s: 3.4.0 Hey [~vagarychen] trunk is actually 3.4 now. Adding to Fix

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111555#comment-17111555 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-05-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111480#comment-17111480 ] Stephen O'Donnell commented on HDFS-15160: -- [~zhuqi] I was wondering if you are still running

[jira] [Updated] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15259: Resolution: Won't Fix Status: Resolved (was: Patch Available) > Reduce useless log information in

[jira] [Commented] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111469#comment-17111469 ] Hadoop QA commented on HDFS-15364: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111459#comment-17111459 ] Wei-Chiu Chuang commented on HDFS-15280: This is basically creating a random backoff mechanism

[jira] [Commented] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111456#comment-17111456 ] Chao Sun commented on HDFS-15259: - Yup. I think it is a won't fix. > Reduce useless log information in

[jira] [Commented] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111453#comment-17111453 ] Wei-Chiu Chuang commented on HDFS-15259: Are we in agreement this is a won't fix? > Reduce

[jira] [Updated] (HDFS-14627) Improvements to make slow archive storage works on HDFS

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14627: --- Issue Type: New Feature (was: Improvement) > Improvements to make slow archive storage

[jira] [Commented] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111447#comment-17111447 ] Hadoop QA commented on HDFS-15363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111421#comment-17111421 ] hemanthboyina commented on HDFS-15362: -- thanks [~elgoiri] for the review we call

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111420#comment-17111420 ] Ayush Saxena commented on HDFS-15288: - Have removed the NPE check, Added static imports, more

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-03.patch > Add Available Space Rack Fault Tolerant BPP >

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111416#comment-17111416 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111402#comment-17111402 ] Íñigo Goiri commented on HDFS-15340: +1 on [^HDFS-15340.008.patch]. > RBF: Implement

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111391#comment-17111391 ] Hadoop QA commented on HDFS-15355: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111386#comment-17111386 ] Íñigo Goiri commented on HDFS-15288: OK, let's keep the 0 to 1 range for consistency; let's add the

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111383#comment-17111383 ] Íñigo Goiri commented on HDFS-15362: Thanks [~hemanthboyina] for the patch. In the test, I think it

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111373#comment-17111373 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111372#comment-17111372 ] Hadoop QA commented on HDFS-12733: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111363#comment-17111363 ] Ayush Saxena commented on HDFS-15359: - Yes, the test verifies two scenarios : *First Scenario :* In

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111359#comment-17111359 ] Wei-Chiu Chuang commented on HDFS-15315: We did not certify HBase on EC at Cloudera so I don't

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111352#comment-17111352 ] Wei-Chiu Chuang commented on HDFS-15359: What does the test check? Looks to me the added test

[jira] [Updated] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Summary: Support sort the output according to the number of occurrences of the opcode for

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: (was: HDFS-15364.001.patch) > Sort the output according to the number of occurrences of the

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Open (was: Patch Available) > Sort the output according to the number of occurrences of the opcode

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Patch Available (was: Open) > Sort the output according to the number of occurrences of the opcode

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: (was: HDFS-15364.001.patch) > Sort the output according to the number of occurrences of the

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Priority: Minor (was: Major) > Sort the output according to the number of occurrences of the opcode for >

[jira] [Commented] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111318#comment-17111318 ] Hadoop QA commented on HDFS-15364: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111311#comment-17111311 ] bianqi commented on HDFS-15364: --- Initial patch attached. please review. > Sort the output according to the

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Patch Available (was: Open) > Sort the output according to the number of occurrences of the opcode

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Created] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
bianqi created HDFS-15364: - Summary: Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor Key: HDFS-15364 URL: https://issues.apache.org/jira/browse/HDFS-15364

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363.001.patch Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111297#comment-17111297 ] Ayush Saxena commented on HDFS-15340: - Thanx [~linyiqun] for holding, I had a quick look on it, my

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363-testrepro.patch > BlockPlacementPolicyWithNodeGroup should validate

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111271#comment-17111271 ] Ayush Saxena commented on HDFS-15288: - Thanx [~elgoiri] for the review. bq. If we are converting the

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111269#comment-17111269 ] Jim Brennan commented on HDFS-9376: --- [~cnauroth], [~iwasakims], [~kihwal] I know this is a pretty old

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111267#comment-17111267 ] Lisheng Sun commented on HDFS-13639:   ||case|| || |Before Case|perf_before_improve_SlotReleaser.png|

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111256#comment-17111256 ] Ayush Saxena commented on HDFS-15093: - Thanx [~elgoiri] for the review. Have added the error message

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Description: When test the performance of the ShortCircuit Read of the HDFS with YCSB, we find that

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-04.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified >

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: (was: image-2020-05-17-23-53-41-115.png) > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111252#comment-17111252 ] Íñigo Goiri commented on HDFS-15355: Thanks [~hadoop_yangyun] for the update, this looks way more

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111248#comment-17111248 ] Íñigo Goiri commented on HDFS-15093: Let's take care of the checkstyle; usually good practice to not

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111247#comment-17111247 ] Íñigo Goiri commented on HDFS-15288: Wow, that conf key length is something :) Is there something we

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-03.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified >

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111215#comment-17111215 ] Jim Brennan commented on HDFS-14960: I will investigate and resolve the unit test failure and put up

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1796#comment-1796 ] Yang Yun commented on HDFS-15355: - Updated to HDFS-15355.009.patch for unit test issues. > Make the

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.009.patch Status: Patch Available (was: Open) > Make the default block

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Description: BlockPlacementPolicyWithNodeGroup  type casts the initialized  clusterMap 

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: (was: HDFS-12733.009.patch) > Option to disable to namenode local edits >

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits >

[jira] [Created] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15363: Summary: BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology Key: HDFS-15363 URL: https://issues.apache.org/jira/browse/HDFS-15363

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1777#comment-1777 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] Should we commit this patch to trunk? Thank you.

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1770#comment-1770 ] Xiaoqiao He commented on HDFS-12733: Hi [~ayushtkn] [~elgoiri], [^HDFS-12733.009.patch] I try to add

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits >

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1734#comment-1734 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111098#comment-17111098 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Status: Open (was: Patch Available) > SlotReleaser is not fast enough >

[jira] [Work started] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13639 started by Lisheng Sun. -- > SlotReleaser is not fast enough > --- > >

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-02.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified >

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110973#comment-17110973 ] Ayush Saxena commented on HDFS-15093: - Added a quick test, ensuring both options reaches namenode. >

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110958#comment-17110958 ] Ayush Saxena commented on HDFS-15359: - Test failures due to {{java.lang.OutOfMemoryError: unable to

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110951#comment-17110951 ] Hadoop QA commented on HDFS-15359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >