[jira] [Updated] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Doris Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-15097: Status: Patch Available (was: Open) > Purge log in KMS and HttpFS > --- > >

[jira] [Created] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
Yang Yun created HDFS-15104: --- Summary: If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true. Key: HDFS-15104 URL: https://issues.apache.org/jira/browse/HDFS-15104

[jira] [Created] (HDFS-15102) HttpFS : put operation is not supported with path "/"

2020-01-09 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15102: Summary: HttpFS : put operation is not supported with path "/" Key: HDFS-15102 URL: https://issues.apache.org/jira/browse/HDFS-15102 Project: Hadoop HDFS

[jira] [Created] (HDFS-15103) JMX endpoint and "dfsadmin" report 1 corrupt block; "fsck" reports 0

2020-01-09 Thread Mark Ormesher (Jira)
Mark Ormesher created HDFS-15103: Summary: JMX endpoint and "dfsadmin" report 1 corrupt block; "fsck" reports 0 Key: HDFS-15103 URL: https://issues.apache.org/jira/browse/HDFS-15103 Project: Hadoop

[jira] [Commented] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Doris Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011600#comment-17011600 ] Doris Gu commented on HDFS-15097: - Thanks, [~weichiu].  By the way, since no other use of class 

[jira] [Commented] (HDFS-15102) HttpFS : put operation is not supported with path "/"

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011691#comment-17011691 ] Hadoop QA commented on HDFS-15102: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011718#comment-17011718 ] Hadoop QA commented on HDFS-15097: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: (was: image-2020-01-09-17-56-13-814.png) > Optimize heartbeat

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: (was: image-2020-01-09-17-45-50-076.png) > Optimize heartbeat

[jira] [Updated] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15104: Issue Type: Bug (was: Improvement) > If block is not reported by any Datanode, the flag corrupt of

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: image-2020-01-09-17-45-50-076.png > Optimize heartbeat for large

[jira] [Commented] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011764#comment-17011764 ] Surendra Singh Lilhore commented on HDFS-15067: --- Design Idea : = Added two new

[jira] [Commented] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011572#comment-17011572 ] Wei-Chiu Chuang commented on HDFS-15097: Good catch. +1 > Purge log in KMS and HttpFS >

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: image-2020-01-09-18-00-49-556.png > Optimize heartbeat for large

[jira] [Comment Edited] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011549#comment-17011549 ] Vinayakumar B edited comment on HDFS-14578 at 1/9/20 8:36 AM: -- Code change

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011549#comment-17011549 ] Vinayakumar B commented on HDFS-14578: -- Code change looks good. some improvements required in tests.

[jira] [Updated] (HDFS-15102) HttpFS : put operation is not supported with path "/"

2020-01-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15102: - Attachment: HDFS-15102.001.patch Status: Patch Available (was: Open) > HttpFS : put

[jira] [Updated] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15104: Attachment: HDFS-15104.patch Assignee: Yang Yun Status: Patch Available (was: Open) > If

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: image-2020-01-09-17-56-13-814.png > Optimize heartbeat for large

[jira] [Commented] (HDFS-15087) RBF: Balance/Rename across federation namespaces

2020-01-09 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011801#comment-17011801 ] Jinglun commented on HDFS-15087: I think we can separate it to subtasks below: * saveTree rpc: save src

[jira] [Created] (HDFS-15106) Remove unused code.

2020-01-09 Thread Jinglun (Jira)
Jinglun created HDFS-15106: -- Summary: Remove unused code. Key: HDFS-15106 URL: https://issues.apache.org/jira/browse/HDFS-15106 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] [Updated] (HDFS-15106) Remove unused code.

2020-01-09 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15106: --- Attachment: HDFS-15106.001.patch Status: Patch Available (was: Open) > Remove unused code. >

[jira] [Updated] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

2020-01-09 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated HDFS-15105: Description: We found a issue that Standby NN exited and failed to restart until we resolved the edit log

[jira] [Commented] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011784#comment-17011784 ] Surendra Singh Lilhore commented on HDFS-15067: --- Attached initial patch for review and

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Status: Patch Available (was: Open) > Optimize heartbeat for large cluster >

[jira] [Created] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15108: --- Summary: RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update Key: HDFS-15108 URL: https://issues.apache.org/jira/browse/HDFS-15108

[jira] [Commented] (HDFS-15083) Add new trash rpc which move the trash (mkdir and the rename) operation to the server side.

2020-01-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011798#comment-17011798 ] Wei-Chiu Chuang commented on HDFS-15083: Also, the existing trash implementation is pluggable,

[jira] [Updated] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15107: Attachment: HDFS-15107-01.patch > dfs.client.server-defaults.validity.period.ms to support time

[jira] [Updated] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15107: Status: Patch Available (was: Open) > dfs.client.server-defaults.validity.period.ms to support

[jira] [Updated] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-15067: -- Attachment: HDFS-15067.01.patch > Optimize heartbeat for large cluster >

[jira] [Commented] (HDFS-15067) Optimize heartbeat for large cluster

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011790#comment-17011790 ] Hadoop QA commented on HDFS-15067: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15083) Add new trash rpc which move the trash (mkdir and the rename) operation to the server side.

2020-01-09 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011794#comment-17011794 ] Wei-Chiu Chuang commented on HDFS-15083: This patch is not going to work for cloud storage as

[jira] [Commented] (HDFS-15104) If block is not reported by any Datanode, the flag corrupt of BlockLocation should be marked as true.

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011836#comment-17011836 ] Hadoop QA commented on HDFS-15104: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

2020-01-09 Thread Tao Yang (Jira)
Tao Yang created HDFS-15105: --- Summary: Standby NN exits and fails to restart due to edit log corruption Key: HDFS-15105 URL: https://issues.apache.org/jira/browse/HDFS-15105 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15108: Status: Patch Available (was: Open) > RBF: MembershipNamenodeResolver should invalidate cache

[jira] [Updated] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15108: Attachment: HDFS-15108-01.patch > RBF: MembershipNamenodeResolver should invalidate cache incase

[jira] [Commented] (HDFS-7765) FSOutputSummer throwing ArrayIndexOutOfBoundsException

2020-01-09 Thread Jonathan Turner Eagles (Jira)
[ https://issues.apache.org/jira/browse/HDFS-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012009#comment-17012009 ] Jonathan Turner Eagles commented on HDFS-7765: -- [~wanghongbing], would you be willing to take

[jira] [Commented] (HDFS-15106) Remove unused code.

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012012#comment-17012012 ] Hadoop QA commented on HDFS-15106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012084#comment-17012084 ] Íñigo Goiri commented on HDFS-15108: Thanks for bringing this up, can you give a little more context

[jira] [Updated] (HDFS-15102) HttpFS: put operation is not supported with path "/"

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15102: --- Summary: HttpFS: put operation is not supported with path "/" (was: HttpFS : put operation is not

[jira] [Commented] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012130#comment-17012130 ] Ayush Saxena commented on HDFS-15108: - In {{RouterRpcClient#InvokeMethod}} L425, if failover occurs,

[jira] [Commented] (HDFS-15100) RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012072#comment-17012072 ] Íñigo Goiri commented on HDFS-15100: A little verbose but I guess that's what we need, let me comment

[jira] [Commented] (HDFS-15078) RBF: Should check connection channel before sending rpc to namenode

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012082#comment-17012082 ] Íñigo Goiri commented on HDFS-15078: Just to summarize, I agree with [~ayushtkn] that the final

[jira] [Commented] (HDFS-15102) HttpFS: put operation is not supported with path "/"

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012101#comment-17012101 ] Íñigo Goiri commented on HDFS-15102: In what case have you seen issues? Can you update the

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012106#comment-17012106 ] Hadoop QA commented on HDFS-14578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012088#comment-17012088 ] Íñigo Goiri commented on HDFS-15107: Do we want to change the value in hdfs-default.xml to be 2s?

[jira] [Commented] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012129#comment-17012129 ] hemanthboyina commented on HDFS-15102: -- faced an issue while implementing enableECPolicy for HttpFS 

[jira] [Updated] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15102: - Description: PUT requests in HttpFS with  path as "/" were not supported .   > HttpFS: put

[jira] [Updated] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15108: Attachment: HDFS-15108-02.patch > RBF: MembershipNamenodeResolver should invalidate cache incase

[jira] [Updated] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14578: Attachment: HDFS-14578-06.patch > AvailableSpaceBlockPlacementPolicy always prefers local node >

[jira] [Updated] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14578: Attachment: (was: HDFS-14578-06.patch) > AvailableSpaceBlockPlacementPolicy always prefers

[jira] [Updated] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14578: Attachment: HDFS-14578-06.patch > AvailableSpaceBlockPlacementPolicy always prefers local node >

[jira] [Commented] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012058#comment-17012058 ] Hadoop QA commented on HDFS-15108: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15102: - Summary: HttpFS: put requests are not supported for path "/" (was: HttpFS: put operation is not

[jira] [Updated] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15108: Attachment: (was: HDFS-15108-02.patch) > RBF: MembershipNamenodeResolver should invalidate

[jira] [Updated] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15108: Attachment: HDFS-15108-02.patch > RBF: MembershipNamenodeResolver should invalidate cache incase

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012133#comment-17012133 ] Ayush Saxena commented on HDFS-15107: - Thanx [~elgoiri] for the review. I followed the same way as in

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012154#comment-17012154 ] Ayush Saxena commented on HDFS-14578: - Thanx [~vinayakumarb] for the review, Changed the test as per

[jira] [Updated] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14578: Attachment: HDFS-14578-05.patch > AvailableSpaceBlockPlacementPolicy always prefers local node >

[jira] [Assigned] (HDFS-15106) Remove unused code.

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15106: --- Assignee: Jinglun (was: Ayush Saxena) > Remove unused code. > --- > >

[jira] [Assigned] (HDFS-15106) Remove unused code.

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15106: --- Assignee: Ayush Saxena (was: Jinglun) > Remove unused code. > --- > >

[jira] [Commented] (HDFS-15106) Remove unused code.

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011942#comment-17011942 ] Ayush Saxena commented on HDFS-15106: - +1(Pending Jenkins) > Remove unused code. >

[jira] [Created] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15107: --- Summary: dfs.client.server-defaults.validity.period.ms to support time units Key: HDFS-15107 URL: https://issues.apache.org/jira/browse/HDFS-15107 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15071) Add DataNode Read and Write throughput percentile metrics

2020-01-09 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012176#comment-17012176 ] Danny Becker commented on HDFS-15071: - v003 should fix all checkstyle errors except for two "line

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012183#comment-17012183 ] Hadoop QA commented on HDFS-15107: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012249#comment-17012249 ] Hadoop QA commented on HDFS-14578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012172#comment-17012172 ] Hadoop QA commented on HDFS-15108: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012219#comment-17012219 ] Íñigo Goiri commented on HDFS-15107: I think the failed tests are unrelated. +1 on

[jira] [Assigned] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

2020-01-09 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HDFS-15099: -- Assignee: Chen Liang > [SBN Read] getBlockLocations() should throw

[jira] [Updated] (HDFS-15071) Add DataNode Read and Write throughput percentile metrics

2020-01-09 Thread Danny Becker (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Becker updated HDFS-15071: Attachment: HDFS-15071.003.patch > Add DataNode Read and Write throughput percentile metrics >

[jira] [Commented] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012223#comment-17012223 ] Íñigo Goiri commented on HDFS-15108: Can we do a better cleanup of the cache and just remove what we

[jira] [Comment Edited] (HDFS-15108) RBF: MembershipNamenodeResolver should invalidate cache incase of active namenode update

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012223#comment-17012223 ] Íñigo Goiri edited comment on HDFS-15108 at 1/9/20 8:51 PM: Can we do a

[jira] [Commented] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012224#comment-17012224 ] Íñigo Goiri commented on HDFS-15102: OK, so we are just doing the same as the GET does. +1 > HttpFS:

[jira] [Updated] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15102: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Comment Edited] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012332#comment-17012332 ] Takanobu Asanuma edited comment on HDFS-15102 at 1/10/20 12:48 AM: --- +1.

[jira] [Commented] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012332#comment-17012332 ] Takanobu Asanuma commented on HDFS-15102: - +1. I'd like to make this jira a subtask of 

[jira] [Commented] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012339#comment-17012339 ] Hudson commented on HDFS-15102: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17840 (See

[jira] [Commented] (HDFS-15102) HttpFS: put requests are not supported for path "/"

2020-01-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012335#comment-17012335 ] Takanobu Asanuma commented on HDFS-15102: - BTW, I think we also need postRoot, like when

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012342#comment-17012342 ] Hadoop QA commented on HDFS-15107: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15071) Add DataNode Read and Write throughput percentile metrics

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012290#comment-17012290 ] Hadoop QA commented on HDFS-15071: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012530#comment-17012530 ] Vinayakumar B commented on HDFS-14578: --

[jira] [Commented] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012535#comment-17012535 ] Hadoop QA commented on HDFS-15099: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14578: Attachment: HDFS-14578-07.patch > AvailableSpaceBlockPlacementPolicy always prefers local node >

[jira] [Updated] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

2020-01-09 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated HDFS-15105: Description: We found a issue that Standby NN exited and failed to restart until we resolved the edit log

[jira] [Created] (HDFS-15110) HttpFS : post requests are not supported for path "/"

2020-01-09 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15110: Summary: HttpFS : post requests are not supported for path "/" Key: HDFS-15110 URL: https://issues.apache.org/jira/browse/HDFS-15110 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15100) RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode

2020-01-09 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15100: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-15100) RBF: Print stacktrace when DFSRouter fails to fetch/parse JMX output from NameNode

2020-01-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012448#comment-17012448 ] Hudson commented on HDFS-15100: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17842 (See

[jira] [Commented] (HDFS-14578) AvailableSpaceBlockPlacementPolicy always prefers local node

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012481#comment-17012481 ] Hadoop QA commented on HDFS-14578: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15105) Standby NN exits and fails to restart due to edit log corruption

2020-01-09 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012512#comment-17012512 ] Tao Yang commented on HDFS-15105: - Hi, [~xiaochen], I noticed that you have fixed an issue which might

[jira] [Commented] (HDFS-14787) NameNode error

2020-01-09 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012519#comment-17012519 ] Tao Yang commented on HDFS-14787: - Hi, [~lucao], any updates about this issue? We have found a similar

[jira] [Commented] (HDFS-15110) HttpFS : post requests are not supported for path "/"

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012523#comment-17012523 ] Hadoop QA commented on HDFS-15110: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

2020-01-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Attachment: HDFS-15099-branch-2.10.001.patch > [SBN Read] getBlockLocations() should throw

[jira] [Updated] (HDFS-15099) [SBN Read] getBlockLocations() should throw ObserverRetryOnActiveException on an attempt to change aTime on ObserverNode

2020-01-09 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-15099: -- Status: Patch Available (was: Open) > [SBN Read] getBlockLocations() should throw

[jira] [Updated] (HDFS-15110) HttpFS : post requests are not supported for path "/"

2020-01-09 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15110: - Attachment: HDFS-15110.001.patch Status: Patch Available (was: Open) > HttpFS : post

[jira] [Updated] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Doris Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-15097: Status: Patch Available (was: Open) > Purge log in KMS and HttpFS > --- > >

[jira] [Updated] (HDFS-15097) Purge log in KMS and HttpFS

2020-01-09 Thread Doris Gu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Gu updated HDFS-15097: Status: Open (was: Patch Available) > Purge log in KMS and HttpFS > --- > >

[jira] [Commented] (HDFS-15110) HttpFS : post requests are not supported for path "/"

2020-01-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012491#comment-17012491 ] Hadoop QA commented on HDFS-15110: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15107: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012415#comment-17012415 ] Ayush Saxena commented on HDFS-15107: - Committed to trunk. Thanx [~elgoiri] for the review!!! >

[jira] [Commented] (HDFS-15107) dfs.client.server-defaults.validity.period.ms to support time units

2020-01-09 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012417#comment-17012417 ] Hudson commented on HDFS-15107: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17841 (See

  1   2   >