[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087949#comment-17087949 ] Wei-Chiu Chuang commented on HDFS-15287: [~cliang] [~shv] could you look into this? > HDFS

[jira] [Created] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-04-20 Thread Ayush Saxena (Jira)
Ayush Saxena created HDFS-15288: --- Summary: Add Available Space Rack Fault Tolerant BPP Key: HDFS-15288 URL: https://issues.apache.org/jira/browse/HDFS-15288 Project: Hadoop HDFS Issue Type:

[jira] [Comment Edited] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee edited comment on HDFS-14504 at 4/20/20, 4:25 PM:

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-10499: - Attachment: HDFS-10499-branch-2.10.003.patch >

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088024#comment-17088024 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087997#comment-17087997 ] Ayush Saxena commented on HDFS-15278: - Thanx for the discussion here. Sorry, couldn't check the

[jira] [Created] (HDFS-15289) Allow viewfs mounts with hdfs scheme and centralized mount table

2020-04-20 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15289: -- Summary: Allow viewfs mounts with hdfs scheme and centralized mount table Key: HDFS-15289 URL: https://issues.apache.org/jira/browse/HDFS-15289 Project:

[jira] [Commented] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee commented on HDFS-14504: Thanks [~hemanthboyina] for updating the patch. 

[jira] [Comment Edited] (HDFS-14504) Rename with Snapshots does not honor quota limit

2020-04-20 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087899#comment-17087899 ] Shashikant Banerjee edited comment on HDFS-14504 at 4/20/20, 4:17 PM:

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087941#comment-17087941 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2020-04-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088127#comment-17088127 ] Chen Liang commented on HDFS-12979: --- [~kihwal], it is disabled in minidsfscluter because there are

[jira] [Created] (HDFS-15290) NPE in HttpServer during NameNode startup

2020-04-20 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-15290: -- Summary: NPE in HttpServer during NameNode startup Key: HDFS-15290 URL: https://issues.apache.org/jira/browse/HDFS-15290 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088045#comment-17088045 ] Wei-Chiu Chuang commented on HDFS-15287: Does it require multiple standby namenodes, observer

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088072#comment-17088072 ] Kihwal Lee commented on HDFS-15287: --- It has nothing to do with observer. The active namenode defaults

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088079#comment-17088079 ] Chen Liang commented on HDFS-15287: --- In case of roll back image, this check {code}

[jira] [Created] (HDFS-15291) [SBN read] Implement CyclicalBlockingQueue to avoid requing RPC calls on Observer.

2020-04-20 Thread Konstantin Shvachko (Jira)
Konstantin Shvachko created HDFS-15291: -- Summary: [SBN read] Implement CyclicalBlockingQueue to avoid requing RPC calls on Observer. Key: HDFS-15291 URL: https://issues.apache.org/jira/browse/HDFS-15291

[jira] [Commented] (HDFS-15290) NPE in HttpServer during NameNode startup

2020-04-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088200#comment-17088200 ] Konstantin Shvachko commented on HDFS-15290: Here is the exception. I saw it on branch-27,

[jira] [Updated] (HDFS-15291) [SBN read] Implement CyclicalBlockingQueue to avoid requing RPC calls on Observer.

2020-04-20 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15291: --- Description: RPC queue is currently based on {{LinkedBlockingQueue}}, which is FIFO.

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-10499: - Attachment: HDFS-10499-branch-2.8.001.patch >

[jira] [Updated] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-14742: - Fix Version/s: (was: 3.4.0) 3.3.0 Thank you [~inigoiri] for your review.

[jira] [Commented] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088309#comment-17088309 ] Hadoop QA commented on HDFS-10499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10499) TestNameNodeMetadataConsistency#testGenerationStampInFuture Fails Intermittently

2020-04-20 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-10499: - Attachment: HDFS-10499-branch-2.10.002.patch >

[jira] [Updated] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14742: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087861#comment-17087861 ] Íñigo Goiri commented on HDFS-14742: Thanks [~aajisaka] for the fix. I merged the PR, feel free to

[jira] [Commented] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087884#comment-17087884 ] Hudson commented on HDFS-14742: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18169 (See

[jira] [Commented] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087529#comment-17087529 ] Hadoop QA commented on HDFS-15278: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-20 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087399#comment-17087399 ] Mingliang Liu edited comment on HDFS-15281 at 4/20/20, 6:12 AM: I'm +1 on

[jira] [Commented] (HDFS-15281) ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address

2020-04-20 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087399#comment-17087399 ] Mingliang Liu commented on HDFS-15281: -- I'm +1 on this idea. I'll leave comments in the PR.

[jira] [Commented] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087409#comment-17087409 ] Yang Yun commented on HDFS-15278: - Thanks [~liuml07] for the review. Yes, our use case can be satisfied

[jira] [Updated] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15278: Attachment: HDFS-15278.003.patch Status: Patch Available (was: Open) > After execute ‘-setrep 1’,

[jira] [Updated] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15278: Status: Open (was: Patch Available) > After execute ‘-setrep 1’, make sure that blocks of the file are

[jira] [Updated] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-14742: - Assignee: Akira Ajisaka (was: Chen Zhang) Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-14742: - Component/s: test > RBF:TestRouterFaultTolerant tests are flaky >

[jira] [Updated] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-14742: - Target Version/s: 3.3.0 > RBF:TestRouterFaultTolerant tests are flaky >

[jira] [Commented] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087537#comment-17087537 ] Akira Ajisaka commented on HDFS-14742: -- Thank you for your report [~zhangchen]. I found the root

[jira] [Comment Edited] (HDFS-15278) After execute ‘-setrep 1’, make sure that blocks of the file are dispersed across different datanodes

2020-04-20 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087409#comment-17087409 ] Yang Yun edited comment on HDFS-15278 at 4/20/20, 9:35 AM: --- Thanks [~liuml07] 

[jira] [Comment Edited] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087554#comment-17087554 ] Akira Ajisaka edited comment on HDFS-14742 at 4/20/20, 9:47 AM: Hi

[jira] [Commented] (HDFS-14742) RBF:TestRouterFaultTolerant tests are flaky

2020-04-20 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087554#comment-17087554 ] Akira Ajisaka commented on HDFS-14742: -- Hi [~inigoiri] and [~ayushtkn], would you check the PR? >

[jira] [Commented] (HDFS-15275) HttpFS: Response of Create was not correct with noredirect and data are true

2020-04-20 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087796#comment-17087796 ] Hudson commented on HDFS-15275: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18168 (See

[jira] [Created] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Kihwal Lee (Jira)
Kihwal Lee created HDFS-15287: - Summary: HDFS rollingupgrade prepare never finishes Key: HDFS-15287 URL: https://issues.apache.org/jira/browse/HDFS-15287 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12979) StandbyNode should upload FsImage to ObserverNode after checkpointing.

2020-04-20 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087738#comment-17087738 ] Kihwal Lee commented on HDFS-12979: --- This breaks rolling upgrade. Filed a blocker, HDFS-15287. I found

[jira] [Commented] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087739#comment-17087739 ] Kihwal Lee commented on HDFS-15287: --- Even for non RU cases, checkpoints can happen more frequently than

[jira] [Updated] (HDFS-15287) HDFS rollingupgrade prepare never finishes

2020-04-20 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-15287: -- Description: After HDFS-12979, the prepare step of rolling upgrade does not work. This is because it

[jira] [Commented] (HDFS-15275) HttpFS: Response of Create was not correct with noredirect and data are true

2020-04-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087764#comment-17087764 ] Takanobu Asanuma commented on HDFS-15275: - [^HDFS-15275.002.patch] looks good to me. +1. >

[jira] [Updated] (HDFS-15275) HttpFS: Response of Create was not correct with noredirect and data are true

2020-04-20 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-15275: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch