[jira] [Assigned] (HDFS-13571) Dead datanode detector

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13571: -- Assignee: Lisheng Sun > Dead datanode detector > -- > >

[jira] [Assigned] (HDFS-13639) SlotReleaser is not fast enough

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun reassigned HDFS-13639: -- Assignee: Lisheng Sun > SlotReleaser is not fast enough > --- > >

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879641#comment-16879641 ] Jinglun commented on HDFS-14631: Hi [~hexiaoqiao], do you have time for this? Or do you know who is the

[jira] [Comment Edited] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879641#comment-16879641 ] Jinglun edited comment on HDFS-14631 at 7/6/19 10:29 AM: - Hi [~hexiaoqiao], do

[jira] [Commented] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879657#comment-16879657 ] Jinglun commented on HDFS-14568: Hi [~ayushtkn], before the change setStoragePolicy() throws IOException

[jira] [Comment Edited] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879657#comment-16879657 ] Jinglun edited comment on HDFS-14568 at 7/6/19 11:42 AM: - Hi [~ayushtkn], thanks

[jira] [Created] (HDFS-14633) The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
Jinglun created HDFS-14633: -- Summary: The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc. Key: HDFS-14633 URL: https://issues.apache.org/jira/browse/HDFS-14633

[jira] [Updated] (HDFS-14568) setStoragePolicy should check quota and update consume on storage type quota.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14568: --- Summary: setStoragePolicy should check quota and update consume on storage type quota. (was: The quota and

[jira] [Updated] (HDFS-14633) The StorageType qutoa and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType qutoa and consume in QuotaFeature is not handled when addBlock, delete, rename,

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Summary: The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename,

[jira] [Commented] (HDFS-14633) The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879660#comment-16879660 ] Jinglun commented on HDFS-14633: Hi [~ayushtkn] [~jojochuang] [~xkrogen] [~hexiaoqiao], do you have time

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14483: --- Attachment: HDFS-14585.branch-2.9.v3.patch > Backport HDFS-14111,HDFS-3246 ByteBuffer pread

[jira] [Updated] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-14633: --- Description: The NameNode manages the global state of the cluster. We should always take NameNode's records

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879664#comment-16879664 ] Lisheng Sun commented on HDFS-14483: Sorry [~stack], I find this problem. There is a error in UT of

[jira] [Commented] (HDFS-14625) Make DefaultAuditLogger class in FSnamesystem to Abstract

2019-07-06 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879666#comment-16879666 ] hemanthboyina commented on HDFS-14625: -- thanks [~elgoiri] for your review and suggestions  have

[jira] [Commented] (HDFS-14257) NPE when given the Invalid path to create target dir

2019-07-06 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879673#comment-16879673 ] hemanthboyina commented on HDFS-14257: -- [~elgoiri]  i think the issue was related to RBF if we run

[jira] [Commented] (HDFS-14227) RBF:HDFS "dfsadmin -printTopology" not displaying the rack details properly

2019-07-06 Thread hemanthboyina (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879674#comment-16879674 ] hemanthboyina commented on HDFS-14227: -- [~elgoiri] this defect is valid one right ? > RBF:HDFS

[jira] [Commented] (HDFS-13694) Making md5 computing being in parallel with image loading

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879783#comment-16879783 ] Lisheng Sun commented on HDFS-13694: [~elgoiri] I think it should cherry-pick to branch-3.2,

[jira] [Commented] (HDFS-13694) Making md5 computing being in parallel with image loading

2019-07-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879764#comment-16879764 ] Íñigo Goiri commented on HDFS-13694: [~leosun08], which versions do you think this should be

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879698#comment-16879698 ] Lisheng Sun commented on HDFS-14483:     I also confirm UT is ok in TestNameNodeHttpServerXFrame

[jira] [Updated] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-14483: - Attachment: HDFS-14585.branch-2.9.v3.patch > Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to

[jira] [Commented] (HDFS-14483) Backport HDFS-14111,HDFS-3246 ByteBuffer pread interface to branch-2.9

2019-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879684#comment-16879684 ] Hadoop QA commented on HDFS-14483: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14257) NPE when given the Invalid path to create target dir

2019-07-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879763#comment-16879763 ] Íñigo Goiri commented on HDFS-14257: Can you provide a unit test? > NPE when given the Invalid path

[jira] [Commented] (HDFS-14227) RBF:HDFS "dfsadmin -printTopology" not displaying the rack details properly

2019-07-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879762#comment-16879762 ] Íñigo Goiri commented on HDFS-14227: Does this have to do with RBF? It might be. This seems to query

[jira] [Updated] (HDFS-14227) RBF: HDFS "dfsadmin -printTopology" not displaying the rack details properly

2019-07-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-14227: --- Summary: RBF: HDFS "dfsadmin -printTopology" not displaying the rack details properly (was:

[jira] [Commented] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-07-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879791#comment-16879791 ] He Xiaoqiao commented on HDFS-14631: Thanks for report and patch it. I would like to review this

[jira] [Commented] (HDFS-14625) Make DefaultAuditLogger class in FSnamesystem to Abstract

2019-07-06 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879761#comment-16879761 ] Íñigo Goiri commented on HDFS-14625: [~hemanthboyina], nothing major, just that now you have: {code}

[jira] [Commented] (HDFS-14633) The StorageType quota and consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879792#comment-16879792 ] He Xiaoqiao commented on HDFS-14633: Thanks for the ping. To be honest, I am not expert and no