[jira] [Commented] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

2020-05-08 Thread Babneet Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102609#comment-17102609 ] Babneet Singh commented on HDFS-15270: -- Requested issue's originator to respond regarding

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

2020-05-08 Thread heliangjun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102293#comment-17102293 ] heliangjun commented on HDFS-8432: -- [~arp] , Thank you for your reply . We have solved other upgrade and

[jira] [Commented] (HDFS-15343) TestConfiguredFailoverProxyProvider is failing

2020-05-08 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102375#comment-17102375 ] Hudson commented on HDFS-15343: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18229 (See

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

2020-05-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102435#comment-17102435 ] Hadoop QA commented on HDFS-15338: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15341) HDFS Move viewfs path to trash failed.

2020-05-08 Thread Vince.Feng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102541#comment-17102541 ] Vince.Feng commented on HDFS-15341: --- @[acmurthy|https://github.com/acmurthy] 

[jira] [Updated] (HDFS-15341) HDFS Move viewfs path to trash failed.

2020-05-08 Thread Vince.Feng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vince.Feng updated HDFS-15341: -- Description: When HDFS client with viewfs want to move file/directory to trash by RemoteUser or

[jira] [Commented] (HDFS-15341) HDFS Move viewfs path to trash failed.

2020-05-08 Thread Vince.Feng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102540#comment-17102540 ] Vince.Feng commented on HDFS-15341: --- Maybe the new method shoud be added to org.apache.hadoop.fs.Trash

[jira] [Created] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15344: - Summary: DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442 Key: HDFS-15344 URL: https://issues.apache.org/jira/browse/HDFS-15344 Project: Hadoop

[jira] [Updated] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15344: -- Status: Patch Available (was: Open) > DataNode#checkSuperuserPrivilege should use UGI#getGroups after

[jira] [Commented] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102786#comment-17102786 ] Xiaoyu Yao commented on HDFS-15344: --- Also find a similar issue in

[jira] [Created] (HDFS-15345) RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDFS-15345: - Summary: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442 Key: HDFS-15345 URL: https://issues.apache.org/jira/browse/HDFS-15345

[jira] [Updated] (HDFS-15345) RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-15345: -- Description: HADOOP-13442 added UGI#getGroups to avoid list->array->list conversions. This ticket is

[jira] [Comment Edited] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102677#comment-17102677 ] Yiqun Lin edited comment on HDFS-15294 at 5/8/20, 3:35 PM: --- Hi [~LiJinglun],

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

2020-05-08 Thread Vinayakumar B (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102653#comment-17102653 ] Vinayakumar B commented on HDFS-14999: -- changes looks fine to me. It would be better to have a

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102677#comment-17102677 ] Yiqun Lin commented on HDFS-15294: -- Hi [~LiJinglun], thanks for the great work on this! Some comments

[jira] [Commented] (HDFS-14999) Avoid Potential Infinite Loop in DFSNetworkTopology

2020-05-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102860#comment-17102860 ] Ayush Saxena commented on HDFS-14999: - Thanx [~vinayakumarb] for the review. I ran the said test. The

[jira] [Updated] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

2020-05-08 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-15345: --- Summary: RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after

[jira] [Updated] (HDFS-15306) Make mount-table to read from central place ( Let's say from HDFS)

2020-05-08 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15306: --- Status: Patch Available (was: Open) I updated the PR with idea of this patch. This

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Description: This jira introduces a new balance command 'fedbalance' that is ran by the administrator. The

[jira] [Created] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-08 Thread Jinglun (Jira)
Jinglun created HDFS-15346: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance. Key: HDFS-15346 URL: https://issues.apache.org/jira/browse/HDFS-15346

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103104#comment-17103104 ] Yiqun Lin commented on HDFS-15294: -- Hi [~LiJinglun], I agree that starting with distcp diff copy is a

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103114#comment-17103114 ] Jinglun commented on HDFS-15294: Hi [~linyiqun], thanks your comments, I agree with your opinion.

[jira] [Updated] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Description: Patch in HDFS-15294 is too big to review so we split it into 2 patches. This is the second one.

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103079#comment-17103079 ] Jinglun commented on HDFS-15294: Hi [~linyiqun], thanks your nice comments.  {quote}Current fedbalance

[jira] [Comment Edited] (HDFS-15306) Make mount-table to read from central place ( Let's say from HDFS)

2020-05-08 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103059#comment-17103059 ] Uma Maheswara Rao G edited comment on HDFS-15306 at 5/9/20, 2:27 AM: -

[jira] [Assigned] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reassigned HDFS-15346: -- Assignee: Jinglun > RBF: Balance data across federation namespaces with DistCp and snapshot diff > /

[jira] [Updated] (HDFS-15343) TestConfiguredFailoverProxyProvider is failing

2020-05-08 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-15343: - Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-05-08 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102302#comment-17102302 ] zhuqi commented on HDFS-15160: -- Hi [~weichiu]  The wrong case seems not related to this patch, i apply to

[jira] [Commented] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102309#comment-17102309 ] Jinglun commented on HDFS-15294: Hi [~ayushtkn], thanks your nice comments. {quote}One doubt that I am

[jira] [Updated] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15294: --- Attachment: distcp-balance.v2.pdf > RBF: Balance data across federation namespaces with DistCp and snapshot

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

2020-05-08 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.003.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >