Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Sunil Govindan
Looks good to me. Thanks Xiaoquio. + Sunil On Fri, Oct 16, 2020 at 12:36 PM Xiaoqiao He wrote: > Thanks Sunil for your reminder, > > branch-3.2.2 is ready now [1] and also mark branch-3.2 to 'prepare for > 3.2.3 development' [2]. > Please help to give another check if you have time. > >

[jira] [Created] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
Jinglun created HDFS-15636: -- Summary: NameNode computes load by group when choosing datanodes. Key: HDFS-15636 URL: https://issues.apache.org/jira/browse/HDFS-15636 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15636. Resolution: Duplicate Duplicate with HDFS-14383 > NameNode computes load by group when choosing

[jira] [Created] (HDFS-15637) Viewfs should make mount-table to read from central place

2020-10-16 Thread Junfan Zhang (Jira)
Junfan Zhang created HDFS-15637: --- Summary: Viewfs should make mount-table to read from central place Key: HDFS-15637 URL: https://issues.apache.org/jira/browse/HDFS-15637 Project: Hadoop HDFS

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-10-16 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/88/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-10-16 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/297/ [Oct 15, 2020 5:57:43 PM] (Eric Badger) YARN-10450. Add cpu and memory utilization per node and cluster-wide metrics. -1 overall The following subsystems voted -1: pathlen unit xml The

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Eric Badger
Hi Xiaoqiao, I believe that https://github.com/apache/hadoop/commit/3274fd139d9b612e449fc234f8804a2a97ae6c47 broke compilation for branch-3.2. Looks like you missed a 3.2.2 -> 3.2.3 in pom.xml in the top-level directory.

MDFS

2020-10-16 Thread David
Hello HDFS Gang, I've been playing around with a POC for a new distributed file system based on a lot of lessons learned from various Apache projects. You, also being a data nerd, I just wanted to share some thoughts with you since you may find it interesting.

Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-16 Thread Chao Sun
Thanks for the replies all! > But in the opposite case, it might have problem, because 2.x server may not understand new client calls added in 3.x Yes not expecting this to work. I'm thinking about the case where one upgrades existing 2.x clients to 3.x and expects it to still work against 2.x

[jira] [Created] (HDFS-15638) Make Hive tables directory permission check flat

2020-10-16 Thread Xinli Shang (Jira)
Xinli Shang created HDFS-15638: -- Summary: Make Hive tables directory permission check flat Key: HDFS-15638 URL: https://issues.apache.org/jira/browse/HDFS-15638 Project: Hadoop HDFS Issue

Re: Collect feedback for HDFS-15638

2020-10-16 Thread Owen O'Malley
I'm very -1 on adding these semantics. When you create the table's directory, set the default ACL. That will have exactly the effect that you are looking for without creating additional semantics. .. Owen On Fri, Oct 16, 2020 at 7:02 PM Xinli shang wrote: > Hi all, > > I opened

Re: [E] Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Sunil Govindan
Yes. I ran a compilation and it also failed. This is an issue when we do maven set version command because hadoop.version in the parent pom also needs to be set. 3.2.2-SNAPSHOT On Sat, Oct 17, 2020 at 12:15 AM Eric Badger wrote: > Hi Xiaoqiao, > > I believe that >

Collect feedback for HDFS-15638

2020-10-16 Thread Xinli shang
Hi all, I opened https://issues.apache.org/jira/browse/HDFS-15638 and want to collect feedback from the community. I know whenever changing the permission model that follows POSIX model is never a trivial change. So please comment on if you have concerns. For reading convenience, here is a copy

Re: Collect feedback for HDFS-15638

2020-10-16 Thread Xinli shang
Thanks Owen for your reply! As mentioned in the Jira, default ACLs don't apply to rename. Any idea how rename can work without setting ACLs per file? On Fri, Oct 16, 2020 at 7:25 PM Owen O'Malley wrote: > I'm very -1 on adding these semantics. > > When you create the table's directory, set the

[jira] [Created] (HDFS-15635) ViewFileSystemOverloadScheme support specifying mount table loader imp through conf

2020-10-16 Thread Junfan Zhang (Jira)
Junfan Zhang created HDFS-15635: --- Summary: ViewFileSystemOverloadScheme support specifying mount table loader imp through conf Key: HDFS-15635 URL: https://issues.apache.org/jira/browse/HDFS-15635

Re: Hadoop 3.2.2 Release Code Freeze Plan

2020-10-16 Thread Xiaoqiao He
Thanks Sunil for your reminder, branch-3.2.2 is ready now [1] and also mark branch-3.2 to 'prepare for 3.2.3 development' [2]. Please help to give another check if you have time. Thanks. [1] https://github.com/apache/hadoop/commits/branch-3.2.2 [2]