Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Wei-Chiu Chuang
We should target 3.4.0, 3.3.1 3.2.3 (or 3.2.2) I updated and set 3.3.0 released in YARN. Time to clean up some of the old releases. I'll do that. On Mon, Dec 21, 2020 at 4:04 PM Eric Badger wrote: > I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, > feel free to

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Eric Badger
I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, feel free to cherry-pick this into the 3.2.2 release branch if you think it is relevant. Also, can someone tell me which releases we should be targeting? Currently these versions are all Unreleased on JIRA: 3.4.1, 3.4.0

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Jim Brennan
I put up a patch for https://issues.apache.org/jira/browse/YARN-10540. Thanks for bringing it to my attention. Jim On Mon, Dec 21, 2020 at 10:36 AM Sunil Govindan wrote: > I had some offline talks with a few folks. > This issue is happening only in Mac, hence ideally it does not cause much > of

[jira] [Created] (HADOOP-17443) Improve Hive Class Logging/Error Handling

2020-12-21 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17443: --- Summary: Improve Hive Class Logging/Error Handling Key: HADOOP-17443 URL: https://issues.apache.org/jira/browse/HADOOP-17443 Project: Hadoop Common

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-12-21 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/362/ [Dec 20, 2020 9:42:32 AM] (Ayush Saxena) HDFS-15116. Correct spelling of comments for NNStorage.setRestoreFailedStorage. Contributed by Xudong Cao. [Dec 20, 2020 9:48:25 AM] (Ayush Saxena)

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2020-12-21 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/93/ [Dec 20, 2020 9:42:32 AM] (Ayush Saxena) HDFS-15116. Correct spelling of comments for NNStorage.setRestoreFailedStorage. Contributed by Xudong Cao. [Dec 20, 2020 9:48:25 AM] (Ayush Saxena)

Re: [E] Yetus is failing with Java unable to create threads

2020-12-21 Thread Ahmed Hussein
> In most cases, the OOM occurs when closing MiniDFSCluster. @Akira Ajisaka , I see some usage of parallelStream() in RouterRPCServer. If we consider pool executors in the code and parallelStream(), could it be possible that there is a large number of threads created in the MiniCluster and

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-21 Thread Sunil Govindan
I had some offline talks with a few folks. This issue is happening only in Mac, hence ideally it does not cause much of a problem in the supported OS. I will wait for feedback here to see whether we need another RC by fixing this. And will continue the discussion in the jira. Thanks Sunil On

[jira] [Created] (HADOOP-17442) Update the hadoop version in TestDynamometerInfra

2020-12-21 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HADOOP-17442: - Summary: Update the hadoop version in TestDynamometerInfra Key: HADOOP-17442 URL: https://issues.apache.org/jira/browse/HADOOP-17442 Project: Hadoop Common

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-21 Thread Steve Loughran
On Fri, 18 Dec 2020 at 23:29, Konstantin Shvachko wrote: > Hey Steve, > > Thanks for the references. I was reading but still need to understand how > exactly this applies to msync. > mainly: pull it up and it becomes part of the broader API, so needs to be specified in a way which can be

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-12-21 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/153/ No changes -1 overall The following subsystems voted -1: asflicense hadolint jshint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: