Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

2020-12-15 Thread Akira Ajisaka
+1 (binding) - Verified checksums and signatures - Built from source with CentOS 7.9 - Setup a pseudo cluster and ran some MapReduce jobs - Checked the Web UIs. Thanks, Akira On Tue, Dec 15, 2020 at 6:43 AM Wei-Chiu Chuang wrote: > > Diff between RC3 and RC4: > > MAPREDUCE-7284.

Mandarin Hadoop Storage Online Meetup this week (APAC Mandarin)

2020-12-15 Thread Xiaoqiao He
Hi All, We are happy to invite Huang Haibin(黄海滨) leading discussion on HDFS Slow Node Improvement Practice at Xiaomi at next week's Hadoop storage online meetup (APAC Mandarin). Time/Date: 12/23 10PM (US West Coast PST) 12/24 1PM (Beijing, China CST) Join Zoom Meeting

[jira] [Resolved] (HDFS-15687) allowSnapshot fails when directory already has a Trash sub directory

2020-12-15 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDFS-15687. Fix Version/s: 3.4.0 Resolution: Duplicate > allowSnapshot fails when

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-15 Thread Konstantin Shvachko
Hey Xiaoqiao, HDFS-14272 was committed to all branches up to 2.10. The jira versions were not updated properly. I'll ping Chen for an update. He committed it in May. Stay safe, --Konstantin On Tue, Dec 15, 2020 at 1:21 AM Xiaoqiao He wrote: > Hi All, > > >> I'm just curious why this is

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-15 Thread Steve Loughran
On Sun, 13 Dec 2020 at 21:08, Konstantin Shvachko wrote: > Hi Steve, > > I am not sure I fully understand what is broken here. It is not an > incompatible change, right? > The issue is that the FileSystem/FileContext APIs are something we have to maintain ~forever, so every API change needs to

Apache Hadoop qbt Report: trunk+JDK11 on Linux/x86_64

2020-12-15 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java11-linux-x86_64/90/ [Dec 15, 2020 4:36:11 AM] (Ayush Saxena) HDFS-15728. Update description of dfs.datanode.handler.count in hdfs-default.xml. Contributed by liuyan.(#2534) [Dec 15, 2020 4:42:23 AM] (Wei-Chiu Chuang)

Re: Regarding HDFS-15567. HDFS should expose msync() API to allow downstream applications call it explicitly

2020-12-15 Thread Xiaoqiao He
Hi All, > I'm just curious why this is included in the 3.2.2 release? HDFS-15567 is > tagged with 3.2.3 and the corresponding HDFS-14272 on server side is tagged > with 3.3.0. Have checked the fix version tag, I found there are 8 issues which do not include branch-3.2.2 correctly or both