Re: [VOTE] Release Apache Hadoop 3.4.2

I really wish we can make ARM64 binaries. Would like to find time to work on the two jiras mentioned. On Wed, May 28, 2025 at 5:25 AM Ahmar Suhail wrote: > Hey all, > > The first release candidate for Hadoop 3.4.2 is now available for voting. > > There are a couple of things to note: > > 1/ No A

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

I am +1 too. * Verified signature. * Release notes and changelogs look good. On Fri, Mar 21, 2025 at 4:35 PM Chris Nauroth wrote: > +1 > > * Verified signatures. > * LICENSE-binary has the expected dependencies and versions. > * Site looks good too. > * Specifically confirmed inclusion of HADOO

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

> update or you need to refresh your keys. I will have a look at the keys > file tomorrow > > On Fri, 14 Mar 2025 at 21:46, Wei-Chiu Chuang wrote: > > > Looks like your GPG key expired? > > > > gpg: Signature made Fri Mar 14 08:56:00 2025 PDT > > gpg:

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Verified SHA-512 checksum, GPG signature -- all good except that the signing key expired. Confirmed git tag release-1.4.0-RC0 and branch name branch-1.4.0 both maps to commit hash 5595f1357eaad02e1cfb660bcce7fd34515197ff. Confirmed it is released as 1.4.0. Noticed HADOOP-19075

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Looks like your GPG key expired? gpg: Signature made Fri Mar 14 08:56:00 2025 PDT gpg:using RSA key 38237EE425050285077DB57AD22CF846DBB162A0 gpg: Good signature from "Steve Loughran (ASF code sign key - 2018) < ste...@apache.org>" [expired] gpg: aka "[jpeg image of

HADOOP-18207 hadoop-logging module about to land

Hi, I am preparing to resolve HADOOP-18207 ( https://github.com/apache/hadoop/pull/5717). This change affects all modules. With this change, it will eliminate almost all the direct log4j usage. As always, landing such a big piece is tricky. I

[ANNOUNCE] Apache Hadoop 3.3.6 release

On behalf of the Apache Hadoop Project Management Committee, I am pleased to announce the release of Apache Hadoop 3.3.6. It contains 117 bug fixes, improvements and enhancements since 3.3.5. Users of Apache Hadoop 3.3.5 and earlier should upgrade to this release. https://hadoop.apache.org/releas

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

> -Ayush > > > [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769 > [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978 > > On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi > wrote: > >> +1 (Non-binding). >> Thanks a lot Wei-Chiu

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

Launched a pseudo distributed cluster using released binary packages, > > done some HDFS dir/file basic opeations. > > + Run grep, pi and wordcount MR tasks on the pseudo cluster. > > > > Bests, > > Sammi Chen > > > > 发件人:

Clean up old Hadoop release tarballs

https://dist.apache.org/repos/dist/release/hadoop/common/ has Hadoop release tarballs 3.3.1 ~ 3.3.5. I plan to remove the tarballs from 3.3.1 to 3.3.4 and leave only 3.3.5 (and the upcoming 3.3.6). Shout out if you have something depending on the old release tarballs (you shouldn't) Other release

DockerHub admin for Apache Hadoop

Ayush and I have acquired the DockerHub admin privilege for the Hadoop project in order to facilitate the release of Hadoop 3.3.6. Apache Infra allows only two seats per project. So if you need something, let Ayush and I know and we will make it happen for you. If you are a Docker guru and can't h

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

gt; > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK > 8 > >> > with native profile enabled. > >> >+ launched pseudo distributed cluster including kms and httpfs with > >> > Kerberos and SSL enabled. > >> >+ created

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

Bumping this thread to the top. If you are verifying the release, please vote on this thread. RC0 and RC1 are exactly the same. The only material difference is the Changelog. Thanks!! On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang wrote: > I am inviting anyone to try and vote on this rele

[VOTE] Release Apache Hadoop 3.3.6 RC1

I am inviting anyone to try and vote on this release candidate. Note: This is exactly the same as RC0, except the CHANGELOG. The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64) https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64) Git tag:

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

lease. The next RC will be prepared, > right? > If true, I would like to try and vote on the next RC. > Just notice that some JIRAs are not included and need to revert some PRs to > pass HBase verification which are mentioned above. > > Best Regards, > - He Xiaoqiao > &

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

ey for gs://fake-in-memory-test-b ucket/contract-test/testOpenFileApplyAsyncRead "fs.option.openfile.length" On Wed, Jun 14, 2023 at 5:01 PM Wei-Chiu Chuang wrote: > The hbase-filesystem tests passed after reverting HADOOP-18596 > <https://issues.apache.org/jira/b

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

It's branching off branch-3.3 On Thu, Jun 15, 2023 at 3:18 AM Steve Loughran wrote: > Which branch is -3.3.6 off? 3.3.5 or 3.3? > > I'm travelling for the next few days and unlikely to be able to test this; > will do my best > > On Wed, 14 Jun 2023 at 07:27, Wei-Ch

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

7;s not the end of the world. I think we can address it by adding an incompatible change flag and a release note. On Wed, Jun 14, 2023 at 3:55 PM Wei-Chiu Chuang wrote: > Cross referenced git history and jira. Changelog needs some update > > Not in the release > >1. HDFS-16858 &

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

59->AbstractContractDistCpTest.distCpUpdateDeepDirectoryStructure:334->AbstractContractDistCpTest.assertCounterInRange:294->Assert.assertTrue:41->Assert.fail:88 Files Copied value 2 above maximum 1 [INFO] [ERROR] Tests run: 240, Failures: 3, Errors: 0, Skipped: 58 Ozone test in progress. Wil

[VOTE] Release Apache Hadoop 3.3.6 RC0

I am inviting anyone to try and vote on this release candidate. Note: This is built off branch-3.3.6 plus PR#5741 (aws sdk update) and PR#5740 (LICENSE file update) The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC0-amd64/ (for amd64) https://home.apache.org/~weichiu/hadoop

Re: [DISCUSS] Hadoop 3.3.6 release planning

ace. While setSafeMode() is exposed through SafeMode interface. On Thu, Jun 8, 2023 at 11:11 AM Wei-Chiu Chuang wrote: > Thanks for comments > > Looking at jiras fixed in 3.3.6 and 3.3.9 (my bad, forgot that most > commits landing in branch-3.3 was 3.3.9), most are okay. We have about

Re: [DISCUSS] Hadoop 3.3.6 release planning

iu for driving this release. > > > > Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed > version. > > > > > > > > so far only 8 jiras were resolved in the branch-3.3 line. > > > > > > > > > > > > If we should consider bo

Re: Call for Presentations, Community Over Code 2023

There's also a call for presentation for Community over Code Asia 2023 https://www.bagevent.com/event/cocasia-2023-EN Happening Aug 18-20. CfP due by 6/6 On Tue, May 9, 2023 at 8:39 PM Ayush Saxena wrote: > Forwarding from dev@hadoop to the dev ML which we use. > > The actual mail lies here: >

[DISCUSS] Hadoop 3.3.6 release planning

Hi community, I'd like to kick off the discussion around Hadoop 3.3.6 release plan. I'm being selfish but my intent for 3.3.6 is to have the new APIs in HADOOP-18671 added so we can have HBase to adopt this new API. Other than that, perhaps thi

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

My random thoughts. Probably bad takes: There are projects experimenting with JDK17 now. JDK11 active support will end in 6 months. If it's already hard to migrate from JDK8 why not retarget JDK17. On Tue, Mar 28, 2023 at 10:30 AM Ayush Saxena wrote: > I know Jersey upgrade as a blocker. Some f

Re: MapReduce Terasort job is slow on Java 11

For the JDK11 case, does everyone on the cluster run on JDK11? or is it the MR job that is on JDK11? We have users running JDK in production. The NN GC performance was the only thing we were aware of. In the past we noticed because JDK11 uses G1GC by default, large NameNode performance was worse t

[DISCUSS] Hadoop 3.3.5 release planning

Bumping this up. Adding the [DISCUSS] text to make this message stand out of your inbox. I certainly missed this message and only realized 3.3.5 has more than just security updates. What was the issue with the ARM64 build? I was able to publish ARM64 build for 3.3.1 release without problems. On

Re: Hadoop BoF at ApacheCon NA'22

t; On Sat, Sep 24, 2022 at 8:52 PM 俊平堵 wrote: > > > > > Yes. It should be a short talk and I can only present remotely for this > > > time. That would be great if you help to coordinate. :) > > > > > > Thanks, > > > > > > Junping &g

Re: Hadoop BoF at ApacheCon NA'22

document/d/1_ha1BFeEyIkAJtl5tJ8Z4Vf5Md_0rN23RCrXkyNCY1c/edit?usp=sharing Please add more details here. On Thu, Sep 22, 2022 at 10:27 PM 俊平堵 wrote: > Thanks Wei-Chiu. I am happy to share the status of Hadoop Meetups in China > (2019-2022) if that is a suitable topic. :) > > Thanks, > > Junping

Hadoop BoF at ApacheCon NA'22

We've not had a physical event for a long long time and we're way overdue for one. I'm excited to announce we've reserved a room at the upcoming ApacheCon for Birds-of-Feather on October 4th from 17:50-18:30 CDT in Rhythms I. I was also told that participants can stay after that until the hotel pe

Re: [DISCUSS] Hadoop on Windows

Great! Sorry I missed the earlier discussion thread. Is there a target version for this support? I assume the milestone is still in a dev branch? On Thu, Apr 28, 2022 at 8:26 AM Gautham Banasandra wrote: > Hi Hadoop devs, > > I would like to announce that we recently reached a new milestone - w

Re: Institutions running kerberized Hadoop clusters

Last time I checked (~2 years ago), there were thousands of Kerberized clusters among Cloudera customers. The largest ones had a few thousand nodes. What are you looking for? On Wed, Apr 13, 2022 at 7:22 AM Santosh Marella wrote: > Hey folks, > > Just curious if we have a list of institutions

Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0

aarch64 support is only introduced in/after 3.3.0 On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt wrote: > Hi, > > > There is no aarch64 artifact in the release candidate. Is this something > that is intended? > > Best, > Emil Ejbyfeldt > > On 14/03/2022 08:14, Masatake Iwasaki wrote: > > Hi all,

[ANNOUNCE] New Hadoop PMC Sun Chao

On behalf of the Apache Hadoop PMC, I am pleased to announce that Sun Chao(sunchao) has accepted the PMC's invitation to become a PMC on the project. We appreciate all of Sun's generous contributions thus far and look forward to his continued involvement. Congratulations and welcome, Sun!

Re: [ANNOUNCE] Apache Hadoop 3.3.2 release

> > Many thanks to Viraj Jasani, Michael Stack, Masatake Iwasaki, Xiaoqiao He, > Mukund Madhav Thakur, Wei-Chiu Chuang, Steve Loughran, Akira Ajisaka and > other folks who helped for this release process. > > Best Regards, > Chao >

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC2

I'll find time to check out the RC bits. I just feel bad that the tarball is now more than 600MB in size. On Fri, Jan 21, 2022 at 2:23 AM Steve Loughran wrote: > *+1 binding.* > > reviewed binaries, source, artifacts in the staging maven repository in > downstream builds. all good. > > *## test

Re: [DISCUSS] Migrate hadoop from log4j1 to log4j2

+1 I think it makes sense to use reload4j in maint releases. I have a draft PR doing this (https://github.com/apache/hadoop/pull/3906) log4j2 in Hadoop 3.4.0 makes sense to me. There could be incompatibilities introduced by log4j2, but I feel we should at least make it 3.4.0 a "preview" release, a

Re: Hadoop-3.2.3 Release Update

Is this still making progress? On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula wrote: > Hi Akira, > > Thanks for your email!! > > I am evaluating the CVE’s which needs to go for this release.. > > Will update soon!! > > > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka wrote: > > > Hi Brahma,

Apache Hadoop and CVE-2021-44228 Log4JShell vulnerability

Hi, Given the widespread attention to the recent log4j vulnerability (CVE-2021-44228), I'd like to share an update from the Hadoop developer community regarding the incident. As you probably know, Apache Hadoop depends on the log4j library to keep log files. The highlighted vulnerability CVE-2021-

Trunk broken by HDFS-16384

My bad. There was a transitive dependency problem in the PR causing trunk to fail the build. The commit has since been reverted. Sorry for the inconvenience.

Re: [VOTE] Release Apache Hadoop 3.3.2 - RC0

Thanks a lot for pushing it forward! A few things I noticed that we should incorporate: 1. the overview page of the doc is for the Hadoop 3.0 release. It would be best to base the doc on top of Hadoop 3.3.0 overview page. (it's a miss on my part... The overview page of 3.3.1 wasn't updated) 2. A

ApacheCon@Home Big Data tracks recordings!

For those who missed the live Apache@Home Big Data tracks, the video recordings are being uploaded to the official ASF channel! Big Data: https://www.youtube.com/playlist?list=PLU2OcwpQkYCzXcumE9UxNirLF1IYLmARj Big Data Ozone: https://www.youtube.com/playlist?list=PLU2OcwpQkYCxtPdZ0nSowYLQMgkmoczM

Re: Hadoop-3.2.3 Release Update

Hi to raise the awareness, it looks like reverting the FoldedTreeSet HDFS-13671 breaks TestBlockManager in branch-3.2. Branch-3.3 is good. tracking jira: HDFS-16258 On Tue, Oct 5, 2021 at 8:45 P

[ANNOUNCE] Apache Hadoop 3.3.1 release

olks who continued helps for this release process. Best Regards, Wei-Chiu Chuang

Re: [VOTE] Hadoop 3.1.x EOL

Dropped 3.1.4 from website. Removed from https://dist.apache.org/repos/dist/release/hadoop/common/ On Thu, Jun 10, 2021 at 3:42 PM Akira Ajisaka wrote: > This vote has passed with 18 binding +1. I'll update the JIRA and the wiki. > > Thanks all for your participation. > > On Tue, Jun 8, 2021 at

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

> > > +1, >> > > Built from Source. >> > > Successful Native Build on Ubuntu 20.04 >> > > Verified Checksums >> > > Ran basic hdfs shell commands. >> > > Ran simple MR jobs. >> > > Browsed NN,DN,RM and NM UI. >> > > >> &g

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

doesn't render right. >> Created https://issues.apache.org/jira/browse/HADOOP-17746. >> >> This is *not a blocker* >> >> I can prepare a fix and we can have it in so that if any other changes >> come >> in the page will look OK. >> >>

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

e release is a > big release, but I get that it’s the current state of the project. > > > On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote: > > > > Hello, > > do we want to extend the release vote? I understand a big release like > this > > takes time to val

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

faster by 20% over Hadoop 3.2 library. Looks like we may need some more time to test. How about extending it by a week? On Tue, Jun 1, 2021 at 6:29 PM Wei-Chiu Chuang wrote: > Hi community, > > This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker > issu

Re: [VOTE] Hadoop 3.1.x EOL

+1 On Thu, Jun 3, 2021 at 2:14 PM Akira Ajisaka wrote: > Dear Hadoop developers, > > Given the feedback from the discussion thread [1], I'd like to start > an official vote > thread for the community to vote and start the 3.1 EOL process. > > What this entails: > > (1) an official announcement t

[VOTE] Release Apache Hadoop 3.3.1 RC3

Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE-7303. Fix TestJobResourceUploader failures after HADOOP-16878 * Revert "HADOOP-16878. FileUtil.copy() t

[jira] [Reopened] (MAPREDUCE-7303) Fix TestJobResourceUploader failures after HADOOP-16878

[ https://issues.apache.org/jira/browse/MAPREDUCE-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened MAPREDUCE-7303: We're reverting HADOOP-16878 so this should be reverted as well.

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1. >> >> -Akira >> >> On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang >> wrote: >> > >> > Hi folks, >> > >> > I have put together a release candidate (RC0) for

Re: [VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

ecked the documents >> - Compiled Hadoop trunk and branch-3.3 with Hadoop third-party 1.1.1. >> >> -Akira >> >> On Wed, May 26, 2021 at 5:29 PM Wei-Chiu Chuang >> wrote: >> > >> > Hi folks, >> > >> > I have put together a release

Re: [VOTE] Release Apache Hadoop 3.3.1 - RC1

review the hadoop-thirdparty 1.1.1 RC0 and cast a vote. Thanks! On Wed, May 26, 2021 at 9:39 AM Wei-Chiu Chuang wrote: > > Found a few issues building downstreams > > Ozone: HADOOP-17730 <https://issues.apache.org/jira/browse/HADOOP-17730> -- > we may have to mak

[VOTE] Release Apache Hadoop Thirdparty 1.1.1 RC0

Hi folks, I have put together a release candidate (RC0) for Hadoop Thirdparty 1.1.1 which will be consumed by Hadoop 3.3.1 RC2. The RC is available at: https://people.apache.org/~weichiu/hadoop-thirdparty-1.1.1-RC0/ The RC tag in svn is here:https://github.com/apache/hadoop-thirdparty/releases

Re: [VOTE] Release Apache Hadoop 3.3.1 - RC1

ertionError: expected null, but was:<1000> at org.apache.hadoop.hbase.TestHBaseConfiguration.testDeprecatedConfigurations(TestHBaseConfiguration.java:150) On Mon, May 24, 2021 at 10:36 PM Wei-Chiu Chuang wrote: > Hi community, > > This is the release candidate RC1 of Apach

[VOTE] Release Apache Hadoop 3.3.1 - RC1

Hi community, This is the release candidate RC1 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved. It contains 697 fixed jira issues [2] since 3.3.0 which include a lot of features and improvements(read the full set of release notes). Below feature additions are the highlights o

Re: [DISCUSS] which release lines should we still consider actively maintained?

Sean, For reasons I don't understand, I never received emails from your new address in the mailing list. Only Akira's response. I was just able to start a thread like this. I am +1 to EOL 3.1.5. Reason? Spark is already on Hadoop 3.2. Hive and Tez are actively working to support Hadoop 3.3. HBas

Publishing Apache Hadoop 3.3.1-RC0 Preview bits

Hi community, This is the preview bits of the first release candidate of Apache Hadoop 3.3.1 line. It takes tremendous amount of effort to produce a Hadoop RC and we still have a number of unresolved issues [1]. Meanwhile, I'd like to publish preview bits so you guys can check out earlier than lat

Hadoop Branching: branch-3.3 is now 3.3.2-SNAPSHOT

Hi I created a branch-3.3.1. The branch-3.3. now tracks 3.3.2-SNAPSHOT. Please use Fix version 3.3.2 when cherrypicking your commits to branch-3.3. Regards, Wei-Chiu

Re: [DISCUSS] Hadoop 3.3.1 release

5790) so you guys can quickly check out. The first RC will probably not have the aarch64 binary. I don't have much experience with that. Cheers, Wei-Chiu On Thu, May 13, 2021 at 9:04 AM Wei-Chiu Chuang wrote: > Hello it's me again. > > While working on the hadoop-thirdparty

Re: [VOTE] hadoop-thirdparty 1.1.0-RC0

all -DskipTests > > - mvn clean install -DskipTests -Psrc > > * Built Hadoop trunk againt hadoop-thirdparty 1.1.0: ok > > > > > > On Thu, May 13, 2021 at 5:25 PM Wei-Chiu Chuang > > wrote: > > > > > Hello my fellow Hadoop developers, > > > &g

Hadoop LZ4 codec questions

Hi I'm trying to understand the LZ4 codec usage in Hadoop. Liang-Chi replaced the LZ4 codec with the lz4-java HADOOP-17292. The intent is so that we can use the native library that is bundled in the jar, no need to install lz4 native libraries on the host machine. However, there's another LZ4 cod

Updated Hadoop fix versions

Hi, I found hundreds of discrepancies between Apache JIRA and git history, and updated the jira fix versions according to git history. Some of the noticeable updates: (1) HADOOP-16730 ABFS: Support for Shared Access Signatures (SAS) --> originally a new feature in 3.3.1, is actually in 3.3.0. (

[VOTE] hadoop-thirdparty 1.1.0-RC0

Hello my fellow Hadoop developers, I am putting together the first release candidate (RC0) for Hadoop-thirdparty 1.1.0. This is going to be consumed by the upcoming Hadoop 3.3.1 release. The RC is available at: https://people.apache.org/~weichiu/hadoop-thirdparty-1.1.0-RC0/ The RC tag in github i

Re: [DISCUSS] Hadoop 3.3.1 release

review the remaining jiras and push out those that don't have much progress today. Thanks all! Weichiu On Tue, Apr 20, 2021 at 12:57 PM Wei-Chiu Chuang wrote: > Billie and Viraj, > > As of today we are at 657 resolved jiras in 3.3.1 > https://issues.apache.org/jira/issues/?filter=-1&am

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

with this change so please help review. Thanks! On Tue, Apr 27, 2021 at 2:59 PM Wei-Chiu Chuang wrote: > I'll start preparing the release vote for third-party 1.1.0. Thanks all > for help! > > On Mon, Apr 26, 2021 at 7:20 PM Wei-Chiu Chuang > wrote: > >> Thanks

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

I'll start preparing the release vote for third-party 1.1.0. Thanks all for help! On Mon, Apr 26, 2021 at 7:20 PM Wei-Chiu Chuang wrote: > Thanks. I created a Jenkins job to upload the SNAPSHOT to Apache nexus > repository. > > https://ci-hadoop.apache.org/view/Hadoop/job/

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

02 PM Ayush Saxena wrote: > Yep, you have to do it manually > > -Ayush > > On 26-Apr-2021, at 3:23 PM, Wei-Chiu Chuang wrote: > >  > Does anyone know how we publish hadoop-thirdparty SNAPSHOT artifacts? > > The main Hadoop arifacts are published by this job > ht

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

apshot, the hadoop code would pick > that up, and watch out everything is safe and clean before release. Unless > you have a better way to verify or already verified!!! > > -Ayush > > > On 23-Apr-2021, at 3:16 PM, Wei-Chiu Chuang > wrote: > > > > Another suggestion:

Sorry for breaking the build

If you are seeing precommit failures, like this: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project hadoop-annotations: Compilation failure [ERROR] javac: invalid flag: -Xmaxwarns= [ERROR] Usage: javac [ERROR] use -help for

Re: [DISCUSS] hadoop-thirdparty 1.1.0 release

version anyway. The version used is too old. On Fri, Apr 23, 2021 at 10:55 AM Wei-Chiu Chuang wrote: > Hi community, > > In preparation of the Hadoop 3.3.1 release, I am starting a thread to > discuss its prerequisite: the release of hadoop-thirdparty 1.1.0. > > My plan: >

[DISCUSS] hadoop-thirdparty 1.1.0 release

Hi community, In preparation of the Hadoop 3.3.1 release, I am starting a thread to discuss its prerequisite: the release of hadoop-thirdparty 1.1.0. My plan: update guava to 30.1.1 (latest). I have the PR ready to merge. Do we want to update protobuf and jaeger? Anything else? I suppose we won

Re: [DISCUSS] Hadoop 3.3.1 release

the release, please tag the jira with the label 'release-blocker'. On Tue, Apr 20, 2021 at 2:44 AM Billie Rinaldi wrote: > I was thinking of backporting HADOOP-16948 for 3.3.1. > > Billie > > On Mon, Apr 19, 2021 at 1:33 AM Wei-Chiu Chuang > wrote: > > > H

Re: [DISCUSS] Hadoop 3.3.1 release

te reply.. > > > > > >> >> > > > > > >> >> I will come up with a plan.. Please let me know if anybody > has > > > some > > > > > >> >> features/improvements/bugs that need to be included. >

Re: [DISCUSS] Hadoop 3.3.1 release

ks > > >> >> > Sunil > > >> >> > > > >> >> > On Mon, Feb 8, 2021 at 11:56 PM Stack wrote: > > >> >> > > > >> >> > > On Wed, Feb 3, 2021 at 6:41 AM Steve Loughran > > >> >>

[DISCUSS] Hadoop 3.3.1 release

Hi all, Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated more than 400 changes in the branch-3.3. A number of downstreamers are eagerly waiting for 3.3.1 which addresses the guava version conflict issue. https://issues.apache.org/jira/issues/?filter=-1&jql=project%20in%2

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC5

+1 (binding) On Mon, Jan 4, 2021 at 11:11 PM Akira Ajisaka wrote: > +1 (binding) > > - Verified the checksums and signatures > - Verified the source is the same as the RC5 tag > - Built from source with CentOS 7.9 and Java 1.8.0_275 > - Setup pseudo cluster and ran some FsShell commands > > Than

Re: [E] Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

We should target 3.4.0, 3.3.1 3.2.3 (or 3.2.2) I updated and set 3.3.0 released in YARN. Time to clean up some of the old releases. I'll do that. On Mon, Dec 21, 2020 at 4:04 PM Eric Badger wrote: > I've committed https://issues.apache.org/jira/browse/YARN-10540. Xiaoqiao, > feel free to cherr

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Forgot to mention I am +1 (binding) too based on the fact there are no blocker issues and RC3 and RC4 diff. On Mon, Dec 14, 2020 at 1:42 PM Wei-Chiu Chuang wrote: > Diff between RC3 and RC4: > > MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136) > HDFS-134

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC4

Diff between RC3 and RC4: MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136) HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma. HADOOP-16080. hadoop-aws does not work with hadoop-client-api (#2510)

Re: [VOTE] Release Apache Hadoop 3.2.2 - RC2

I suggest we wait for HDFS-15680 (If I understand it correctly, it's a blocker) I wish to update jetty too in this release, but it's turning out to be more involved than i had anticipated. On Fri, Nov 13, 2020 at 3:22 PM Chao Sun wrote: > +1 (

Committers please subscribe to security@hadoop

The security@hadoop mailing list is restricted to Hadoop committers. Subscribing to the mailing list is not an automatic process. If you are a committer, please subscribe by sending an email to security-subscr...@hadoop.apache.org so we can discuss vulnerabilities in private. Thanks, Wei-Chiu

Fwd: Heads-up, Apache Yetus looking for feedback on RC with lots of changes

Forwarding to the Hadoop devs -- Forwarded message - From: Sean Busbey Date: Tue, Nov 3, 2020 at 9:51 AM Subject: Heads-up, Apache Yetus looking for feedback on RC with lots of changes To: dev Hi folks! FYI, Apache Yetus is doing RCs for their 0.13.0 release and it's got a lot

Re: Fixing flaky tests in Apache Hadoop

at 2:03 PM Wei-Chiu Chuang wrote: > Thanks for raising the issue, Akira and Ahmed, > > Fixing flaky tests is a thankless job so I want to take this opportunity > to recognize the time and effort. > > We will always have flaky tests due to bad tests or simply infra issues. > Fi

Re: Fixing flaky tests in Apache Hadoop

Thanks for raising the issue, Akira and Ahmed, Fixing flaky tests is a thankless job so I want to take this opportunity to recognize the time and effort. We will always have flaky tests due to bad tests or simply infra issues. Fixing flaky tests will take time but if they are not addressed it was

JIRA privilege for committers/PMCs

Hi, Is there any one who is a Hadoop committer or PMC, but who does not have the committer/administrator privilege (e.g. assign/resolve jiras)? JIRA projects like HADOOP has "hadoop" and "hadoop-pmc" groups added as administrators. [image: Screen Shot 2020-10-14 at 3.20.59 PM.png] So I would hav

Re: Hadoop 3.2.2 Release Code Freeze Plan

Thanks Xiaoqiao! Glad to see this is moving along. I noticed your dashboard has private filters and therefore the results are not visible publicly. On Tue, Sep 29, 2020 at 10:02 PM Xiaoqiao He wrote: > Hi All, > > Plan to code frozen for Hadoop-3.2.2 release at 2020/10/15. From now on, > most of

Re: [VOTE] Moving Ozone to a separated Apache project

+1 Look forward to it. On Tue, Sep 29, 2020 at 4:48 PM Konstantin Shvachko wrote: > +1 > > Stay safe, > --Konstantin > > On Thu, Sep 24, 2020 at 10:59 PM Elek, Marton wrote: > > > Hi all, > > > > Thank you for all the feedback and requests, > > > > As we discussed in the previous thread(s) [1]

[ANNOUNCE] Hui Fei is a new Apache Hadoop Committer

y Sync Online > > https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit#heading=h.irqxw1iy16zo > where >he discussed the Hadoop 3 rolling upgrade support > > Let's congratulate Hui for this new role! Cheers, Wei-Chiu Chuang (on behalf of the Apache Hadoop PMC)

[ANNOUNCE] Lisheng Sun is a new Apache Hadoop Committer

ssues.apache.org/jira/browse/HDFS-13694> and HDFS-13693 <https://issues.apache.org/jira/browse/HDFS-13693>. Code wise, he resolved 57 Hadoop jiras. Let's congratulate Lisheng for this new role! Cheers, Wei-Chiu Chuang (on behalf of the Apache Hadoop PMC)

Re: [VOTE] Release Apache Hadoop 2.10.1 (RC0)

+1 (binding) I did a security scan for the 2.10.1 RC0 and it looks fine to me. Checked recent critical/blocker HDFS issues that are not in 2.10.1. It looks mostly fine. Most of them are Hadoop 3.x features (EC, ... etc) but there is one worth attention: 1. HDFS-14674

Two more binding votes required for Apache Hadoop 2.10.1 RC0

Masatake is doing a great job rolling out 2.10.1 RC0. Let's give him a final push to get it out. Thanks, Wei-Chiu

Re: Sep. Y2020 Hadoop Meetup in China

This is great news! Can you also share this with the user@ and user-zh@ mailing lists? We need to get the message out. On Tue, Sep 15, 2020 at 10:36 PM 俊平堵 wrote: > Hi, > Last year Aug, we had a very successful meetup in Beijing ( > https://blogs.apache.org/hadoop) which help to promote hado

[ANNOUNCEMENT] Apache Hadoop 2.9.x release line end of life

newer release lines: 2.10.0 / 3.1.4 / 3.2.1 / 3.3.0. Please check out our Release EOL wiki for details: https://cwiki.apache.org/confluence/display/HADOOP/EOL+(End-of-life)+Release+Branches Best Regards, Wei-Chiu Chuang (On Behalf of the Apache Hadoop PMC)

[DISCUSS] Hadoop 3.2.2 release

Hi folks, I was reminded by Xiaoqiao that Hadoop 3.2.1 was made almost a year ago (released on September 22, 2019) and we're overdue for a follow-up. @Rohith Sharma K S you were the RM for Hadoop 3.2.1. Are we planning to make the 3.2.2 releases soon? Xiaoqiao wants to help with the release. T

[DISCUSS] Hadoop 2.10.1 release

Hello, I see that Masatake graciously agreed to volunteer with the Hadoop 2.10.1 release work in the 2.9 branch EOL discussion thread https://s.apache.org/hadoop2.9eold Anyone else likes to contribute also? Thanks

Re: [DISCUSS] fate of branch-2.9

hanks, Weichiu On Fri, Mar 6, 2020 at 5:47 PM Wei-Chiu Chuang wrote: > I think that's a great suggestion. > Currently, we make 1 minor release per year, and within each minor release > we bring up 1 thousand to 2 thousand commits in it compared with the > previous one. > I can t

Re: Mandarin Hadoop online sync this week

ed we can port Ozone features into Hadoop Common. For example, Java-based configuration is a power feature which can benefit Hadoop as well. On Tue, Aug 25, 2020 at 9:47 AM Wei-Chiu Chuang wrote: > Hello, > > There hasn't been a Mandarin online sync for quite some time. I'd lik

  1   2   >