+1(Binding) * Built from Source * Successful native build on Ubuntu 18.04 * Verified Checksums * Verified Signatures * Successful RAT check * Ran Basic HDFS shell commands * Ran basic MR example Jobs (TeraGen/TeraSort & TeraValidate) * Browsed through UI(NN, DN, RM, NM & JHS) * Skimmed through the contents of ChangeLog & ReleaseNotes. Look Good
Thanx Masatake for driving the release, Good Luck!!! -Ayush On Thu, 21 Jul 2022 at 23:28, Chris Nauroth <cnaur...@apache.org> wrote: > I'm changing my vote to +1 (binding). > > Masatake and Ashutosh, thank you for investigating. > > I reran tests without the parallel options, and that mostly addressed the > failures. Maybe the tests in question are just not sufficiently isolated to > support parallel execution. That looks to be the case for TestFsck, where > the failure was caused by missing audit log entries. This test works by > toggling global logging state, so I can see why multi-threaded execution > might confuse the test. > > Chris Nauroth > > > On Thu, Jul 21, 2022 at 12:01 AM Ashutosh Gupta < > ashutoshgupta...@gmail.com> > wrote: > > > +1(non-binding) > > > > * Builds from source look good. > > * Checksums and signatures are correct. > > * Running basic HDFS and MapReduce commands looks good. > > > > > * TestAMRMProxy - Not able to reproduce in local > > > * TestFsck - I can see failure only I can see is > > TestFsck.testFsckListCorruptSnapshotFiles which passed after applying > > HDFS-15038 > > > * TestSLSStreamAMSynth - Not able to reproduce in local > > > * TestServiceAM - Not able to reproduce in local > > > > Thanks Masatake for driving this release. > > > > On Thu, Jul 21, 2022 at 5:51 AM Masatake Iwasaki < > > iwasak...@oss.nttdata.com> > > wrote: > > > > > Hi developers, > > > > > > I'm still waiting for your vote. > > > I'm considering the intermittent test failures mentioned by Chris are > not > > > blocker. > > > Please file a JIRA and let me know if you find a blocker issue. > > > > > > I will appreciate your help for the release process. > > > > > > Regards, > > > Masatake Iwasaki > > > > > > On 2022/07/20 14:50, Masatake Iwasaki wrote: > > > >> TestServiceAM > > > > > > > > I can see the reported failure of TestServiceAM in some "Apache > Hadoop > > > qbt Report: branch-3.2+JDK8 on Linux/x86_64". > > > > 3.3.0 and above might be fixed by YARN-8867 which added guard using > > > GenericTestUtils#waitFor for stabilizing the > > > testContainersReleasedWhenPreLaunchFails. > > > > YARN 8867 did not modified other code under hadoop-yarn-services. > > > > If it is the case, TestServiceAM can be tagged as flaky in > branch-3.2. > > > > > > > > > > > > On 2022/07/20 14:21, Masatake Iwasaki wrote: > > > >> Thanks for testing the RC0, Chris. > > > >> > > > >>> The following are new test failures for me on 3.2.4: > > > >>> * TestAMRMProxy > > > >>> * TestFsck > > > >>> * TestSLSStreamAMSynth > > > >>> * TestServiceAM > > > >> > > > >> I could not reproduce the test failures on my local. > > > >> > > > >> For TestFsck, if the failed test case is > > > testFsckListCorruptSnapshotFiles, > > > >> cherry-picking HDFS-15038 (fixing only test code) could be the fix. > > > >> > > > >> The failure of TestSLSStreamAMSynth looks frequently reported by > > > >> "Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64". > > > >> It could be tagged as known flaky test. > > > >> > > > >> On 2022/07/20 9:15, Chris Nauroth wrote: > > > >>> -0 (binding) > > > >>> > > > >>> * Verified all checksums. > > > >>> * Verified all signatures. > > > >>> * Built from source, including native code on Linux. > > > >>> * mvn clean package -Pnative -Psrc -Drequire.openssl > > > -Drequire.snappy > > > >>> -Drequire.zstd -DskipTests > > > >>> * Tests mostly passed, but see below. > > > >>> * mvn --fail-never clean test -Pnative -Dparallel-tests > > > >>> -Drequire.snappy -Drequire.zstd -Drequire.openssl > > > >>> -Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8 > > > >>> > > > >>> The following are new test failures for me on 3.2.4: > > > >>> * TestAMRMProxy > > > >>> * TestFsck > > > >>> * TestSLSStreamAMSynth > > > >>> * TestServiceAM > > > >>> > > > >>> The following tests also failed, but they also fail for me on > 3.2.3, > > so > > > >>> they aren't likely to be related to this release candidate: > > > >>> * TestCapacitySchedulerNodeLabelUpdate > > > >>> * TestFrameworkUploader > > > >>> * TestSLSGenericSynth > > > >>> * TestSLSRunner > > > >>> * test_libhdfs_threaded_hdfspp_test_shim_static > > > >>> > > > >>> I'm not voting a full -1, because I haven't done any root cause > > > analysis on > > > >>> these new test failures. I don't know if it's a quirk to my > > > environment, > > > >>> though I'm using the start-build-env.sh Docker container, so any > > build > > > >>> dependencies should be consistent. I'd be comfortable moving ahead > if > > > >>> others are seeing these tests pass. > > > >>> > > > >>> Chris Nauroth > > > >>> > > > >>> > > > >>> On Thu, Jul 14, 2022 at 7:57 AM Masatake Iwasaki < > > > iwasak...@oss.nttdata.com> > > > >>> wrote: > > > >>> > > > >>>> +1 from myself. > > > >>>> > > > >>>> * skimmed the contents of site documentation. > > > >>>> > > > >>>> * built the source tarball on Rocky Linux 8 (x86_64) by OpenJDK 8 > > with > > > >>>> `-Pnative`. > > > >>>> > > > >>>> * launched pseudo distributed cluster including kms and httpfs > with > > > >>>> Kerberos and SSL enabled. > > > >>>> > > > >>>> * created encryption zone, put and read files via httpfs. > > > >>>> * ran example MR wordcount over encryption zone. > > > >>>> > > > >>>> * launched 3-node docker cluster with NN-HA and RM-HA enabled and > > ran > > > some > > > >>>> example MR jobs. > > > >>>> > > > >>>> * built HBase 2.4.11, Hive 3.1.2 and Spark 3.1.2 against Hadoop > > 3.2.4 > > > RC0 > > > >>>> on CentOS 7 (x86_64) by using Bigtop branch-3.1 and ran > > > smoke-tests. > > > >>>> https://github.com/apache/bigtop/pull/942 > > > >>>> > > > >>>> * Hive needs updating exclusion rule to address HADOOP-18088 > > > (migration > > > >>>> to reload4j). > > > >>>> > > > >>>> * built Spark 3.3.0 against Hadoop 3.2.4 RC0 using the staging > > > repository:: > > > >>>> > > > >>>> <repository> > > > >>>> <id>staged</id> > > > >>>> <name>staged-releases</name> > > > >>>> <url> > > > >>>> > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > > > >>>> </url> > > > >>>> <releases> > > > >>>> <enabled>true</enabled> > > > >>>> </releases> > > > >>>> <snapshots> > > > >>>> <enabled>true</enabled> > > > >>>> </snapshots> > > > >>>> </repository> > > > >>>> > > > >>>> Thanks, > > > >>>> Masatake Iwasaki > > > >>>> > > > >>>> On 2022/07/13 1:14, Masatake Iwasaki wrote: > > > >>>>> Hi all, > > > >>>>> > > > >>>>> Here's Hadoop 3.2.4 release candidate #0: > > > >>>>> > > > >>>>> The RC is available at: > > > >>>>> https://home.apache.org/~iwasakims/hadoop-3.2.4-RC0/ > > > >>>>> > > > >>>>> The RC tag is at: > > > >>>>> > > https://github.com/apache/hadoop/releases/tag/release-3.2.4-RC0 > > > >>>>> > > > >>>>> The Maven artifacts are staged at: > > > >>>>> > > > >>>> > > > > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > > > >>>>> > > > >>>>> You can find my public key at: > > > >>>>> https://downloads.apache.org/hadoop/common/KEYS > > > >>>>> > > > >>>>> Please evaluate the RC and vote. > > > >>>>> The vote will be open for (at least) 5 days. > > > >>>>> > > > >>>>> Thanks, > > > >>>>> Masatake Iwasaki > > > >>>>> > > > >>>>> > > --------------------------------------------------------------------- > > > >>>>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > >>>>> For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > > >>>>> > > > >>>> > > > >>>> > > --------------------------------------------------------------------- > > > >>>> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > > >>>> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > > >>>> > > > >>>> > > > >>> > > > >> > > > >> > --------------------------------------------------------------------- > > > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > >> > > > > > > > > --------------------------------------------------------------------- > > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > > > > >
