I'm changing my vote to +1 (binding). Masatake and Ashutosh, thank you for investigating.
I reran tests without the parallel options, and that mostly addressed the failures. Maybe the tests in question are just not sufficiently isolated to support parallel execution. That looks to be the case for TestFsck, where the failure was caused by missing audit log entries. This test works by toggling global logging state, so I can see why multi-threaded execution might confuse the test. Chris Nauroth On Thu, Jul 21, 2022 at 12:01 AM Ashutosh Gupta <ashutoshgupta...@gmail.com> wrote: > +1(non-binding) > > * Builds from source look good. > * Checksums and signatures are correct. > * Running basic HDFS and MapReduce commands looks good. > > > * TestAMRMProxy - Not able to reproduce in local > > * TestFsck - I can see failure only I can see is > TestFsck.testFsckListCorruptSnapshotFiles which passed after applying > HDFS-15038 > > * TestSLSStreamAMSynth - Not able to reproduce in local > > * TestServiceAM - Not able to reproduce in local > > Thanks Masatake for driving this release. > > On Thu, Jul 21, 2022 at 5:51 AM Masatake Iwasaki < > iwasak...@oss.nttdata.com> > wrote: > > > Hi developers, > > > > I'm still waiting for your vote. > > I'm considering the intermittent test failures mentioned by Chris are not > > blocker. > > Please file a JIRA and let me know if you find a blocker issue. > > > > I will appreciate your help for the release process. > > > > Regards, > > Masatake Iwasaki > > > > On 2022/07/20 14:50, Masatake Iwasaki wrote: > > >> TestServiceAM > > > > > > I can see the reported failure of TestServiceAM in some "Apache Hadoop > > qbt Report: branch-3.2+JDK8 on Linux/x86_64". > > > 3.3.0 and above might be fixed by YARN-8867 which added guard using > > GenericTestUtils#waitFor for stabilizing the > > testContainersReleasedWhenPreLaunchFails. > > > YARN 8867 did not modified other code under hadoop-yarn-services. > > > If it is the case, TestServiceAM can be tagged as flaky in branch-3.2. > > > > > > > > > On 2022/07/20 14:21, Masatake Iwasaki wrote: > > >> Thanks for testing the RC0, Chris. > > >> > > >>> The following are new test failures for me on 3.2.4: > > >>> * TestAMRMProxy > > >>> * TestFsck > > >>> * TestSLSStreamAMSynth > > >>> * TestServiceAM > > >> > > >> I could not reproduce the test failures on my local. > > >> > > >> For TestFsck, if the failed test case is > > testFsckListCorruptSnapshotFiles, > > >> cherry-picking HDFS-15038 (fixing only test code) could be the fix. > > >> > > >> The failure of TestSLSStreamAMSynth looks frequently reported by > > >> "Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64". > > >> It could be tagged as known flaky test. > > >> > > >> On 2022/07/20 9:15, Chris Nauroth wrote: > > >>> -0 (binding) > > >>> > > >>> * Verified all checksums. > > >>> * Verified all signatures. > > >>> * Built from source, including native code on Linux. > > >>> * mvn clean package -Pnative -Psrc -Drequire.openssl > > -Drequire.snappy > > >>> -Drequire.zstd -DskipTests > > >>> * Tests mostly passed, but see below. > > >>> * mvn --fail-never clean test -Pnative -Dparallel-tests > > >>> -Drequire.snappy -Drequire.zstd -Drequire.openssl > > >>> -Dsurefire.rerunFailingTestsCount=3 -DtestsThreadCount=8 > > >>> > > >>> The following are new test failures for me on 3.2.4: > > >>> * TestAMRMProxy > > >>> * TestFsck > > >>> * TestSLSStreamAMSynth > > >>> * TestServiceAM > > >>> > > >>> The following tests also failed, but they also fail for me on 3.2.3, > so > > >>> they aren't likely to be related to this release candidate: > > >>> * TestCapacitySchedulerNodeLabelUpdate > > >>> * TestFrameworkUploader > > >>> * TestSLSGenericSynth > > >>> * TestSLSRunner > > >>> * test_libhdfs_threaded_hdfspp_test_shim_static > > >>> > > >>> I'm not voting a full -1, because I haven't done any root cause > > analysis on > > >>> these new test failures. I don't know if it's a quirk to my > > environment, > > >>> though I'm using the start-build-env.sh Docker container, so any > build > > >>> dependencies should be consistent. I'd be comfortable moving ahead if > > >>> others are seeing these tests pass. > > >>> > > >>> Chris Nauroth > > >>> > > >>> > > >>> On Thu, Jul 14, 2022 at 7:57 AM Masatake Iwasaki < > > iwasak...@oss.nttdata.com> > > >>> wrote: > > >>> > > >>>> +1 from myself. > > >>>> > > >>>> * skimmed the contents of site documentation. > > >>>> > > >>>> * built the source tarball on Rocky Linux 8 (x86_64) by OpenJDK 8 > with > > >>>> `-Pnative`. > > >>>> > > >>>> * launched pseudo distributed cluster including kms and httpfs with > > >>>> Kerberos and SSL enabled. > > >>>> > > >>>> * created encryption zone, put and read files via httpfs. > > >>>> * ran example MR wordcount over encryption zone. > > >>>> > > >>>> * launched 3-node docker cluster with NN-HA and RM-HA enabled and > ran > > some > > >>>> example MR jobs. > > >>>> > > >>>> * built HBase 2.4.11, Hive 3.1.2 and Spark 3.1.2 against Hadoop > 3.2.4 > > RC0 > > >>>> on CentOS 7 (x86_64) by using Bigtop branch-3.1 and ran > > smoke-tests. > > >>>> https://github.com/apache/bigtop/pull/942 > > >>>> > > >>>> * Hive needs updating exclusion rule to address HADOOP-18088 > > (migration > > >>>> to reload4j). > > >>>> > > >>>> * built Spark 3.3.0 against Hadoop 3.2.4 RC0 using the staging > > repository:: > > >>>> > > >>>> <repository> > > >>>> <id>staged</id> > > >>>> <name>staged-releases</name> > > >>>> <url> > > >>>> > > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > > >>>> </url> > > >>>> <releases> > > >>>> <enabled>true</enabled> > > >>>> </releases> > > >>>> <snapshots> > > >>>> <enabled>true</enabled> > > >>>> </snapshots> > > >>>> </repository> > > >>>> > > >>>> Thanks, > > >>>> Masatake Iwasaki > > >>>> > > >>>> On 2022/07/13 1:14, Masatake Iwasaki wrote: > > >>>>> Hi all, > > >>>>> > > >>>>> Here's Hadoop 3.2.4 release candidate #0: > > >>>>> > > >>>>> The RC is available at: > > >>>>> https://home.apache.org/~iwasakims/hadoop-3.2.4-RC0/ > > >>>>> > > >>>>> The RC tag is at: > > >>>>> > https://github.com/apache/hadoop/releases/tag/release-3.2.4-RC0 > > >>>>> > > >>>>> The Maven artifacts are staged at: > > >>>>> > > >>>> > > https://repository.apache.org/content/repositories/orgapachehadoop-1354 > > >>>>> > > >>>>> You can find my public key at: > > >>>>> https://downloads.apache.org/hadoop/common/KEYS > > >>>>> > > >>>>> Please evaluate the RC and vote. > > >>>>> The vote will be open for (at least) 5 days. > > >>>>> > > >>>>> Thanks, > > >>>>> Masatake Iwasaki > > >>>>> > > >>>>> > --------------------------------------------------------------------- > > >>>>> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >>>>> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > >>>>> > > >>>> > > >>>> > --------------------------------------------------------------------- > > >>>> To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > > >>>> For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > > >>>> > > >>>> > > >>> > > >> > > >> --------------------------------------------------------------------- > > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > >> > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > --------------------------------------------------------------------- > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > >
