Compile the distribution using mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true -DskipShade and run some hadoop fs commands. All good there.
Then I ran the hadoop-aws tests and saw following failures: [*ERROR*] *Failures: * [*ERROR*] * ITestS3AMiscOperations.testEmptyFileChecksums:147->Assert.assertEquals:118->Assert.failNotEquals:743->Assert.fail:88 checksums expected:<etag: "6dd081d9f4abc2fb88fb75f94c84a85f"> but was:<etag: "aa7c140fc86610c1d0d188acb572036c">* [*ERROR*] * ITestS3AMiscOperations.testNonEmptyFileChecksumsUnencrypted:199->Assert.assertEquals:118->Assert.failNotEquals:743->Assert.fail:88 checksums expected:<etag: "381e9886ed6117722fa9080e5234202f"> but was:<etag: "10908d6e1c24362a79a3cd4c5aafb1a1">* These were the same failures which I saw in RC0 as well. I think these are known failures. Apart from that, all of my AssumedRole tests are failing AccessDenied exception like [*ERROR*] testPartialDeleteSingleDelete(org.apache.hadoop.fs.s3a.auth.ITestAssumeRole) Time elapsed: 3.359 s <<< ERROR! org.apache.hadoop.fs.s3a.AWSServiceIOException: initTable on mthakur-data: com.amazonaws.services.dynamodbv2.model.AmazonDynamoDBException: User: arn:aws:sts::152813717728:assumed-role/mthakur-assumed-role/valid is not authorized to perform: dynamodb:DescribeTable on resource: arn:aws:dynamodb:ap-south-1:152813717728:table/mthakur-data (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: AccessDeniedException; Request ID: UJLKVGJ9I1S9TQF3AEPHVGENVJVV4KQNSO5AEMVJF66Q9ASUAAJG): User: arn:aws:sts::152813717728:assumed-role/mthakur-assumed-role/valid is not authorized to perform: dynamodb:DescribeTable on resource: arn:aws:dynamodb:ap-south-1:152813717728:table/mthakur-data (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: AccessDeniedException; Request ID: UJLKVGJ9I1S9TQF3AEPHVGENVJVV4KQNSO5AEMVJF66Q9ASUAAJG) at org.apache.hadoop.fs.s3a.auth.ITestAssumeRole.executePartialDelete(ITestAssumeRole.java:759) at org.apache.hadoop.fs.s3a.auth.ITestAssumeRole.testPartialDeleteSingleDelete(ITestAssumeRole.java:735) I checked my policy and could verify that dynamodb:DescribeTable access is present there. So just to cross check, I ran the AssumedRole test with the same configs for apache/trunk and it succeeded. Not sure if this is a false alarm but I think it would be better if someone else run these AssumedRole tests as well and verify. Thanks Mukund On Fri, Jun 26, 2020 at 7:21 PM Gabor Bota <gabor.b...@cloudera.com> wrote: > Hi folks, > > I have put together a release candidate (RC2) for Hadoop 3.1.4. > > The RC is available at: http://people.apache.org/~gabota/hadoop-3.1.4-RC2/ > The RC tag in git is here: > https://github.com/apache/hadoop/releases/tag/release-3.1.4-RC2 > The maven artifacts are staged at > https://repository.apache.org/content/repositories/orgapachehadoop-1269/ > > You can find my public key at: > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > and http://keys.gnupg.net/pks/lookup?op=get&search=0xB86249D83539B38C > > Please try the release and vote. The vote will run for 5 weekdays, > until July 6. 2020. 23:00 CET. > > The release includes the revert of HDFS-14941, as it caused > HDFS-15421. IBR leak causes standby NN to be stuck in safe mode. > (https://issues.apache.org/jira/browse/HDFS-15421) > The release includes HDFS-15323, as requested. > (https://issues.apache.org/jira/browse/HDFS-15323) > > Thanks, > Gabor >
