[
https://issues.apache.org/jira/browse/FLINK-33415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Pohl resolved FLINK-33415.
-----------------------------------
Assignee: Matthias Pohl
Resolution: Done
I did a bit more research. The method in question is
{{HadoopKerberosName.setRuleMechanism}} which is derived from {{KerberosName}}.
The method was added in
[d43af8b3|https://github.com/apache/hadoop/commit/d43af8b3db4743b4b240751b6f29de6c20cfd6e5].
The corresponding issue HADOOP-15996 was resolved in 2019. The Hadoop version
2.8.3 (which we used accidentally in the initial GHA runs) was released in
2018. Therefore, it makes sense to get this {{NoSuchMethodError}}.
I'm gonna resolve this issue.
> HAJobRunOnHadoopS3FileSystemITCase failed due to NoSuchMethodError
> ------------------------------------------------------------------
>
> Key: FLINK-33415
> URL: https://issues.apache.org/jira/browse/FLINK-33415
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Reporter: Matthias Pohl
> Assignee: Matthias Pohl
> Priority: Major
> Labels: github-actions, test-stability
>
> {code:java}
> Error: 23:16:52 23:16:52.433 [ERROR] Tests run: 1, Failures: 0, Errors: 1,
> Skipped: 0, Time elapsed: 6.271 s <<< FAILURE! - in
> org.apache.flink.fs.s3hadoop.HAJobRunOnHadoopS3FileSystemITCase
> 37033Error: 23:16:52 23:16:52.433 [ERROR]
> org.apache.flink.fs.s3hadoop.HAJobRunOnHadoopS3FileSystemITCase Time
> elapsed: 6.271 s <<< ERROR!
> 37034Oct 10 23:16:52 java.lang.NoSuchMethodError: 'void
> org.apache.hadoop.security.HadoopKerberosName.setRuleMechanism(java.lang.String)'
> 37035Oct 10 23:16:52 at
> org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:84)
> 37036Oct 10 23:16:52 at
> org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:315)
> 37037Oct 10 23:16:52 at
> org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:300)
> 37038Oct 10 23:16:52 at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:575)
> 37039Oct 10 23:16:52 at
> org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:474)
> 37040Oct 10 23:16:52 at
> org.apache.flink.fs.s3.common.AbstractS3FileSystemFactory.create(AbstractS3FileSystemFactory.java:129)
> 37041Oct 10 23:16:52 at
> org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:508)
> 37042Oct 10 23:16:52 at
> org.apache.flink.core.fs.FileSystem.get(FileSystem.java:409)
> 37043Oct 10 23:16:52 at
> org.apache.flink.core.fs.Path.getFileSystem(Path.java:279)
> 37044Oct 10 23:16:52 at
> org.apache.flink.runtime.blob.BlobUtils.createFileSystemBlobStore(BlobUtils.java:99)
> 37045Oct 10 23:16:52 at
> org.apache.flink.runtime.blob.BlobUtils.createBlobStoreFromConfig(BlobUtils.java:86)
> 37046Oct 10 23:16:52 at
> org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createZooKeeperHaServices(HighAvailabilityServicesUtils.java:89)
> 37047Oct 10 23:16:52 at
> org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createAvailableOrEmbeddedServices(HighAvailabilityServicesUtils.java:69)
> 37048Oct 10 23:16:52 at
> org.apache.flink.runtime.minicluster.MiniCluster$RegularHighAvailabilityServicesFactory.createHAServices(MiniCluster.java:1530)
> 37049Oct 10 23:16:52 at
> org.apache.flink.runtime.minicluster.MiniCluster.createHighAvailabilityServices(MiniCluster.java:617)
> 37050Oct 10 23:16:52 at
> org.apache.flink.runtime.minicluster.MiniCluster.start(MiniCluster.java:438)
> 37051Oct 10 23:16:52 at
> org.apache.flink.runtime.testutils.MiniClusterResource.startMiniCluster(MiniClusterResource.java:246)
> 37052Oct 10 23:16:52 at
> org.apache.flink.runtime.testutils.MiniClusterResource.before(MiniClusterResource.java:110)
> 37053Oct 10 23:16:52 at
> org.apache.flink.runtime.testutils.InternalMiniClusterExtension.beforeAll(InternalMiniClusterExtension.java:72)
> 37054Oct 10 23:16:52 at
> org.apache.flink.test.junit5.MiniClusterExtension.beforeAll(MiniClusterExtension.java:231)
> [...] {code}
> [Run
> #14|https://github.com/XComp/flink/actions/runs/6472816505/job/17575963787#step:11:37035]
> in the {{finegrained_resourcemanagement}} stage (see FLINK-33245)
> [Run
> #11|https://github.com/XComp/flink/actions/runs/6471147857/job/17571310183#step:11:41740]
> in the {{finegrained_resourcemanagement}} stage (see FLINK-33245)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
