Matthias Pohl created FLINK-29622:
-------------------------------------
Summary: KerberosDelegationTokenManager fails to load
DelegationTokenProvider due to NoClassDefFoundError in various tests
Key: FLINK-29622
URL: https://issues.apache.org/jira/browse/FLINK-29622
Project: Flink
Issue Type: Bug
Components: Runtime / Coordination, Tests
Affects Versions: 1.16.0, 1.17.0
Reporter: Matthias Pohl
There are multiple ITCases that print an error when trying to load the
{{HadoopFSDelegationTokenProvider}} which is on the classpath through
{{flink-runtime}} but the corresponding hadoop dependency seems to be missing:
{code}
186348 02:25:25,492 [ main] INFO
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Loading delegation token providers
186349 02:25:25,493 [ main] ERROR
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager [] -
Failed to initialize delegation token provider hadoopfs
186350 java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/HdfsConfiguration
186351 at
org.apache.flink.runtime.security.token.HadoopFSDelegationTokenProvider.init(HadoopFSDelegationTokenProvider.java:68)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186352 at
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager.loadProviders(KerberosDelegationTokenManager.java:124)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186353 at
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager.<init>(KerberosDelegationTokenManager.java:109)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186354 at
org.apache.flink.runtime.security.token.KerberosDelegationTokenManager.<init>(KerberosDelegationTokenManager.java:91)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186355 at
org.apache.flink.runtime.security.token.KerberosDelegationTokenManagerFactory.create(KerberosDelegationTokenManagerFactory.java:47)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186356 at
org.apache.flink.runtime.minicluster.MiniCluster.start(MiniCluster.java:431)
~[flink-runtime-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186357 at
org.apache.flink.runtime.testutils.MiniClusterResource.startMiniCluster(MiniClusterResource.java:234)
~[flink-runtime-1.16-SNAPSHOT-tests.jar:1.16-SNAPSHOT]
186358 at
org.apache.flink.runtime.testutils.MiniClusterResource.before(MiniClusterResource.java:109)
~[flink-runtime-1.16-SNAPSHOT-tests.jar:1.16-SNAPSHOT]
186359 at
org.apache.flink.test.util.MiniClusterWithClientResource.before(MiniClusterWithClientResource.java:64)
~[flink-test-utils-1.16-SNAPSHOT.jar:1.16-SNAPSHOT]
186360 at
org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase.setupTestCluster(EventTimeWindowCheckpointingITCase.java:253)
~[test-classes/:?]
186361 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_292]
[...]
{code}
This error might be misleading/confusing to people investigating the logs. It
looks like this error is actually expected since the tests not necessarily
require Kerberos delegation tokens.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
