Truong Duc Kien created FLINK-18527:
---------------------------------------
Summary: Task Managers fail to start on HDP 2.6.5 due to
commons-cli conflict
Key: FLINK-18527
URL: https://issues.apache.org/jira/browse/FLINK-18527
Project: Flink
Issue Type: Bug
Components: Runtime / Task
Affects Versions: 1.11.0
Reporter: Truong Duc Kien
When launching a new job in HDP 2.6.5, we are encountering these exceptions
{code:java}
2020-07-08 16:10:36 E [default-dispatcher-4] [ o.a.f.y.YarnResourceManager]
Could not start TaskManager in container container_xxx
java.lang.NoSuchMethodError:
org.apache.commons.cli.Option.builder(Ljava/lang/String;)Lorg/apache/commons/cli/Option$Builder;
at
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions.<clinit>(CommandLineOptions.java:28)
~[flink-dist_2.12-1.11.0.jar:1.11.0]
....
2020-07-08 16:12:46 E [default-dispatcher-4] [ o.a.f.y.YarnResourceManager]
Could not start TaskManager in container container_xxx {} []
java.lang.NoClassDefFoundError: Could not initialize class
org.apache.flink.runtime.entrypoint.parser.CommandLineOptions
{code}
We figure this is because HDP 2.6.5 is putting commons-cli version 1.2 on the
class path, while Flink is expecting version 1.3. Maybe commons-cli should also
be shaded to avoid such issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
