Robert Metzger created FLINK-3295:
-------------------------------------
Summary: Flink Kafka consumer fails with NoNodeException if
zkConnect string contains chroot-path
Key: FLINK-3295
URL: https://issues.apache.org/jira/browse/FLINK-3295
Project: Flink
Issue Type: Bug
Reporter: Robert Metzger
Assignee: Robert Metzger
Zookeeper allows since V 3.2 to pass a base path (similar to chroot) with the
connection string. Flink's {{ZookeeperOffsetHandler}} doesn't show a very
helpful error message when the base path hasn't been created by the user.
This is the exception:
{{code}}
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /consumers
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.curator.utils.ZKPaths.mkdirs(ZKPaths.java:232)
at
org.apache.curator.utils.EnsurePath$InitialHelper$1.call(EnsurePath.java:148)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
at
org.apache.curator.utils.EnsurePath$InitialHelper.ensure(EnsurePath.java:141)
at org.apache.curator.utils.EnsurePath.ensure(EnsurePath.java:99)
at
org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.getOffsetFromZooKeeper(ZookeeperOffsetHandler.java:125)
at
org.apache.flink.streaming.connectors.kafka.internals.ZookeeperOffsetHandler.seekFetcherToInitialOffsets(ZookeeperOffsetHandler.java:93)
at
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer08.open(FlinkKafkaConsumer08.java:283)
at
org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
at
org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:89)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:305)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:227)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:568)
at java.lang.Thread.run(Thread.java:745)
{{code}}
But the user passed a connection string like: {{host:port/foo/bar}}.
See also: http://zookeeper.apache.org/doc/trunk/zookeeperProgrammers.html
(section on "ZooKeeper Sessions").
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
