Nico Kruber created FLINK-7287:
----------------------------------
Summary: test instability in
Kafka010ITCase.testCommitOffsetsToKafka
Key: FLINK-7287
URL: https://issues.apache.org/jira/browse/FLINK-7287
Project: Flink
Issue Type: Improvement
Components: Kafka Connector, Tests
Affects Versions: 1.4.0
Reporter: Nico Kruber
Assignee: Nico Kruber
sporadically, {{Kafka010ITCase.testCommitOffsetsToKafka}} seems to be failing,
e.g.
{code}
================================================================================
Test
testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase)
is running.
--------------------------------------------------------------------------------
12:29:31,597 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase
-
===================================
== Writing sequence of 50 into testCommitOffsetsToKafkaTopic with p=3
===================================
12:29:31,597 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase
- Writing attempt #1
12:29:31,598 INFO
org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl -
Creating topic testCommitOffsetsToKafkaTopic-1
12:29:31,598 INFO org.I0Itec.zkclient.ZkEventThread
- Starting ZkClient event thread.
12:29:31,599 INFO org.I0Itec.zkclient.ZkClient
- Waiting for keeper state SyncConnected
12:29:31,601 INFO org.I0Itec.zkclient.ZkClient
- zookeeper state changed (SyncConnected)
12:29:31,615 INFO org.I0Itec.zkclient.ZkEventThread
- Terminate ZkClient event thread.
12:29:31,719 INFO org.I0Itec.zkclient.ZkEventThread
- Starting ZkClient event thread.
12:29:31,722 INFO org.I0Itec.zkclient.ZkClient
- Waiting for keeper state SyncConnected
12:29:31,728 INFO org.I0Itec.zkclient.ZkClient
- zookeeper state changed (SyncConnected)
12:29:31,729 INFO org.I0Itec.zkclient.ZkEventThread
- Terminate ZkClient event thread.
12:29:31,832 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting
FlinkKafkaProducer (3/3) to produce into default topic
testCommitOffsetsToKafkaTopic-1
12:29:31,840 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting
FlinkKafkaProducer (2/3) to produce into default topic
testCommitOffsetsToKafkaTopic-1
12:29:31,842 WARN
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing
on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
12:29:31,844 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Starting
FlinkKafkaProducer (1/3) to produce into default topic
testCommitOffsetsToKafkaTopic-1
12:29:31,844 WARN
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing
on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
12:29:31,846 WARN
org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerBase - Flushing
on checkpoint is enabled, but checkpointing is not enabled. Disabling flushing.
12:29:31,998 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase
- Finished writing sequence
12:29:31,998 INFO org.apache.flink.streaming.connectors.kafka.KafkaTestBase
- Validating sequence
12:29:32,123 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,129 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,136 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,139 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 0 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
12:29:32,154 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 2 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
12:29:32,236 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 1 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
12:29:32,496 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,507 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,521 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - No
restore state for FlinkKafkaConsumer.
12:29:32,531 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 1 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=2}]
12:29:32,535 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 2 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=0}]
12:29:32,628 INFO
org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer
subtask 0 will start reading the following 1 partitions from the committed
group offsets in Kafka:
[KafkaTopicPartition{topic='testCommitOffsetsToKafkaTopic-1', partition=1}]
12:29:33,017 ERROR org.apache.flink.streaming.connectors.kafka.Kafka010ITCase
-
--------------------------------------------------------------------------------
Test
testCommitOffsetsToKafka(org.apache.flink.streaming.connectors.kafka.Kafka010ITCase)
failed with:
java.lang.RuntimeException: Job failed with an exception
at
org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runCommitOffsetsToKafka(KafkaConsumerTestBase.java:251)
at
org.apache.flink.streaming.connectors.kafka.Kafka010ITCase.testCommitOffsetsToKafka(Kafka010ITCase.java:162)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.flink.runtime.client.JobCancellationException: Job was
cancelled.
at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply$mcV$sp(JobManager.scala:921)
at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
at
org.apache.flink.runtime.jobmanager.JobManager$$anonfun$handleMessage$1$$anonfun$applyOrElse$7.apply(JobManager.scala:873)
at
scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at
scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40)
at
akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
{code}
https://s3.amazonaws.com/archive.travis-ci.org/jobs/258046274/log.txt?X-Amz-Expires=30&X-Amz-Date=20170727T155552Z&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAJRYRXRSVGNKPKO5A/20170727/us-east-1/s3/aws4_request&X-Amz-SignedHeaders=host&X-Amz-Signature=0b629a0c2b5daedc65c8aa8eb3293bc956f8fd61dc70066a051ed5878b004dbf
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
