[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17246319#comment-17246319
]
Huang Xingbo commented on FLINK-13595:
--
[https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=10677=logs=c5f0071e-1851-543e-9a45-9ac140befc32=1fb1a56f-e8b5-5a82-00a0-a2db7757b4f5]
This test occurred timeout in the release-1.12, not when KafkaAdminClient is
closed in the cleanup stage, but the job execution timeout.
{code:java}
2020-12-09T02:32:42.0953308Z Test
testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
failed with:
2020-12-09T02:32:42.0953877Z org.junit.runners.model.TestTimedOutException:
test timed out after 6 milliseconds
2020-12-09T02:32:42.0954413Zat sun.misc.Unsafe.park(Native Method)
2020-12-09T02:32:42.0954766Zat
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
2020-12-09T02:32:42.0955196Zat
java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1707)
2020-12-09T02:32:42.0955654Zat
java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3323)
2020-12-09T02:32:42.0956099Zat
java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1742)
2020-12-09T02:32:42.0961014Zat
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
2020-12-09T02:32:42.0961793Zat
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1842)
2020-12-09T02:32:42.0962431Zat
org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1822)
2020-12-09T02:32:42.0962974Zat
org.apache.flink.test.util.TestUtils.tryExecute(TestUtils.java:40)
2020-12-09T02:32:42.0963756Zat
org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1305)
2020-12-09T02:32:42.0964449Zat
org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:120)
2020-12-09T02:32:42.0964886Zat
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-12-09T02:32:42.0965314Zat
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-12-09T02:32:42.0965813Zat
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-12-09T02:32:42.0966261Zat
java.lang.reflect.Method.invoke(Method.java:498)
2020-12-09T02:32:42.0966693Zat
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
2020-12-09T02:32:42.0967188Zat
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2020-12-09T02:32:42.0967775Zat
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
2020-12-09T02:32:42.0968408Zat
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2020-12-09T02:32:42.0968934Zat
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
2020-12-09T02:32:42.0969467Zat
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
2020-12-09T02:32:42.0969937Zat
java.util.concurrent.FutureTask.run(FutureTask.java:266)
2020-12-09T02:32:42.0970293Zat java.lang.Thread.run(Thread.java:748){code}
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016846#comment-17016846
]
Jiangjie Qin commented on FLINK-13595:
--
PR Merged.
master: fff0952a0230ab7271e95ce604356cf211595d02
release-1.10: bf0f968f89061153d0d3a93890eb8f7a202f0c59
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1336)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> https://api.travis-ci.org/v3/job/568176170/log.txt
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002735#comment-17002735
]
Jiangjie Qin commented on FLINK-13595:
--
Two out of the three reported failures occurred in the cleanup stage due to the
timeout when closing the {{KafkaAdminClient}}. I am not sure if this is an
actual issue but for our testing purpose, closing the {{KafkaAdminClient}} with
a timeout should avoid the problem.
The logging information from the third case was too vague to debug.
I'll address the timeout problem and close the ticket. If there are further
occurrence, let's reopen the ticket.
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Critical
> Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1336)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> https://api.travis-ci.org/v3/job/568176170/log.txt
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984741#comment-16984741
]
Dian Fu commented on FLINK-13595:
-
Another instance: [https://api.travis-ci.org/v3/job/618270925/log.txt]
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Critical
> Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1336)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> https://api.travis-ci.org/v3/job/568176170/log.txt
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978480#comment-16978480
]
Gary Yao commented on FLINK-13595:
--
Another instance https://api.travis-ci.org/v3/job/614530220/log.txt
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Critical
> Labels: test-stability
> Fix For: 1.10.0
>
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1336)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> https://api.travis-ci.org/v3/job/568176170/log.txt
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (FLINK-13595) KafkaITCase.testBigRecordJob fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900760#comment-16900760
]
Jiangjie Qin commented on FLINK-13595:
--
This issue is more of a Kafka issue than a Flink issue. It occurs after all the
testing logic has completed while cleaning the testing environment to delete
the Kafka testing topics. The delete took long to finish and cause the test to
fail.
I'll look into this issue and probably fix this on the Kafka side. Meanwhile,
we don't have to make this as a blocker for 1.9 release. Moving to critical
instead.
> KafkaITCase.testBigRecordJob fails on Travis
>
>
> Key: FLINK-13595
> URL: https://issues.apache.org/jira/browse/FLINK-13595
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka, Tests
>Affects Versions: 1.9.0
>Reporter: Till Rohrmann
>Assignee: Jiangjie Qin
>Priority: Blocker
> Labels: test-stability
> Fix For: 1.9.0
>
>
> The {{KafkaITCase.testBigRecordJob}} failed with a {{TestTimedOutException}}
> on Travis.
> {code}
> Test
> testBigRecordJob(org.apache.flink.streaming.connectors.kafka.KafkaITCase)
> failed with:
> org.junit.runners.model.TestTimedOutException: test timed out after 6
> milliseconds
> at java.lang.Object.wait(Native Method)
> at java.lang.Thread.join(Thread.java:1252)
> at java.lang.Thread.join(Thread.java:1326)
> at
> org.apache.kafka.clients.admin.KafkaAdminClient.close(KafkaAdminClient.java:476)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:92)
> at org.apache.kafka.clients.admin.AdminClient.close(AdminClient.java:75)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.deleteTestTopic(KafkaTestEnvironmentImpl.java:153)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaTestBase.deleteTestTopic(KafkaTestBase.java:204)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runBigRecordTestTopology(KafkaConsumerTestBase.java:1336)
> at
> org.apache.flink.streaming.connectors.kafka.KafkaITCase.testBigRecordJob(KafkaITCase.java:121)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.lang.Thread.run(Thread.java:748)
> {code}
> https://api.travis-ci.org/v3/job/568176170/log.txt
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
