[jira] [Created] (FLINK-23240) ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper fails on azure
Xintong Song created FLINK-23240: Summary: ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper fails on azure Key: FLINK-23240 URL: https://issues.apache.org/jira/browse/FLINK-23240 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.14.0 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19872=logs=b0a398c0-685b-599c-eb57-c8c2a771138e=d13f554f-d4b9-50f8-30ee-d49c6fb0b3cc=10186 {code} Jul 04 22:17:29 [ERROR] Tests run: 12, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 91.407 s <<< FAILURE! - in org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase Jul 04 22:17:29 [ERROR] testExternalizedFSCheckpointsWithLocalRecoveryZookeeper(org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase) Time elapsed: 31.356 s <<< ERROR! Jul 04 22:17:29 java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Invocation of public abstract java.util.concurrent.CompletableFuture org.apache.flink.runtime.webmonitor.RestfulGateway.cancelJob(org.apache.flink.api.common.JobID,org.apache.flink.api.common.time.Time) timed out. Jul 04 22:17:29 at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:395) Jul 04 22:17:29 at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999) Jul 04 22:17:29 at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.runJobAndGetExternalizedCheckpoint(ResumeCheckpointManuallyITCase.java:303) Jul 04 22:17:29 at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.testExternalizedCheckpoints(ResumeCheckpointManuallyITCase.java:275) Jul 04 22:17:29 at org.apache.flink.test.checkpointing.ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper(ResumeCheckpointManuallyITCase.java:215) Jul 04 22:17:29 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Jul 04 22:17:29 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Jul 04 22:17:29 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Jul 04 22:17:29 at java.base/java.lang.reflect.Method.invoke(Method.java:566) Jul 04 22:17:29 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) Jul 04 22:17:29 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Jul 04 22:17:29 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) Jul 04 22:17:29 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Jul 04 22:17:29 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Jul 04 22:17:29 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61) Jul 04 22:17:29 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Jul 04 22:17:29 at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) Jul 04 22:17:29 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) Jul 04 22:17:29 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) Jul 04 22:17:29 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) Jul 04 22:17:29 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Jul 04 22:17:29 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Jul 04 22:17:29 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Jul 04 22:17:29 at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) Jul 04 22:17:29 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) Jul 04 22:17:29 at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54) Jul 04 22:17:29 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Jul 04 22:17:29 at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) Jul 04 22:17:29 at org.junit.runners.ParentRunner.run(ParentRunner.java:413) Jul 04 22:17:29 at org.junit.runners.Suite.runChild(Suite.java:128) Jul 04 22:17:29 at org.junit.runners.Suite.runChild(Suite.java:27) Jul 04 22:17:29 at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) Jul 04 22:17:29 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) Jul 04 22:17:29 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) Jul 04 22:17:29 at
[jira] [Created] (FLINK-23239) HiveTableSinkITCase hangs on azure
Xintong Song created FLINK-23239: Summary: HiveTableSinkITCase hangs on azure Key: FLINK-23239 URL: https://issues.apache.org/jira/browse/FLINK-23239 Project: Flink Issue Type: Bug Components: Connectors / Hive Affects Versions: 1.14.0 Reporter: Xintong Song Fix For: 1.14.0 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19872=logs=5cae8624-c7eb-5c51-92d3-4d2dacedd221=420bd9ec-164e-562e-8947-0dacde3cec91=23845 {code} "main" #1 prio=5 os_prio=0 tid=0x7fac9000b800 nid=0x619b waiting on condition [0x7fac98621000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.sleepBeforeRetry(CollectResultFetcher.java:237) at org.apache.flink.streaming.api.operators.collect.CollectResultFetcher.next(CollectResultFetcher.java:113) at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.nextResultFromFetcher(CollectResultIterator.java:106) at org.apache.flink.streaming.api.operators.collect.CollectResultIterator.hasNext(CollectResultIterator.java:80) at org.apache.flink.table.api.internal.TableResultImpl$CloseableRowIteratorWrapper.hasNext(TableResultImpl.java:370) at org.apache.flink.connectors.hive.HiveTableSinkITCase.fetchRows(HiveTableSinkITCase.java:384) at org.apache.flink.connectors.hive.HiveTableSinkITCase.testStreamingSinkWithTimestampLtzWatermark(HiveTableSinkITCase.java:360) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23238) EventTimeWindowCheckpointingITCase.testTumblingTimeWindowWithKVStateMaxMaxParallelism fails on azure
Xintong Song created FLINK-23238: Summary: EventTimeWindowCheckpointingITCase.testTumblingTimeWindowWithKVStateMaxMaxParallelism fails on azure Key: FLINK-23238 URL: https://issues.apache.org/jira/browse/FLINK-23238 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.12.4 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19873=logs=baf26b34-3c6a-54e8-f93f-cf269b32f802=6dff16b1-bf54-58f3-23c6-76282f49a185=4490 {code} [ERROR] Tests run: 42, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 261.311 s <<< FAILURE! - in org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase [ERROR] testTumblingTimeWindowWithKVStateMaxMaxParallelism[statebackend type =ROCKSDB_INCREMENTAL](org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase) Time elapsed: 79.062 s <<< FAILURE! java.lang.AssertionError: Job execution failed. at org.junit.Assert.fail(Assert.java:88) at org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase.doTestTumblingTimeWindowWithKVState(EventTimeWindowCheckpointingITCase.java:434) at org.apache.flink.test.checkpointing.EventTimeWindowCheckpointingITCase.testTumblingTimeWindowWithKVStateMaxMaxParallelism(EventTimeWindowCheckpointingITCase.java:350) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23237) Add log to print data that failed to deserialize when ignore-parse-error=true and threre is NPE question when use `new String(message) ` if message = null
hehuiyuan created FLINK-23237: - Summary: Add log to print data that failed to deserialize when ignore-parse-error=true and threre is NPE question when use `new String(message) ` if message = null Key: FLINK-23237 URL: https://issues.apache.org/jira/browse/FLINK-23237 Project: Flink Issue Type: Improvement Reporter: hehuiyuan (1)Add log to print error data that failed to deserialize when set `ignore-parse-error` = `true` (2)Threre is NPE question when use `new String(message) ` if message is null. {code:java} public RowData deserialize(@Nullable byte[] message) throws IOException { if (message == null) { return null; } try { final JsonNode root = objectReader.readValue(message); return (RowData) runtimeConverter.convert(root); } catch (Throwable t) { if (ignoreParseErrors) { return null; } throw new IOException( String.format("Failed to deserialize CSV row '%s'.", new String(message)), t); } } {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23236) FanOutShardSubscriberTest.testTimeoutEnqueuingEvent fails on azure
Xintong Song created FLINK-23236: Summary: FanOutShardSubscriberTest.testTimeoutEnqueuingEvent fails on azure Key: FLINK-23236 URL: https://issues.apache.org/jira/browse/FLINK-23236 Project: Flink Issue Type: Bug Components: Connectors / Kinesis Affects Versions: 1.13.1 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19874=logs=d44f43ce-542c-597d-bf94-b0718c71e5e8=03dca39c-73e8-5aaf-601d-328ae5c35f20=14218 {code} Jul 04 22:22:17 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 3.415 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kinesis.internals.publisher.fanout.FanOutShardSubscriberTest Jul 04 22:22:17 [ERROR] testTimeoutEnqueuingEvent(org.apache.flink.streaming.connectors.kinesis.internals.publisher.fanout.FanOutShardSubscriberTest) Time elapsed: 2.552 s <<< FAILURE! Jul 04 22:22:17 java.lang.AssertionError: Expected test to throw (an instance of org.apache.flink.streaming.connectors.kinesis.internals.publisher.fanout.FanOutShardSubscriber$RecoverableFanOutSubscriberException and exception with message a string containing "Timed out enqueuing event SubscriptionNextEvent") Jul 04 22:22:17 at org.junit.Assert.fail(Assert.java:88) Jul 04 22:22:17 at org.junit.rules.ExpectedException.failDueToMissingException(ExpectedException.java:263) Jul 04 22:22:17 at org.junit.rules.ExpectedException.access$200(ExpectedException.java:106) Jul 04 22:22:17 at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:245) Jul 04 22:22:17 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Jul 04 22:22:17 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) Jul 04 22:22:17 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) Jul 04 22:22:17 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) Jul 04 22:22:17 at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) Jul 04 22:22:17 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) Jul 04 22:22:17 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) Jul 04 22:22:17 at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) Jul 04 22:22:17 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) Jul 04 22:22:17 at org.junit.runners.ParentRunner.run(ParentRunner.java:363) Jul 04 22:22:17 at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365) Jul 04 22:22:17 at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273) Jul 04 22:22:17 at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238) Jul 04 22:22:17 at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159) Jul 04 22:22:17 at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384) Jul 04 22:22:17 at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345) Jul 04 22:22:17 at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126) Jul 04 22:22:17 at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23235) SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure
Xintong Song created FLINK-23235: Summary: SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode fails on azure Key: FLINK-23235 URL: https://issues.apache.org/jira/browse/FLINK-23235 Project: Flink Issue Type: Bug Components: API / DataStream Affects Versions: 1.13.1 Reporter: Xintong Song Fix For: 1.13.2 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=02c4e775-43bf-5625-d1cc-542b5209e072=e5961b24-88d9-5c77-efd3-955422674c25=9972 {code} Jul 03 23:57:29 [ERROR] Tests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 5.53 s <<< FAILURE! - in org.apache.flink.test.streaming.runtime.SinkITCase Jul 03 23:57:29 [ERROR] writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(org.apache.flink.test.streaming.runtime.SinkITCase) Time elapsed: 0.68 s <<< FAILURE! Jul 03 23:57:29 java.lang.AssertionError: Jul 03 23:57:29 Jul 03 23:57:29 Expected: iterable over ["(895,null,-9223372036854775808)", "(895,null,-9223372036854775808)", "(127,null,-9223372036854775808)", "(127,null,-9223372036854775808)", "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", "(161,null,-9223372036854775808)", "(161,null,-9223372036854775808)", "(148,null,-9223372036854775808)", "(148,null,-9223372036854775808)", "(662,null,-9223372036854775808)", "(662,null,-9223372036854775808)", "(822,null,-9223372036854775808)", "(822,null,-9223372036854775808)", "(491,null,-9223372036854775808)", "(491,null,-9223372036854775808)", "(275,null,-9223372036854775808)", "(275,null,-9223372036854775808)", "(122,null,-9223372036854775808)", "(122,null,-9223372036854775808)", "(850,null,-9223372036854775808)", "(850,null,-9223372036854775808)", "(630,null,-9223372036854775808)", "(630,null,-9223372036854775808)", "(682,null,-9223372036854775808)", "(682,null,-9223372036854775808)", "(765,null,-9223372036854775808)", "(765,null,-9223372036854775808)", "(434,null,-9223372036854775808)", "(434,null,-9223372036854775808)", "(970,null,-9223372036854775808)", "(970,null,-9223372036854775808)", "(714,null,-9223372036854775808)", "(714,null,-9223372036854775808)", "(795,null,-9223372036854775808)", "(795,null,-9223372036854775808)", "(288,null,-9223372036854775808)", "(288,null,-9223372036854775808)", "(422,null,-9223372036854775808)", "(422,null,-9223372036854775808)"] in any order Jul 03 23:57:29 but: Not matched: "end of input" Jul 03 23:57:29 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) Jul 03 23:57:29 at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) Jul 03 23:57:29 at org.apache.flink.test.streaming.runtime.SinkITCase.writerAndCommitterAndGlobalCommitterExecuteInStreamingMode(SinkITCase.java:139) Jul 03 23:57:29 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Jul 03 23:57:29 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Jul 03 23:57:29 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Jul 03 23:57:29 at java.lang.reflect.Method.invoke(Method.java:498) Jul 03 23:57:29 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Jul 03 23:57:29 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Jul 03 23:57:29 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Jul 03 23:57:29 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Jul 03 23:57:29 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) Jul 03 23:57:29 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) Jul 03 23:57:29 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Jul 03 23:57:29 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) Jul 03 23:57:29 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Jul 03 23:57:29 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) Jul 03 23:57:29 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) Jul 03 23:57:29 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) Jul 03 23:57:29 at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) Jul 03 23:57:29 at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) Jul 03 23:57:29 at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) Jul 03 23:57:29 at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) Jul 03 23:57:29 at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) Jul 03
[jira] [Created] (FLINK-23234) UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails on azure with NoResourceAvailableException
Xintong Song created FLINK-23234: Summary: UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails on azure with NoResourceAvailableException Key: FLINK-23234 URL: https://issues.apache.org/jira/browse/FLINK-23234 Project: Flink Issue Type: Bug Affects Versions: 1.13.1 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19867=logs=d8d26c26-7ec2-5ed2-772e-7a1a1eb8317c=be5fb08e-1ad7-563c-4f1a-a97ad4ce4865=9813 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23233) OperatorEventSendingCheckpointITCase.testOperatorEventLostWithReaderFailure fails on azure
Xintong Song created FLINK-23233: Summary: OperatorEventSendingCheckpointITCase.testOperatorEventLostWithReaderFailure fails on azure Key: FLINK-23233 URL: https://issues.apache.org/jira/browse/FLINK-23233 Project: Flink Issue Type: Bug Components: Runtime / Checkpointing Affects Versions: 1.13.1 Reporter: Xintong Song Fix For: 1.13.2 https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19857=logs=4d4a0d10-fca2-5507-8eed-c07f0bdf4887=c2734c79-73b6-521c-e85a-67c7ecae9107=9382 {code} Jul 03 01:37:31 [ERROR] Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 21.415 s <<< FAILURE! - in org.apache.flink.runtime.operators.coordination.OperatorEventSendingCheckpointITCase Jul 03 01:37:31 [ERROR] testOperatorEventLostWithReaderFailure(org.apache.flink.runtime.operators.coordination.OperatorEventSendingCheckpointITCase) Time elapsed: 3.623 s <<< FAILURE! Jul 03 01:37:31 java.lang.AssertionError: expected:<[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100]> but was:<[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67]> Jul 03 01:37:31 at org.junit.Assert.fail(Assert.java:88) Jul 03 01:37:31 at org.junit.Assert.failNotEquals(Assert.java:834) Jul 03 01:37:31 at org.junit.Assert.assertEquals(Assert.java:118) Jul 03 01:37:31 at org.junit.Assert.assertEquals(Assert.java:144) Jul 03 01:37:31 at org.apache.flink.runtime.operators.coordination.OperatorEventSendingCheckpointITCase.runTest(OperatorEventSendingCheckpointITCase.java:254) Jul 03 01:37:31 at org.apache.flink.runtime.operators.coordination.OperatorEventSendingCheckpointITCase.testOperatorEventLostWithReaderFailure(OperatorEventSendingCheckpointITCase.java:143) Jul 03 01:37:31 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Jul 03 01:37:31 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Jul 03 01:37:31 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Jul 03 01:37:31 at java.lang.reflect.Method.invoke(Method.java:498) Jul 03 01:37:31 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) Jul 03 01:37:31 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) Jul 03 01:37:31 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) Jul 03 01:37:31 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) Jul 03 01:37:31 at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45) Jul 03 01:37:31 at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55) Jul 03 01:37:31 at org.junit.rules.RunRules.evaluate(RunRules.java:20) Jul 03 01:37:31 at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) Jul 03 01:37:31 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) Jul 03 01:37:31 at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[VOTE] Release 1.12.5, release candidate #1
Hi everyone, Please review and vote on the release candidate #1 for the version 1.12.5, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * the official Apache source release and binary convenience releases to be deployed to dist.apache.org [2], which are signed with the key with fingerprint FBB83C0A4FFB9CA8 [3], * all artifacts to be deployed to the Maven Central Repository [4], * source code tag "release-1.12.5-rc1" [5], * website pull request listing the new release and adding announcement blog post [6]. The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. Best, Jingsong Lee [1] https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12350166 [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.12.5-rc1/ [3] https://dist.apache.org/repos/dist/release/flink/KEYS [4] https://repository.apache.org/content/repositories/orgapacheflink-1430 [5] https://github.com/apache/flink/releases/tag/release-1.12.5-rc1 [6] https://github.com/apache/flink-web/pull/455
Re: [VOTE] Release 1.13.2, release candidate #1
@JING ZHANG , thanks for your reminder and you could comment on my PR for further discussion. Best Yun Tang From: Xintong Song Sent: Monday, July 5, 2021 10:09 To: dev Subject: Re: [VOTE] Release 1.13.2, release candidate #1 +1 (binding) - verified checksums & signatures - built from sources - run example jobs with standalone and native k8s (with custom image) deployments * job execution looks fine * nothing unexpected found in logs and web ui Thank you~ Xintong Song On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG wrote: > Hi yun, > Website pull request lists[6] and JIRA release notes[1] both contain > unfinished JIRA (such as FLINK-22955). > Is it expected? > > Best regards, > JING ZHANG > > Dawid Wysakowicz 于2021年7月2日周五 下午9:05写道: > > > +1 (binding) > > > >- verified signatures and checksums > >- reviewed the announcement PR > >- built from sources and run an example, quickly checked Web UI > >- checked diff of pom.xml and NOTICE files from 1.13.1, > >- commons-io updated, > > - bundled guava:failureaccess addded in flink-sql-connector-kinesis > > which is properly reflected in the NOTICE file > > > > Best, > > Dawid > > On 01/07/2021 12:57, Yun Tang wrote: > > > > Hi everyone, > > Please review and vote on the release candidate #1 for the version > 1.13.2, as follows: > > [ ] +1, Approve the release > > [ ] -1, Do not approve the release (please provide specific comments) > > > > > > The complete staging area is available for your review, which includes: > > * JIRA release notes [1], > > * the official Apache source release and binary convenience releases to > be deployed to dist.apache.org [2], which are signed with the key with > fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3], > > * all artifacts to be deployed to the Maven Central Repository [4], > > * source code tag "release-1.13.2-rc1" [5], > > * website pull request listing the new release and adding announcement > blog post [6]. > > > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > > > Best, > > Yun Tang > > > > [1] > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522 > > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/ > > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1429/ > > [5] https://github.com/apache/flink/releases/tag/release-1.13.2-rc1 > > [6] https://github.com/apache/flink-web/pull/453 > > > > >
Re: [VOTE] Release 1.13.2, release candidate #1
+1 (non-binding) - built from sources - run example jobs with standalone and yarn. - check TaskManager's rest API from the JM master and its standby, everything looks good Best, Yangze Guo On Mon, Jul 5, 2021 at 10:10 AM Xintong Song wrote: > > +1 (binding) > > - verified checksums & signatures > - built from sources > - run example jobs with standalone and native k8s (with custom image) > deployments > * job execution looks fine > * nothing unexpected found in logs and web ui > > Thank you~ > > Xintong Song > > > > On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG wrote: > > > Hi yun, > > Website pull request lists[6] and JIRA release notes[1] both contain > > unfinished JIRA (such as FLINK-22955). > > Is it expected? > > > > Best regards, > > JING ZHANG > > > > Dawid Wysakowicz 于2021年7月2日周五 下午9:05写道: > > > > > +1 (binding) > > > > > >- verified signatures and checksums > > >- reviewed the announcement PR > > >- built from sources and run an example, quickly checked Web UI > > >- checked diff of pom.xml and NOTICE files from 1.13.1, > > >- commons-io updated, > > > - bundled guava:failureaccess addded in flink-sql-connector-kinesis > > > which is properly reflected in the NOTICE file > > > > > > Best, > > > Dawid > > > On 01/07/2021 12:57, Yun Tang wrote: > > > > > > Hi everyone, > > > Please review and vote on the release candidate #1 for the version > > 1.13.2, as follows: > > > [ ] +1, Approve the release > > > [ ] -1, Do not approve the release (please provide specific comments) > > > > > > > > > The complete staging area is available for your review, which includes: > > > * JIRA release notes [1], > > > * the official Apache source release and binary convenience releases to > > be deployed to dist.apache.org [2], which are signed with the key with > > fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3], > > > * all artifacts to be deployed to the Maven Central Repository [4], > > > * source code tag "release-1.13.2-rc1" [5], > > > * website pull request listing the new release and adding announcement > > blog post [6]. > > > > > > The vote will be open for at least 72 hours. It is adopted by majority > > approval, with at least 3 PMC affirmative votes. > > > > > > Best, > > > Yun Tang > > > > > > [1] > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522 > > > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/ > > > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > > > [4] > > https://repository.apache.org/content/repositories/orgapacheflink-1429/ > > > [5] https://github.com/apache/flink/releases/tag/release-1.13.2-rc1 > > > [6] https://github.com/apache/flink-web/pull/453 > > > > > > > >
[jira] [Created] (FLINK-23232) PyFlink tox check fails on azure
Xintong Song created FLINK-23232: Summary: PyFlink tox check fails on azure Key: FLINK-23232 URL: https://issues.apache.org/jira/browse/FLINK-23232 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.14.0 Reporter: Xintong Song https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=19855=logs=9cada3cb-c1d3-5621-16da-0f718fb86602=8d78fe4f-d658-5c70-12f8-4921589024c3=23069 {code} Jul 03 00:07:56 tox checks... [FAILED] Jul 03 00:07:56 Process exited with EXIT CODE: 1. Jul 03 00:07:56 Trying to KILL watchdog (3140). /__w/2/s/tools/ci/watchdog.sh: line 100: 3140 Terminated watchdog Jul 03 00:07:56 Searching for .dump, .dumpstream and related files in '/__w/2/s' The STDIO streams did not close within 10 seconds of the exit event from process '/bin/bash'. This may indicate a child process inherited the STDIO streams and has not yet exited. {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: [VOTE] Release 1.13.2, release candidate #1
+1 (binding) - verified checksums & signatures - built from sources - run example jobs with standalone and native k8s (with custom image) deployments * job execution looks fine * nothing unexpected found in logs and web ui Thank you~ Xintong Song On Sun, Jul 4, 2021 at 12:36 PM JING ZHANG wrote: > Hi yun, > Website pull request lists[6] and JIRA release notes[1] both contain > unfinished JIRA (such as FLINK-22955). > Is it expected? > > Best regards, > JING ZHANG > > Dawid Wysakowicz 于2021年7月2日周五 下午9:05写道: > > > +1 (binding) > > > >- verified signatures and checksums > >- reviewed the announcement PR > >- built from sources and run an example, quickly checked Web UI > >- checked diff of pom.xml and NOTICE files from 1.13.1, > >- commons-io updated, > > - bundled guava:failureaccess addded in flink-sql-connector-kinesis > > which is properly reflected in the NOTICE file > > > > Best, > > Dawid > > On 01/07/2021 12:57, Yun Tang wrote: > > > > Hi everyone, > > Please review and vote on the release candidate #1 for the version > 1.13.2, as follows: > > [ ] +1, Approve the release > > [ ] -1, Do not approve the release (please provide specific comments) > > > > > > The complete staging area is available for your review, which includes: > > * JIRA release notes [1], > > * the official Apache source release and binary convenience releases to > be deployed to dist.apache.org [2], which are signed with the key with > fingerprint 78A306590F1081CC6794DC7F62DAD618E07CF996 [3], > > * all artifacts to be deployed to the Maven Central Repository [4], > > * source code tag "release-1.13.2-rc1" [5], > > * website pull request listing the new release and adding announcement > blog post [6]. > > > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > > > Best, > > Yun Tang > > > > [1] > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12350218==12315522 > > [2] https://dist.apache.org/repos/dist/dev/flink/flink-1.13.2-rc1/ > > [3] https://dist.apache.org/repos/dist/release/flink/KEYS > > [4] > https://repository.apache.org/content/repositories/orgapacheflink-1429/ > > [5] https://github.com/apache/flink/releases/tag/release-1.13.2-rc1 > > [6] https://github.com/apache/flink-web/pull/453 > > > > >
[RESULT] [VOTE] FLIP-150: Introduce Hybrid Source
Hi everyone, The vote for FLIP-150 has now been closed. We have six approving votes, two of which are binding: * Arvid Heise (binding) * Thomas Weise (binding) * Steven Wu * Shawn * Elkhan Dadashov * Israel Ekpo There are no disapproving votes. Thanks everyone for voting! Regards Nicholas Jiang
[jira] [Created] (FLINK-23230) Cannot compile Flink on MacOS with M1 chip
Osama Neiroukh created FLINK-23230: -- Summary: Cannot compile Flink on MacOS with M1 chip Key: FLINK-23230 URL: https://issues.apache.org/jira/browse/FLINK-23230 Project: Flink Issue Type: Bug Components: Build System Affects Versions: 1.13.1 Reporter: Osama Neiroukh Flink doesn't currently compile on MacOS with M1 silicon. This is true for all recent versions (1.13.X) as well as master. Some of the problems have potentially easy fixes, such as installing node separately or updating the relevant pom.xml to use a newer version of node. I am getting some errors about deprecated features being used which are not supported by newer node, but on the surface they seem easy to resolve. I've had less success with complex dependencies such as protobuf.us My long term objective is to use and contribute to Flink. If I can get some help with the above issues, I am willing to make the modifications, submit the changes as a pull request, and shepherd them to release. If compilation on MacOS/M1 is not a priority, I can look for a virtual machine solution instead. Feedback appreciated. Thanks Osama -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23229) Translate "Timely Stream Processing" page into Chinese
kevin created FLINK-23229: - Summary: Translate "Timely Stream Processing" page into Chinese Key: FLINK-23229 URL: https://issues.apache.org/jira/browse/FLINK-23229 Project: Flink Issue Type: Improvement Components: chinese-translation, Documentation Affects Versions: 1.13.0 Reporter: kevin Fix For: 1.13.0 The page url is [https://ci.apache.org/projects/flink/flink-docs-release-1.13/zh/docs/concepts/time/] The markdown file is located in *docs/content.zh/docs/concepts/time.md* This page needs to be translated to Chinese, currently, only title was translated to Chinese. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-23228) Translate "Stateful Stream Processing" page into Chinese
kevin created FLINK-23228: - Summary: Translate "Stateful Stream Processing" page into Chinese Key: FLINK-23228 URL: https://issues.apache.org/jira/browse/FLINK-23228 Project: Flink Issue Type: Improvement Components: chinese-translation, Documentation Affects Versions: 1.13.0 Reporter: kevin Fix For: 1.13.0 The page url is [https://ci.apache.org/projects/flink/flink-docs-release-1.13/zh/docs/concepts/stateful-stream-processing/ |https://ci.apache.org/projects/flink/flink-docs-release-1.13/zh/docs/concepts/stateful-stream-processing/] The markdown file is located in *docs/content.zh/docs/concepts/stateful-stream-processing.md* this page needs to be translated to Chinese, currently, only title was translated to Chinese. -- This message was sent by Atlassian Jira (v8.3.4#803005)