JingsongLi opened a new pull request #17803: URL: https://github.com/apache/flink/pull/17803
## What is the purpose of the change The test CsvFilesystemStreamSinkITCase.testPart times out on AZP. ``` 2021-11-08T16:36:28.6542078Z Nov 08 16:36:28 org.junit.runners.model.TestTimedOutException: test timed out after 20 seconds 2021-11-08T16:36:28.6561998Z Nov 08 16:36:28 at java.io.ObjectOutputStream.putFields(ObjectOutputStream.java:463) 2021-11-08T16:36:28.6581789Z Nov 08 16:36:28 at java.util.Locale.writeObject(Locale.java:2156) 2021-11-08T16:36:28.6601916Z Nov 08 16:36:28 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2021-11-08T16:36:28.6621871Z Nov 08 16:36:28 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2021-11-08T16:36:28.6632222Z Nov 08 16:36:28 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2021-11-08T16:36:28.6633082Z Nov 08 16:36:28 at java.lang.reflect.Method.invoke(Method.java:498) 2021-11-08T16:36:28.6633845Z Nov 08 16:36:28 at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1154) 2021-11-08T16:36:28.6634442Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496) 2021-11-08T16:36:28.6634968Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6637691Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6640766Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6641958Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6642763Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6643563Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6644365Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6645138Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6647747Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6648657Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6649439Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6650189Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6650958Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6651975Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6652632Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6653314Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6664918Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6665679Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6666409Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6667211Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6667907Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6668585Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6669301Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6669991Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6670706Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6671353Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6672227Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6672878Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6673381Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6673864Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6674366Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6674864Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6675348Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6675851Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6676340Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6676827Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6677321Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6677797Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6678290Z Nov 08 16:36:28 at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548) 2021-11-08T16:36:28.6678781Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509) 2021-11-08T16:36:28.6679262Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432) 2021-11-08T16:36:28.6679764Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178) 2021-11-08T16:36:28.6680236Z Nov 08 16:36:28 at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348) 2021-11-08T16:36:28.6680733Z Nov 08 16:36:28 at org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:632) 2021-11-08T16:36:28.6681669Z Nov 08 16:36:28 at org.apache.flink.util.InstantiationUtil.writeObjectToConfig(InstantiationUtil.java:548) 2021-11-08T16:36:28.6682620Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamConfig.setStreamOperatorFactory(StreamConfig.java:308) 2021-11-08T16:36:28.6683633Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.setVertexConfig(StreamingJobGraphGenerator.java:713) 2021-11-08T16:36:28.6684729Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:461) 2021-11-08T16:36:28.6685788Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:411) 2021-11-08T16:36:28.6686964Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createChain(StreamingJobGraphGenerator.java:411) 2021-11-08T16:36:28.6688033Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.setChaining(StreamingJobGraphGenerator.java:377) 2021-11-08T16:36:28.6689024Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:178) 2021-11-08T16:36:28.6689973Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator.createJobGraph(StreamingJobGraphGenerator.java:116) 2021-11-08T16:36:28.6690944Z Nov 08 16:36:28 at org.apache.flink.streaming.api.graph.StreamGraph.getJobGraph(StreamGraph.java:960) 2021-11-08T16:36:28.6692027Z Nov 08 16:36:28 at org.apache.flink.client.StreamGraphTranslator.translateToJobGraph(StreamGraphTranslator.java:50) 2021-11-08T16:36:28.6692998Z Nov 08 16:36:28 at org.apache.flink.client.FlinkPipelineTranslationUtil.getJobGraph(FlinkPipelineTranslationUtil.java:39) 2021-11-08T16:36:28.6694130Z Nov 08 16:36:28 at org.apache.flink.client.deployment.executors.PipelineExecutorUtils.getJobGraph(PipelineExecutorUtils.java:56) 2021-11-08T16:36:28.6695274Z Nov 08 16:36:28 at org.apache.flink.test.util.MiniClusterPipelineExecutorServiceLoader$MiniClusterExecutor.execute(MiniClusterPipelineExecutorServiceLoader.java:137) 2021-11-08T16:36:28.6696466Z Nov 08 16:36:28 at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.executeAsync(StreamExecutionEnvironment.java:2095) 2021-11-08T16:36:28.6697500Z Nov 08 16:36:28 at org.apache.flink.table.planner.delegation.DefaultExecutor.executeAsync(DefaultExecutor.java:95) 2021-11-08T16:36:28.6698470Z Nov 08 16:36:28 at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:772) 2021-11-08T16:36:28.6699494Z Nov 08 16:36:28 at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:753) 2021-11-08T16:36:28.6700427Z Nov 08 16:36:28 at org.apache.flink.table.api.internal.TableImpl.executeInsert(TableImpl.java:574) 2021-11-08T16:36:28.6701363Z Nov 08 16:36:28 at org.apache.flink.table.api.internal.TableImpl.executeInsert(TableImpl.java:556) 2021-11-08T16:36:28.6702418Z Nov 08 16:36:28 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.test(FsStreamingSinkITCaseBase.scala:118) 2021-11-08T16:36:28.6703498Z Nov 08 16:36:28 at org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.testPart(FsStreamingSinkITCaseBase.scala:84) 2021-11-08T16:36:28.6704348Z Nov 08 16:36:28 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2021-11-08T16:36:28.6705109Z Nov 08 16:36:28 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2021-11-08T16:36:28.6705993Z Nov 08 16:36:28 at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2021-11-08T16:36:28.6706775Z Nov 08 16:36:28 at java.lang.reflect.Method.invoke(Method.java:498) 2021-11-08T16:36:28.6707560Z Nov 08 16:36:28 at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) 2021-11-08T16:36:28.6708439Z Nov 08 16:36:28 at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) 2021-11-08T16:36:28.6709327Z Nov 08 16:36:28 at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) 2021-11-08T16:36:28.6710196Z Nov 08 16:36:28 at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) 2021-11-08T16:36:28.6711113Z Nov 08 16:36:28 at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) 2021-11-08T16:36:28.6712067Z Nov 08 16:36:28 at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) 2021-11-08T16:36:28.6712971Z Nov 08 16:36:28 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) 2021-11-08T16:36:28.6714031Z Nov 08 16:36:28 at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) 2021-11-08T16:36:28.6714883Z Nov 08 16:36:28 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 2021-11-08T16:36:28.6715538Z Nov 08 16:36:28 at java.lang.Thread.run(Thread.java:748) 2021-11-08T16:36:28.6715983Z Nov 08 16:36:28 ``` https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26165&view=logs&j=d44f43ce-542c-597d-bf94-b0718c71e5e8&t=ed165f3f-d0f6-524b-5279-86f8ee7d0e2d&l=13306 ## Brief change log There are various situations during timeout. These stacks should not be blocked. One possible reason is that the timeout time is too short. For example: in https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23629&view=logs&j=3d12d40f-c62d-5ec4-6acc-0efe94cc3e89&t=4cf71635-d33f-53ff-7185-c5abb11ae3a0&l=14505 There is only memory computation in org.apache.flink.table.planner.runtime.stream.FsStreamingSinkITCaseBase.$anonfun$check$1(FsStreamingSinkITCaseBase.scala:137), no blocker. ## Verifying this change See unstable tests. ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (yes / **no**) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (yes / **no**) - The serializers: (yes / **no** / don't know) - The runtime per-record code paths (performance sensitive): (yes / **no** / don't know) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't know) - The S3 file system connector: (yes / **no** / don't know) ## Documentation - Does this pull request introduce a new feature? (yes / **no**) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
