kennknowles commented on issue #19814:
URL: https://github.com/apache/beam/issues/19814#issuecomment-1282896291
Despite recent flakes in Jenkins, this succeeded:
```
for i in `seq 1 100` ; do (
echo "RUN $i"
./gradlew :runners:flink:1.15:cleanTest --quiet
./gradlew :runners:flink:1.15:validatesRunnerStreaming --quiet --tests
ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful
) 2>/dev/null
done
```
From the logs, it seems clear that the state of the chain moves to failed,
and presumably it is taken down in a race condition with calling teardown.
```
[CHAIN DataSource (at Create.Values/Read(CreateSource)
(org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat)) ->
FlatMap (FlatMap at ParDo(ExceptionThrowing)/ParMultiDo(ExceptionThrowing)) ->
FlatMap (FlatMap at
ParDo(ExceptionThrowing)/ParMultiDo(ExceptionThrowing).output) (1/2)#0] WARN
org.apache.flink.runtime.taskmanager.Task - CHAIN DataSource (at
Create.Values/Read(CreateSource)
(org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat)) ->
FlatMap (FlatMap at ParDo(ExceptionThrowing)/ParMultiDo(ExceptionThrowing)) ->
FlatMap (FlatMap at
ParDo(ExceptionThrowing)/ParMultiDo(ExceptionThrowing).output) (1/2)#0
(5f615db581224acfcac1a918f0fa2b1c) switched from RUNNING to FAILED with failure
cause: org.apache.beam.sdk.util.UserCodeException: java.lang.Exception: Hasn't
yet thrown
at
org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
at
org.apache.beam.sdk.transforms.ParDoLifecycleTest$ExceptionThrowingFn$DoFnInvoker.invokeProcessElement(Unknown
Source)
at
org.apache.beam.runners.core.SimpleDoFnRunner.invokeProcessElement(SimpleDoFnRunner.java:211)
at
org.apache.beam.runners.core.SimpleDoFnRunner.processElement(SimpleDoFnRunner.java:188)
at
org.apache.beam.runners.flink.metrics.DoFnRunnerWithMetricsUpdate.processElement(DoFnRunnerWithMetricsUpdate.java:62)
at
org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction.flatMap(FlinkDoFnFunction.java:122)
at
org.apache.beam.runners.flink.translation.functions.FlinkDoFnFunction.flatMap(FlinkDoFnFunction.java:59)
at
org.apache.flink.runtime.operators.chaining.ChainedFlatMapDriver.collect(ChainedFlatMapDriver.java:79)
at
org.apache.flink.runtime.operators.util.metrics.CountingCollector.collect(CountingCollector.java:35)
at
org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:208)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.Exception: Hasn't yet thrown
at
org.apache.beam.sdk.transforms.ParDoLifecycleTest$ExceptionThrowingFn.throwIfNecessary(ParDoLifecycleTest.java:453)
at
org.apache.beam.sdk.transforms.ParDoLifecycleTest$ExceptionThrowingFn.perElement(ParDoLifecycleTest.java:433)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
