[
https://issues.apache.org/jira/browse/BEAM-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17326967#comment-17326967
]
Kenneth Knowles commented on BEAM-12205:
----------------------------------------
For releases, this is set to a specific Beam version, not `beam-master-<date>`.
In fact, I think we probably shouldn't even have any jar in
`beam-master-<date>` at this point, to quickly surface tests using this
container image in a way that is no longer adequately tested.
(there was a time in the past where we always did use that container image and
simply could not make correlated changes in SDK and worker, but instead had to
build the image first)
> Dataflow pipelines broken NoSuchMethodError DoFnInvoker.invokeSetup()
> ---------------------------------------------------------------------
>
> Key: BEAM-12205
> URL: https://issues.apache.org/jira/browse/BEAM-12205
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow, test-failures
> Reporter: Andrew Pilloud
> Assignee: Xinyu Liu
> Priority: P0
> Labels: currently-failing
>
> After https://github.com/apache/beam/pull/14155 a bunch of Dataflow SQL
> integration tests are crash looping with the following stack trace:
> {code}
> java.lang.NoSuchMethodError:
> org.apache.beam.sdk.transforms.reflect.DoFnInvoker.invokeSetup()
> org.apache.beam.runners.dataflow.worker.DoFnInstanceManagers$ConcurrentQueueInstanceManager.deserializeCopy(DoFnInstanceManagers.java:83)
>
> org.apache.beam.runners.dataflow.worker.DoFnInstanceManagers$ConcurrentQueueInstanceManager.peek(DoFnInstanceManagers.java:65)
> org.apache.beam.runners.dataflow.worker.UserParDoFnFactory.create(UserParDoFnFactory.java:99)
> org.apache.beam.runners.dataflow.worker.DefaultParDoFnFactory.create(DefaultParDoFnFactory.java:75)
>
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.createParDoOperation(IntrinsicMapTaskExecutorFactory.java:267)
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.access$000(IntrinsicMapTaskExecutorFactory.java:89)
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:186)
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:168)
> org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:66)
> org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:53)
> org.apache.beam.runners.dataflow.worker.graph.Networks.replaceDirectedNetworkNodes(Networks.java:90)
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.create(IntrinsicMapTaskExecutorFactory.java:128)
> org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.process(StreamingDataflowWorker.java:1332)
> org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.access$1100(StreamingDataflowWorker.java:165)
> org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker$7.run(StreamingDataflowWorker.java:1109)
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
