mosche commented on PR #23522:
URL: https://github.com/apache/beam/pull/23522#issuecomment-1274290020
@aromanenko-dev Unfortunately there's no tests that would cover this ...
such classpath issues can only be detected if NOT running Spark in local mode.
I just noticed that the Spark 2 job-server / runner is broken as well, what
a mess 😠😡
```
java.lang.NoSuchMethodError:
com.fasterxml.jackson.databind.type.TypeBindings.emptyBindings()Lcom/fasterxml/jackson/databind/type/TypeBindings;
at
org.apache.beam.sdk.options.PipelineOptionsFactory.createBeanProperty(PipelineOptionsFactory.java:1708)
at
org.apache.beam.sdk.options.PipelineOptionsFactory.computeDeserializerForMethod(PipelineOptionsFactory.java:1732)
at
java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1660)
at
org.apache.beam.sdk.options.PipelineOptionsFactory.getDeserializerForMethod(PipelineOptionsFactory.java:1782)
at
org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1806)
```
That issue is even worse, I'm pretty convinced this isn't only affecting the
portable runner. Attempting to deserialize pipeline options will fail on the
cluster using either `PortableRunner` or `SparkRunner` because the expected
Jackson API is newer than the one available on the Spark cluster
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
