[
https://issues.apache.org/jira/browse/BEAM-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15858780#comment-15858780
]
ASF GitHub Bot commented on BEAM-1411:
--------------------------------------
GitHub user adude3141 opened a pull request:
https://github.com/apache/beam/pull/1954
[BEAM-1411] Shade Guava in beam-sdks-java-io-hdfs module
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/adude3141/beam BEAM-1411
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/1954.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1954
----
commit 39269e621e8061bb11a4aaec0102bb24da134b97
Author: Michael Luckey <[email protected]>
Date: 2017-02-09T00:31:47Z
[BEAM-1411] Shade Guava in beam-sdks-java-io-hdfs module
----
> Unable to downgrade to lower guava version after upgrade to beam-0.5
> --------------------------------------------------------------------
>
> Key: BEAM-1411
> URL: https://issues.apache.org/jira/browse/BEAM-1411
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Affects Versions: 0.5.0
> Reporter: Michael Luckey
> Assignee: Davor Bonaci
>
> While testing upgrading to 0.5 version of beam we ran into NoSuchMethodErrors
> {noformat}
> java.lang.NoSuchMethodError:
> com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V
> at
> org.apache.beam.sdk.io.hdfs.HDFSFileSource$SerializableSplit.<init>(HDFSFileSource.java:473)
> at
> org.apache.beam.sdk.io.hdfs.AvroHDFSFileSource$1.apply(AvroHDFSFileSource.java:81)
> at
> org.apache.beam.sdk.io.hdfs.AvroHDFSFileSource$1.apply(AvroHDFSFileSource.java:78)
> at
> com.google.common.collect.Lists$TransformingRandomAccessList.get(Lists.java:451)
> at java.util.AbstractList$Itr.next(AbstractList.java:358)
> at
> org.apache.beam.runners.direct.BoundedReadEvaluatorFactory$InputProvider.getInitialInputs(BoundedReadEvaluatorFactory.java:202)
> at
> org.apache.beam.runners.direct.RootProviderRegistry.getInitialInputs(RootProviderRegistry.java:65)
> at
> org.apache.beam.runners.direct.ExecutorServiceParallelExecutor.start(ExecutorServiceParallelExecutor.java:168)
> at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:329)
> at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:71)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:178)
> at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:258)
> {noformat}
> This seems to be caused by the [HDFS
> IO|https://github.com/apache/beam/tree/master/sdks/java/io/hdfs] components
> guava dependency not being shaded - in contrast to the core components - and
> revealed by the [recent update to
> guava-20.0|https://github.com/apache/beam/commit/0b4b2becb45b9f637ba31f599ebe8be0331bd633]
> and the therefore incorporated api changes made by [overloading
> methods|https://github.com/google/guava/commit/892e323fca32945cdfb25395ca6e346dd0fffa5b#diff-fe7358934fa6eba23c2791eb40cec030]
> Did not check, whether more components are affected to.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
