GitHub user steveloughran reopened a pull request:
https://github.com/apache/spark/pull/21146
[SPARK-23654][BUILD] remove jets3t as a dependency of spark
## What changes were proposed in this pull request?
With the update of bouncy-castle JAR in Spark 2.3; jets3t doesn't work any
more; hence the s3n
connector to S3 is dead. Only one person has noticed so far. The hadoop s3n
connector is never going to be updated to work with a later version of jets3t,
instead the code has just been [cut from hadoop 3.x
entirely.](http://hadoop.apache.org/docs/r3.1.0/hadoop-aws/tools/hadoop-aws/s3n.html).
This patch remove the declarations of jets3t from the POMs which include it
(root and spark-core), so it is not being packaged up.
Of the transitive dependencies, one is pinned at the same version, the
others removed.
* javax.activation is kept at version 1.1.1. by an explicit import; without
this it would be downgraded to version 1.0.
* bcprov-jdk15on-1.58.jar, base64-2.3.8.jar, java-xmlbuilder-1.1.jar are
all removed. They are not directly used in Spark.
## How was this patch tested?
Seeing what jenkins has to say about the missing/changed dependencies.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/steveloughran/spark cloud/SPARK-23654-jets3t
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21146.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21146
----
commit f4b00c2d464f6c29f6ed97974ad256b5cb8b3fcc
Author: Steve Loughran <stevel@...>
Date: 2018-03-28T09:34:11Z
SPARK-23654 remove jets3t as a dependency of spark
This also updates the dev/deps dependency files so it is not expected
Change-Id: I15798710925d378de97523f7f89dbe5bd1cc8582
commit db77f2812dca195f9e940625421d5625e8497b93
Author: Steve Loughran <stevel@...>
Date: 2018-07-04T15:26:11Z
[SPARK-23654]. Explicitly add javax.activation-1.1.1 to the spark-core
dependencies so the version it transitively exports is the same as the one it
used to when jets3t was on the import graph. Remove the other JARs from the
deps list.
Change-Id: If22bb1b26381e2e8a3df050a535d644f45d306fe
commit eba7c820bb0fd14a382afbd76911a16fd8ab0d68
Author: Steve Loughran <stevel@...>
Date: 2018-07-14T15:18:58Z
[SPARK-23654] inline javax.activation version
Change-Id: I1298d6c3063ece8bc86575d781a85ba5309cda39
commit 9adc0ec943a0bc867e2017b0ecc1f028da4ea2f6
Author: Steve Loughran <stevel@...>
Date: 2018-08-13T18:10:57Z
[SPARK-23654] purge all of bouncy-castle from the POM and from all license
files
Change-Id: Iaf2e87ca57d46592551cfdbe6d5f8b419a92bcae
commit 853ee1cf1143073acec9f3d0cdade7d445ecc4c7
Author: Steve Loughran <stevel@...>
Date: 2018-08-14T05:38:02Z
[SPARK-25111] increment kinesis client/producer lib versions & aws-sdk to
match
Change-Id: Ibf4162fca33189086bef234b6752f403a06aa7b0
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
