GitHub user steveloughran reopened a pull request: https://github.com/apache/spark/pull/21146
[SPARK-23654][BUILD] remove jets3t as a dependency of spark ## What changes were proposed in this pull request? With the update of bouncy-castle JAR in Spark 2.3; jets3t doesn't work any more; hence the s3n connector to S3 is dead. Only one person has noticed so far. The hadoop s3n connector is never going to be updated to work with a later version of jets3t, instead the code has just been [cut from hadoop 3.x entirely.](http://hadoop.apache.org/docs/r3.1.0/hadoop-aws/tools/hadoop-aws/s3n.html). This patch remove the declarations of jets3t from the POMs which include it (root and spark-core), so it is not being packaged up. Of the transitive dependencies, one is pinned at the same version, the others removed. * javax.activation is kept at version 1.1.1. by an explicit import; without this it would be downgraded to version 1.0. * bcprov-jdk15on-1.58.jar, base64-2.3.8.jar, java-xmlbuilder-1.1.jar are all removed. They are not directly used in Spark. ## How was this patch tested? Seeing what jenkins has to say about the missing/changed dependencies. You can merge this pull request into a Git repository by running: $ git pull https://github.com/steveloughran/spark cloud/SPARK-23654-jets3t Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/21146.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #21146 ---- commit f4b00c2d464f6c29f6ed97974ad256b5cb8b3fcc Author: Steve Loughran <stevel@...> Date: 2018-03-28T09:34:11Z SPARK-23654 remove jets3t as a dependency of spark This also updates the dev/deps dependency files so it is not expected Change-Id: I15798710925d378de97523f7f89dbe5bd1cc8582 commit db77f2812dca195f9e940625421d5625e8497b93 Author: Steve Loughran <stevel@...> Date: 2018-07-04T15:26:11Z [SPARK-23654]. Explicitly add javax.activation-1.1.1 to the spark-core dependencies so the version it transitively exports is the same as the one it used to when jets3t was on the import graph. Remove the other JARs from the deps list. Change-Id: If22bb1b26381e2e8a3df050a535d644f45d306fe commit eba7c820bb0fd14a382afbd76911a16fd8ab0d68 Author: Steve Loughran <stevel@...> Date: 2018-07-14T15:18:58Z [SPARK-23654] inline javax.activation version Change-Id: I1298d6c3063ece8bc86575d781a85ba5309cda39 commit 9adc0ec943a0bc867e2017b0ecc1f028da4ea2f6 Author: Steve Loughran <stevel@...> Date: 2018-08-13T18:10:57Z [SPARK-23654] purge all of bouncy-castle from the POM and from all license files Change-Id: Iaf2e87ca57d46592551cfdbe6d5f8b419a92bcae commit 853ee1cf1143073acec9f3d0cdade7d445ecc4c7 Author: Steve Loughran <stevel@...> Date: 2018-08-14T05:38:02Z [SPARK-25111] increment kinesis client/producer lib versions & aws-sdk to match Change-Id: Ibf4162fca33189086bef234b6752f403a06aa7b0 ---- --- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org