PJ Fanning created SPARK-11640:
----------------------------------
Summary: shading packages in spark-assembly jar
Key: SPARK-11640
URL: https://issues.apache.org/jira/browse/SPARK-11640
Project: Spark
Issue Type: Bug
Components: Build
Reporter: PJ Fanning
The spark assembly jar contains classes from many external dependencies like
hadoop and bouncycastle.
I have run into issues trying to use bouncycastle code in a Spark job because
the JCE codebase expects the encryption code to be in a signed jar and since
the classes are copied into spark-assembly jar and it is not signed, the JCE
framework returns an error.
If the bouncycastle classes in spark-assembly were shaded, then I could deploy
the properly signed bcprov jar. The spark code could access the shaded copies
of the bouncycastle classes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
