I posted this after spending 2 days tracking the problem down, and of
course found the issue right after posting it...
We are using the sbt-assembly plugin to create a fat jar file for Spark
deployment. The assemblyMergeStrategy was discarding the META-INF directory
from the netty-tcnative-boringssl-static-2.0.5.Final.jar file, which
happens to contain the native ssl libraries. The solution was to update the
merge strategy in build.sbt as follows. Hope this helps someone else.
val uberJarMerge = new sbtassembly.MergeStrategy {
override def name: String = "uberJarMerge"
override def apply(tempDir: File, path: String, files: Seq[File]):
Either[String, Seq[(File, String)]] = {
Right(
for {
// collects not jar-origin files plus jar-origin "native" directory
f <- files if (!AssemblyUtils.sourceOfFileForMerge(tempDir, f)._4) ||
(f.getPath contains "/native/")
} yield {
f -> path
}
)
}
}
assemblyMergeStrategy in assembly := {
case PathList("META-INF", xs @ _*) => uberJarMerge
case x => MergeStrategy.first
}
--
------------------------------
SevOne, Inc. reserves the right to monitor the transmission of this message
and to take corrective action against any misuse or abuse of its e-mail
system or other components of its network.
The information contained in this e-mail may be confidential and/or legally
privileged. It is intended solely for the addressee. If the reader of this
message is not an intended recipient, you are hereby notified that any
unauthorized review, use, disclosure, dissemination, distribution, or
copying of this communication, or any of its contents, is strictly
prohibited and may be unlawful. If you have received this communication in
error, please reply to the sender and destroy all copies of the message.
To contact us directly, send to [email protected].
--
You received this message because you are subscribed to the Google Groups
"Netty discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/netty/e84d8d38-f1d4-4a85-864a-be95c873f1f4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
