GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/22557
[SPARK-25535][core] Work around bad error handling in commons-crypto.
The commons-crypto library does some questionable error handling internally,
which can lead to JVM crashes if some call into native code fails and cleans
up state it should not.
While the library is not fixed, this change adds some workarounds in Spark
code
so that when an error is detected in the commons-crypto side, Spark avoids
calling into the library further.
Tested with existing and added unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-25535
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22557.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22557
----
commit fe3f06bbc5db00acf893fd6c4f70f93ba1648d11
Author: Marcelo Vanzin <vanzin@...>
Date: 2018-09-26T00:22:11Z
[SPARK-25535][core] Work around bad error handling in commons-crypto.
The commons-crypto library does some questionable error handling internally,
which can lead to JVM crashes if some call into native code fails and cleans
up state it should not.
While the library is not fixed, this change adds some workarounds in Spark
code
so that when an error is detected in the commons-crypto side, Spark avoids
calling into the library further.
Tested with existing and added unit tests.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
