Daniel Imfeld created SPARK-10566:
-------------------------------------
Summary: SnappyCompressionCodec init exception handling masks
important error information
Key: SPARK-10566
URL: https://issues.apache.org/jira/browse/SPARK-10566
Project: Spark
Issue Type: Bug
Components: Input/Output
Affects Versions: 1.5.0
Reporter: Daniel Imfeld
Priority: Minor
The change to always throw an IllegalArgumentException when failing to load in
SnappyCompressionCodec (CompressionCodec.scala:151) throws away the description
from the exception thrown, which makes it really difficult to actually figure
out what the problem is:
: java.lang.IllegalArgumentException
at
org.apache.spark.io.SnappyCompressionCodec.<init>(CompressionCodec.scala:151)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
Removing this try...catch I get the following error, which actually gives some
information about how to fix the problem:
: java.lang.UnsatisfiedLinkError: no snappyjava in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1864)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at
org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:178)
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
A change to initialize the IllegalArgumentException with the value of
e.getMessage() would be great, as the current error without any description
just leads to a lot of frustrating guesswork.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
