Hi,
I am trying to invoke C library from the Spark Stack using JNI interface
(here is sample application code)
class SimpleApp {
// ---Native methods
@native def foo (Top: String): String
}
object SimpleApp {
def main(args: Array[String]) {
val conf = new
SparkConf().setAppName("SimpleApplication").set("SPARK_LIBRARY_PATH", "lib")
val sc = new SparkContext(conf)
System.loadLibrary("foolib")
//instantiate the class
val SimpleAppInstance = new SimpleApp
//String passing - Working
val ret = SimpleAppInstance.foo("fooString")
}
Above code work fines.
I have setup LD_LIBRARY_PATH and spark.executor.extraClassPath,
spark.executor.extraLibraryPath
at worker node
How can i invoke JNI library from worker node ? Where should i load it in
executor ?
Calling System.loadLibrary("foolib") inside the work node gives me
following error :
Exception in thread "main" java.lang.UnsatisfiedLinkError:
Any help would be really appreciated.