Hi all, Can anyone tell me how to set the native library path in Spark.
Right not I am setting it using "SPARK_LIBRARY_PATH" environmental variable in spark-env.sh. But still no success. I am still seeing this in spark-shell. NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Thanks, Pradeep