I used to use SPARK_LIBRARY_PATH to specify the location of native libs for lzo compression when using spark 0.9.0.
The references to that environment variable have disappeared from the docs for spark 1.0.1 and it's not clear how to specify the location for lzo. Any guidance?