I am trying to use Spark/MLLib on Yarn and do not have libgfortran installed on my cluster. Is there any way I can set LD_LIBRARY_PATH so Spark/MLLib/jblas pick up the library from a non-standard location (like say the distributed cache or /tmp instead of /usr/lib).
Thanks, ~Shubham.