Using netlib-java lib in fat jar issue

Hi there, I have included the netlib-java lib in my fat jar, but the spark always said: 16/04/24 06:11:16 WARN BLAS: Failed to load implementation from: com.github.fommil.netlib.NativeSystemBLAS 16/04/24 06:11:16 WARN BLAS: Failed to load implementation from:

How to remove empty strings from JavaRDD

Hi All, Can someone give me a example code to get rid of the empty string in JavaRDD? I kwon there is a filter method in JavaRDD: https://spark.apache.org/docs/1.6.0/api/java/org/apache/spark/rdd/RDD.html#filter(scala.Function1) Regards, Greg

Does anyone install netlib-java on AWS EMR Spark?

Hi All, I want to enable the netlib-java feather for Spark ML module base on AWS EMR. But the Spark cluster has install spark default except I install it myself and configure all the cluster. Does anyone have some idea to just enable the netlib-java base on the standard EMR Spark cluster?

Does anyone have experience processing large volume images on Spark cluster

Hi All, Does anyone have experience processing large volume images on Spark cluster? Such as use the Spark to run some MapReduce tasks to distinguish some common features, for example count cars number in a satellite pictures. Regards, Greg