Re: How to debug: Runs locally but not on cluster

tFile("s3n://geonames").sample(false,0.35) // 64MB, 2849439 Lines // fails val samples = sc.textFile("s3n://geonames").sample(false,0.4) // 64MB, 2849439 Lines Any ideas? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-debug-R

How to debug: Runs locally but not on cluster

spark.serializer.KryoSerializer #spark.kryoserializer.buffer.mb 1000 spark.executor.memory 58315m spark.executor.extraLibraryPath /root/ephemeral-hdfs/lib/native/ spark.executor.extraClassPath /root/ephemeral-hdfs/conf -- View this message in context: http://apache-spark-user-list.1001560.n3.nabbl