Hi all,
I'm trying to call a python script from a scala application. Below is
part of my code.
My problem is that it doesn't work, but it also doesn't provide any
error message, so I can't debug it.
val spark =new
SparkLauncher().setSparkHome("/home/user/spark-1.4.1-bin-hadoop2.6")
.setAppResource("/home/user/MyCode/forSpark/wordcount.py").addPyFile("/home/andabe/MyCode/forSpark/wordcount.py")
.setMaster("myServerName")
.setAppName("pytho2word")
.launch();
println("finishing")
spark.waitFor();
println("finished")
Any help is appreciated.
Cheers,
Andrejs
