NoClassDefFoundError

2016-12-21 Thread Reza zade
Hello I've extended the JavaSparkJob (job-server-0.6.2) and created an object of SQLContext class. my maven project doesn't have any problem during compile and packaging phase. but when I send .jar of project to sjs and run it "NoClassDefFoundError" will be issued. the trace of exception is :

problem deploying spark-jobserver on CentOS

2016-11-16 Thread Reza zade
Hi I'm going to deploy jobserver on my CentOS (spark is installed with cdh5.7). I'm using oracle jdk1.8, sbt-0.13.13, spark-1.6.0 and jobserver-0.6.2. When I run sbt command (after running sbt publish-local) I encountered the bellow message : [cloudera@quickstart spark-jobserver]$ sbt [info]

installing spark-jobserver on cdh 5.7 and yarn

2016-11-09 Thread Reza zade
Hi I have set up a cloudera cluster and work with spark. I want to install spark-jobserver on it. What should I do?

Fwd: A Spark long running program as web server

2016-11-06 Thread Reza zade
Hi I have written multiple spark driver programs that load some data from HDFS to data frames and accomplish spark sql queries on it and persist the results in HDFS again. Now I need to provide a long running java program in order to receive requests and their some parameters(such as the number