Hi I have experience about spark-mongodb works. but it looks like, spark worker is trying to access http:// <mysystemurl>/jars/Query-1.0.jar and mysystemurl is returning 504.
Could you explain little bit more about what is Query-1.0.jar and how it is added in your code? Thanks, moon On Mon, May 11, 2015 at 3:40 PM Roopa Prabhu <[email protected]> wrote: > Here's my code (loaded the required jar using %dep): > > import sys.process._ > import test.{testData1,QueryData} > import com.stratio.deep.mongodb._ > > QueryData.statusCheck() //*goes through fine* > val readConfig = QueryData.runMongoJob() //*goes through fine* > val rdd = sqlContext.fromMongoDB(readConfig) //*fails* > rdd.registerTempTable("metadata"). > > "val rdd = sqlContext.fromMongoDB(readConfig)" > OR > QueryData.OtherMethod(sc, sqlContext): > Any of the above two attempts with sc/sqlContext throws the following > exception: > > org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 > in stage 9.0 failed 1 times, most recent failure: Lost task 0.0 in stage > 9.0 (TID 4, localhost): java.io.IOException: Server returned HTTP response > code: 504 for URL: http://<mysystemurl>/jars/Query-1.0.jar > > >
