RE: Submitting Python Applications from Remote to Master

2014-11-15 Thread Ashic Mahtab
job server https://github.com/ooyala/spark-jobserver provides a restful interface to submit jobs. Does that help? Regards,Ashic. Date: Fri, 14 Nov 2014 13:40:43 -0600 Subject: Submitting Python Applications from Remote to Master From: quasi...@gmail.com To: user@spark.apache.org Hi All, I'm

Re: Submitting Python Applications from Remote to Master

2014-11-15 Thread Ognen Duzlevski
: Submitting Python Applications from Remote to Master From: quasi...@gmail.com To: user@spark.apache.org Hi All, I'm not quite clear on whether submitting a python application to spark standalone on ec2 is possible. Am I reading this correctly: *A common deployment strategy is to submit your

RE: Submitting Python Applications from Remote to Master

2014-11-15 Thread Ashic Mahtab
; user@spark.apache.org Subject: Re: Submitting Python Applications from Remote to Master Ashic, Thanks for your email. Two things: 1. I think a whole lot of data scientists and other people would love it if they could just fire off jobs from their laptops. It is, in my opinion

Submitting Python Applications from Remote to Master

2014-11-14 Thread Benjamin Zaitlen
Hi All, I'm not quite clear on whether submitting a python application to spark standalone on ec2 is possible. Am I reading this correctly: *A common deployment strategy is to submit your application from a gateway machine that is physically co-located with your worker machines (e.g. Master