Let me be more explicit. What I want to do is not using the host where PredictionServer will run as a slave in the Spark cluser.
When I do this I got "Initial job has not accepted any resources" error message. 2017-03-29 22:18 GMT+04:00 Pat Ferrel <[email protected]>: > yes > > My answer below was needlessly verbose. > > > On Mar 28, 2017, at 8:41 AM, Marius Rabenarivo <[email protected]> > wrote: > > But I want to run the driver outside the server where I'll run the > PredictionServer. > > As Spark will be used only for launching there. > > Is it possible to run the driver outside the host where I'll deploy the > engine? I mean for deploying > > I'm reading documentation about Spark right now for having insight on how > I can do it but I want to know if someone has tried to do something similar. > > 2017-03-28 19:34 GMT+04:00 Pat Ferrel <[email protected]>: > >> Spark must be installed locally (so spark-submit will work) but Spark is >> only used to launch the PredictionServer. No job is run on Spark for the UR >> during query serving. >> >> We typically train on a Spark driver machine that is like part of the >> Spark cluster and deploy on a server separate from the Spark cluster. This >> is so that the cluster can be stopped when not training and no AWS charges >> are incurred. >> >> So yes you can and often there are good reasons to do so. >> >> See the Spark overview here: http://actionml.com/docs/intro_to_spark >> >> >> On Mar 27, 2017, at 11:48 PM, Marius Rabenarivo < >> [email protected]> wrote: >> >> Hello, >> >> For the pio train command, I understand that I can use another machine >> with PIO, Spark Driver, Master and Worker. >> >> But, is it possible to deploy in a machine without Spark locally >> installed as it is use spark-submit during deployment >> and >> >> org.apache.predictionio.workflow.CreateServer >> >> references sparkContext. >> >> I'm using UR v0.4.2 and PredictionIO 0.10.0 >> >> Regards, >> >> Marius >> >> P.S. I also posted in the ActionML Google group forum : >> https://groups.google.com/forum/#!topic/actionml-user/9yNQgVIODvI >> >> > >
