Re: PredictionIO spark deployment in Production

2018-08-07 Thread Pat Ferrel
Oh and no it does not need a new context for every query, only for the deploy. From: Pat Ferrel Date: August 7, 2018 at 10:00:49 AM To: Ulavapalle Meghamala Cc: user@predictionio.apache.org , actionml-user Subject: Re: PredictionIO spark deployment in Production The answers to your

Re: PredictionIO spark deployment in Production

2018-08-07 Thread Pat Ferrel
: PredictionIO spark deployment in Production Thanks Pat for getting back. Are there any PredictionIO models/templates which really use Spark in "pio deploy" ? (not just loading the Spark Context for loading the 'pio deploy' driver and then dropping the Spark Context), but a running Spark Context t

Re: PredictionIO spark deployment in Production

2018-08-07 Thread Pat Ferrel
AM To: user@predictionio.apache.org Subject: PredictionIO spark deployment in Production Hi, Are there any templates in PredictionIO where "spark" is used even in "pio deploy" ? How are you handling such cases ? Will you create a spark context every time you run a predi