Oh and no it does not need a new context for every query, only for the
deploy.
From: Pat Ferrel
Date: August 7, 2018 at 10:00:49 AM
To: Ulavapalle Meghamala
Cc: user@predictionio.apache.org
, actionml-user
Subject: Re: PredictionIO spark deployment in Production
The answers to your
The answers to your question illustrate why IMHO it is bad to have Spark
required for predictions.
Any of the MLlib ALS recommenders use Spark to predict and so run Spark
during the time they are deployed.. They can use one machine or use the
entire cluster. This is one case where using the
PIO is designed to use Spark in train and deploy. But the Universal
Recommender removes the need for Spark to make predictions. This IMO is a
key to use Spark well—remove it from serving results. PIO creates a Spark
context to launch the `pio deploy' driver but Spark is never used and the
context
