That feature requires a template to support the eval template APIs and many template do not including the UR. We do cross-validation tests with an integration test that is supplied with the recommender.
I'd like to see the eval stuff removed from PIO. Cross-validation is too different for different algorithms and so is more naturally supported outside of PIO. "Batch predict" seems like a nice feature though and fits with the outside of PIO cross-validation methods. In this case it is a new method to the Algorithm, maybe Algo.batchPredict that trivially calls Predict to batch up results before returning. On Jul 27, 2017, at 10:38 AM, Mars Hall <[email protected]> wrote: Hi Mattz, Yes, that batch evaluator using `pio eval` is currently the only documented way to run batch predictions. It's also possible to create a custom script that calls the Queries HTTP/REST API to collect predictions in bulk. My team has had this need reoccur. So, I implemented a `pio batchpredict` command for PredictionIO, but it's not yet been merged & released. See the pull request: https://github.com/apache/incubator-predictionio/pull/412 *Mars ( <> .. <> ) > On Jul 27, 2017, at 05:25, Mattz <[email protected]> wrote: > > Hello, > > I am using the "Universal Recommender" template. Is the below guide current > if I want to create bulk recommendations in batch? > > https://predictionio.incubator.apache.org/templates/recommendation/batch-evaluator/ > > Thanks!
