Re: Model performance history with PredictionIO

2016-09-25 Thread Vijay Bhat
Hi Donald, Great to hear we are on the same page about this functionality. I'm glad to contribute to the project. I'll follow the contribution guidelines in http://predictionio.incubator.apache.org/community/contribute-code/ and report back when I've made some progress. Best, Vijay On Tue, Sep

Re: Model performance history with PredictionIO

2016-09-20 Thread Donald Szeto
Hi Vijay, This is definitely an interesting idea and would be very useful for production and debugging. In fact, if you look at the EngineInstances / EvaluationInstances classes, some foundation is already in place and it just desperately need a UI to expose it. Would it be something that you be

Model performance history with PredictionIO

2016-09-19 Thread Vijay Bhat
Hi all, I've been playing with PredictionIO recently and am impressed with its capabilities / ease of use. I like how the model serving engine provides clear visibility into the currently deployed ML model and its performance (latency, throughput). What I'm also interested in for some of the