Matthew, Pat Thanks for the answers and concerns. Yes, we want to calculate every 30 minutes trending for the last X hours, there X might be even few days. So realtime analogy is correct.
On Wed, Jun 20, 2018 at 6:50 PM, Pat Ferrel <[email protected]> wrote: > No the trending algorithm is meant to look at something like trends over 2 > days. This is because it looks at 2 buckets of conversion frequencies and > if you cut them smaller than a day you will have so much bias due to daily > variations that the trends will be invalid. In other words the ups and > downs over a day period need to be made irrelevant and taking day long > buckets is the simplest way to do this. Likewise for “hot” which needs 3 > buckets and so takes 3 days worth of data. > > Maybe what you need is to just count conversions for 30 minutes as a > realtime thing. For every item, keep conversions for the last 30 minutes, > sort them periodically by count. This is a Kappa style algorithm doing > online learning, not really supported by PredictionIO. You will have to > experiment with the length of time since a too small period will be very > noisy, popping back and forth between items semi-randomly. > > > From: George Yarish <[email protected]> <[email protected]> > Reply: [email protected] <[email protected]> > <[email protected]> > Date: June 20, 2018 at 8:34:10 AM > To: [email protected] <[email protected]> > <[email protected]> > Subject: UR trending ranking as separate process > > Hi! > > Not sure this is correct place to ask, since my question correspond to UR > specifically, not to pio itself I guess. > > Anyway, we are using UR template for predictionio and we are about to use > trending ranking for sorting UR output. If I understand it correctly > ranking is created during training and stored in ES. Our training takes ~ 3 > hours and we launch it daily by scheduler but for trending rankings we want > to get actual information every 30 minutes. > > That means we want to separate training (scores calculation) and ranking > calculation and launch them by different schedule. > > Is there any easy way to achieve it? Does UR supports something like this? > > Thanks, > George > > -- George Yarish, Java Developer Grid Dynamics 197101, Rentgena Str., 5A, St.Petersburg, Russia Cell: +7 950 030-1941 Read Grid Dynamics' Tech Blog <http://blog.griddynamics.com/?utm_campaign=Big%20Data%20Blog%20social%20media%20promotion&utm_medium=CTA&utm_source=Email>
