Re: Implementing cart and wishlist item events into Ecommerce recommendation template

2017-11-02 Thread Vaghawan Ojha 
Hey there,

did you consider seeing this:
https://predictionio.incubator.apache.org/templates/ecommercerecommendation/train-with-rate-event/

for considering such events you may want to use the $set events as shown in
the template documentation. I use universal recommender though since
already supports these requirements.


Hope this helps.

On Fri, Nov 3, 2017 at 10:37 AM, ilker burak  wrote:

> Hello,
> I am using Ecommerce recommendation template. Currently i imported view
> and buy events and it works. To improve results accuracy, how can i modify
> code to import and use events like 'user added item to cart' and 'user
> added item to wishlist'? I know this template supports to add new events
> but there is only example in site about how to implement rate event, whic i
> am not using rate data.
> Thank you
>
> Ilker
>

Re: Not able to train data

2017-10-26 Thread Vaghawan Ojha 
Hi Abhimanyu,

In that case, you should probably wait for someone else to help, I'd done
the same thing with one of the old recommendation template, but that was
with 0.10.0 .

Thanks
Vaghawan


On Thu, Oct 26, 2017 at 12:56 PM, Abhimanyu Nagrath <
abhimanyunagr...@gmail.com> wrote:

> Hi Vaghawan,
>
> I have made that template compatible with the version mentioned
> above. Changed versions of engine.json and changed packages name.
>
>
> Regards,
> Abhimanyu
>
> On Thu, Oct 26, 2017 at 12:39 PM, Vaghawan Ojha <vaghawan...@gmail.com>
> wrote:
>
>> Hi Abhimanyu,
>>
>> I don't think this template works with version 0.11.0. As per the
>> template :
>>
>> update for PredictionIO 0.9.2, including:
>>
>> I don't think it supports the latest pio. You rather switch it to 0.9.2
>> if you want to experiment it.
>>
>> On Thu, Oct 26, 2017 at 12:52 PM, Abhimanyu Nagrath <
>> abhimanyunagr...@gmail.com> wrote:
>>
>>> Hi Vaghawan ,
>>>
>>> I am using v0.11.0-incubating with (ES - v5.2.1 , Hbase - 1.2.6 , Spark
>>> - 2.1.0).
>>>
>>> Regards,
>>> Abhimanyu
>>>
>>> On Thu, Oct 26, 2017 at 12:31 PM, Vaghawan Ojha <vaghawan...@gmail.com>
>>> wrote:
>>>
>>>> Hi Abhimanyu,
>>>>
>>>> Ok, which version of pio is this? Because the template looks old to me.
>>>>
>>>> On Thu, Oct 26, 2017 at 12:44 PM, Abhimanyu Nagrath <
>>>> abhimanyunagr...@gmail.com> wrote:
>>>>
>>>>> Hi Vaghawan,
>>>>>
>>>>> yes, the spark master connection string is correct I am getting
>>>>> executor fails to connect to spark master after 4-5 hrs.
>>>>>
>>>>>
>>>>> Regards,
>>>>> Abhimanyu
>>>>>
>>>>> On Thu, Oct 26, 2017 at 12:17 PM, Sachin Kamkar <
>>>>> sachinkam...@gmail.com> wrote:
>>>>>
>>>>>> It should be correct, as the user got the exception after 3-4 hours
>>>>>> of starting. So looks like something else broke. OOM?
>>>>>>
>>>>>> With Regards,
>>>>>>
>>>>>>  Sachin
>>>>>> ⚜KTBFFH⚜
>>>>>>
>>>>>> On Thu, Oct 26, 2017 at 12:15 PM, Vaghawan Ojha <
>>>>>> vaghawan...@gmail.com> wrote:
>>>>>>
>>>>>>> "Executor failed to connect with master ", are you sure the --master
>>>>>>> spark://*.*.*.*:7077 is correct?
>>>>>>>
>>>>>>> Like the one you copied from the spark master's web ui? sometimes
>>>>>>> having that wrong fails to connect with the spark master.
>>>>>>>
>>>>>>> Thanks
>>>>>>>
>>>>>>> On Thu, Oct 26, 2017 at 12:02 PM, Abhimanyu Nagrath <
>>>>>>> abhimanyunagr...@gmail.com> wrote:
>>>>>>>
>>>>>>>> I am new to predictionIO . I am using template
>>>>>>>> https://github.com/EmergentOrder/template-scala-probabilisti
>>>>>>>> c-classifier-batch-lbfgs.
>>>>>>>>
>>>>>>>> My training dataset count is 1184603 having approx 6500 features. I
>>>>>>>> am using ec2 r4.8xlarge system (240 GB RAM, 32 Cores, 200 GB Swap).
>>>>>>>>
>>>>>>>>
>>>>>>>> I tried two ways for training
>>>>>>>>
>>>>>>>>  1. Command '
>>>>>>>>
>>>>>>>> > pio train -- --driver-memory 120G --executor-memory 100G -- conf
>>>>>>>> > spark.network.timeout=1000
>>>>>>>>
>>>>>>>> '
>>>>>>>>   Its throwing exception after 3-4 hours.
>>>>>>>>
>>>>>>>>
>>>>>>>> Exception in thread "main" org.apache.spark.SparkException:
>>>>>>>> Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, 
>>>>>>>> most
>>>>>>>> recent failure: Lost task 0.0 in stage 1.0 (TID 15, localhost, executor
>>>>>>>> driver): ExecutorLostFailure (executor driver exited caused by one of 
>>>>>>>> the
>&g

Re: Not able to train data

2017-10-26 Thread Vaghawan Ojha 
Hi Abhimanyu,

I've never tried the classification template, So I'm not sure about how
much time would it exactly take. But as per your error, your model is not
going any far from stage 1. "Task 0 in stage 1.0 failed 1 times, " .

Probably something to do with the OOMs.
https://stackoverflow.com/questions/37260230/spark-cluster-full-of-heartbeat-timeouts-executors-exiting-on-their-own


did you see this?

On Thu, Oct 26, 2017 at 1:57 PM, Abhimanyu Nagrath <
abhimanyunagr...@gmail.com> wrote:

> Hi Vaghawan,
>
> For debugging I just made a change I just reduced the number if features
> to 1  record count being the same as 1 Million and hardware is (240 GB RAM
> , 32 cores and 100 GB SWAP) and training is still going on since 2 hrs.Is
> it an expected behavior. On which factors does the training time depend.
>
>
> Regards,
> Abhimanyu
>
>
> On Thu, Oct 26, 2017 at 12:41 PM, Abhimanyu Nagrath <
> abhimanyunagr...@gmail.com> wrote:
>
>> Hi Vaghawan,
>>
>> I have made that template compatible with the version mentioned
>> above. Changed versions of engine.json and changed packages name.
>>
>>
>> Regards,
>> Abhimanyu
>>
>> On Thu, Oct 26, 2017 at 12:39 PM, Vaghawan Ojha <vaghawan...@gmail.com>
>> wrote:
>>
>>> Hi Abhimanyu,
>>>
>>> I don't think this template works with version 0.11.0. As per the
>>> template :
>>>
>>> update for PredictionIO 0.9.2, including:
>>>
>>> I don't think it supports the latest pio. You rather switch it to 0.9.2
>>> if you want to experiment it.
>>>
>>> On Thu, Oct 26, 2017 at 12:52 PM, Abhimanyu Nagrath <
>>> abhimanyunagr...@gmail.com> wrote:
>>>
>>>> Hi Vaghawan ,
>>>>
>>>> I am using v0.11.0-incubating with (ES - v5.2.1 , Hbase - 1.2.6 , Spark
>>>> - 2.1.0).
>>>>
>>>> Regards,
>>>> Abhimanyu
>>>>
>>>> On Thu, Oct 26, 2017 at 12:31 PM, Vaghawan Ojha <vaghawan...@gmail.com>
>>>> wrote:
>>>>
>>>>> Hi Abhimanyu,
>>>>>
>>>>> Ok, which version of pio is this? Because the template looks old to
>>>>> me.
>>>>>
>>>>> On Thu, Oct 26, 2017 at 12:44 PM, Abhimanyu Nagrath <
>>>>> abhimanyunagr...@gmail.com> wrote:
>>>>>
>>>>>> Hi Vaghawan,
>>>>>>
>>>>>> yes, the spark master connection string is correct I am getting
>>>>>> executor fails to connect to spark master after 4-5 hrs.
>>>>>>
>>>>>>
>>>>>> Regards,
>>>>>> Abhimanyu
>>>>>>
>>>>>> On Thu, Oct 26, 2017 at 12:17 PM, Sachin Kamkar <
>>>>>> sachinkam...@gmail.com> wrote:
>>>>>>
>>>>>>> It should be correct, as the user got the exception after 3-4 hours
>>>>>>> of starting. So looks like something else broke. OOM?
>>>>>>>
>>>>>>> With Regards,
>>>>>>>
>>>>>>>  Sachin
>>>>>>> ⚜KTBFFH⚜
>>>>>>>
>>>>>>> On Thu, Oct 26, 2017 at 12:15 PM, Vaghawan Ojha <
>>>>>>> vaghawan...@gmail.com> wrote:
>>>>>>>
>>>>>>>> "Executor failed to connect with master ", are you sure the --master
>>>>>>>> spark://*.*.*.*:7077 is correct?
>>>>>>>>
>>>>>>>> Like the one you copied from the spark master's web ui? sometimes
>>>>>>>> having that wrong fails to connect with the spark master.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>>
>>>>>>>> On Thu, Oct 26, 2017 at 12:02 PM, Abhimanyu Nagrath <
>>>>>>>> abhimanyunagr...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> I am new to predictionIO . I am using template
>>>>>>>>> https://github.com/EmergentOrder/template-scala-probabilisti
>>>>>>>>> c-classifier-batch-lbfgs.
>>>>>>>>>
>>>>>>>>> My training dataset count is 1184603 having approx 6500 features.
>>>>>>>>> I am using ec2 r4.8xlarge system (240 GB RAM, 32 Cores, 200 GB Swap).
>>>>>>>>>
>>>>>>>>>
>>>>>>

Re: PIO User Guide,

2018-02-04 Thread Vaghawan Ojha 
Hi,

If you have successfully installed the PIO, then next move for you is to
install the templates or your wish. If you wish to install Universal
recommendation you should go here: http://actionml.com/docs/ur_quickstart
But UR doesn't work with postgresql as event storage as far as I've used
it.

https://predictionio.incubator.apache.org/templates/recommendation/quickstart/
(This one is for recommendation) I would suggest you to first check the
engine templates page and choose, you will find the guide for each
template. Here's the link to template gallery:
https://predictionio.incubator.apache.org/gallery/template-gallery/

I hope this helps. Even though this (
https://medium.freecodecamp.org/building-an-recommendation-engine-with-apache-prediction-io-ml-server-aed0319e0d8)
guide uses the PIO 0.10, you may check if its useful.

Thanks
Vaghawan

On Sun, Feb 4, 2018 at 6:28 PM, Mehmet Erkek  wrote:

> Hello all,
>
> I have downloaded and successfully installed predictionio with postgresql
> as event storage. I am able to post events to the server and create batch
> events.. so far so good. from here on, I need some documentation to see how
> to deploy an algorithm/train and serve recommendations... I have gone thru
> documentation as well, but I am a bit lost... I appreciate if you could
> point me to any link where I can find more info. thanks.
>
> P.S: The project looks promising and well thought... Special thanks to the
> creators/contributors!
> After getting in it, I and my team would like to contribute to it
> (documentation/model/code etc)...
>