Re: HBase warn on startup

5.mbox/%3ccaep_jwbf1kghmsl272hymtodskts68tp6b3lh2ecsq-nwe9...@mail.gmail.com%3E <http://mail-archives.apache.org/mod_mbox/hbase-user/201505.mbox/%3ccaep_jwbf1kghmsl272hymtodskts68tp6b3lh2ecsq-nwe9...@mail.gmail.com%3E> On Wed, Jul 13, 2016 at 2:42 PM, Pat Ferrel <p...@occamsmachete.com <mailto:p...

HBase warn on startup

I saw a question Tom asked about this error when doing `pio status` Was there every an answer for what causes it? [INFO] [Storage$] Verifying Event Data Backend (Source: HBASE)... [INFO] [Storage$] Test writing to Event Store (App Id 0)... [WARN] [MetaReader] No serialized HRegionInfo in

Re: Incubator Graduation Status

May I ask why you are interested? Graduation only means the project is active and operating under Apache best practices, it does not affect releases or quality. In fact there may be less eyes on releases once we have graduated. On Jan 26, 2017, at 9:24 AM, Venkatesh Kumar

Re: How to transform variables?

and inside of PIO as much as possible. On Fri, Jan 20, 2017 at 12:45 PM Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: It would help to know what you are trying to implement. The datasource and preparator are used only during the input part of train, they

Re: Problem with Universal Recommender

t.github.com/conker84/12e58c5af470677d56f9a8bfa99608e8> Thanks Andrea Il giorno gio 16 feb 2017 alle ore 00:19 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> ha scritto: The properties are input incorrectly, they should all be arrays of strings, even if there is only

Re: Installing PIO

Can you share pio-env.sh? On Feb 23, 2017, at 9:00 PM, Vin Ad wrote: Hi, I am trying to install PIO 0.10.0 on my Ubuntu 16.04 from source code. I was unsuccessful at pio-start-all, which resulted in an error : Please set PIO_STORAGE_SOURCES_ELASTICSEARCH_HOME in

Re: Problem with Universal Recommender

The model looks ok. It looks like you have “purchase” as the conversion event and “categories” properties for items. Since the popularity is being calculated you can only get a blank result if you have supplied a filter in the query (that disallows everything) or there is some other config

Re: Download Link Broken

We are only releasing source artifacts, you will need to build PIO yourself. There is a supplied script make-distribution.sh that works nicely. On Feb 8, 2017, at 11:06 PM, Andrea Santurbano wrote: Thanks Chan but i'm looking for the compiled bundle. I have taken the link

Re: Problem with Universal Recommender

i made a simple empty query like "{}"... :( Il giorno dom 12 feb 2017 alle ore 21:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> ha scritto: The model looks ok. It looks like you have “purchase” as the conversion event and “categories” properties for i

Re: Multiple apps problem

sein Bahrami <mailto:h.bahr...@live.com> Sent: Monday, January 16, 2017 9:18 AM To: Pat Ferrel <mailto:p...@occamsmachete.com>; user@predictionio.incubator.apache.org <mailto:user@predictionio.incubator.apache.org> Subject: RE: Multiple apps problem Hi Pat, Thanks for your help, problem fi

Re: ElasticSearch Nodes not Found - Universal Recommender Template

The UR uses the REST API for most operations. The servers should be listed in the engine.json for this in the sparkConf section. Like this: "sparkConf": { "spark.serializer": "org.apache.spark.serializer.KryoSerializer", "spark.kryo.registrator":

Re: Multiple apps problem

tioned, it didn’t helped, still have problem. From: Pat Ferrel <mailto:p...@occamsmachete.com> Sent: Wednesday, January 18, 2017 5:52 PM To: user@predictionio.incubator.apache.org <mailto:user@predictionio.incubator.apache.org> Subject: Re: Multiple apps problem Yes this will ha

Re: Mahout Samsara & DASE

The Universal Recommender uses Mahout Samsara so yes, of course. See the UR template for how to do this “wrapping”. The core algorithm for Correlated Cross-Occurrence comes from this bit: http://mahout.apache.org/users/algorithms/recommender-overview.html

Re: How to transform variables?

It would help to know what you are trying to implement. The datasource and preparator are used only during the input part of train, they pass data to the train method of your algorithm when you run `pio train`. The predict method does not use them at all. It may get data from the EventStore,

Re: Help requested: Multiple events and algorithms on one engine

May I ask why you are packaging these as multiple algorithms in a template rather than multiple templates with one algo each? On Feb 28, 2017, at 3:29 PM, Kanak Singh wrote: Hi all, This is my first email so pardon me for any mistakes in email etiquette. I am trying

Re: New items in UR

We have an in-house Template to implement “Behavioral Search” with the algo inside the UR called Correlated Cross-Occurrence. It allows you to augment your Search index, which usually contains mainly content from items. These augmentation fields have information about what item other people

Re: Setup PredictionIO for large events

lps. Tom On Sep 5, 2016 9:05 PM, "Digambar Bhat" <digambarbha...@gmail.com <mailto:digambarbha...@gmail.com>> wrote: Update please.. On 30-Aug-2016 8:06 pm, "Digambar Bhat" <digambarbha...@gmail.com <mailto:digambarbha...@gmail.com>> wrot

Re: pio build & train - server available?

Think of PIO as 2 or more servers: 1) EventServer, which may run continuously, taking events from outside and queries during pio build or from the second server 2) PredictionServer, there is one of these per engine. It serves query results. Some templates allow these to run continuously (like

Re: Batch import, Java

The page is now live On Sep 8, 2016, at 11:49 AM, Gustavo Frederico wrote: The page at http://predictionio.incubator.apache.org/datacollection/batchimport/ displays "(coming soon)" for

Re: Multitenancy on the Universal Product Recommender

I’m the maintainer of the Universal Recommender. We have OSS support at https://groups.google.com/forum/#!forum/actionml-user Do you wish to take advantage of the same user being in multiple datasets/tenants? The answer below is assuming

Re: Multitenancy on the Universal Product Recommender

pports multi-tenancy with lightweight Actors one per tenant. On Thu, Sep 8, 2016 at 7:52 PM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: I’m the maintainer of the Universal Recommender. We have OSS support at https://groups.google.com/forum/#!forum/act

NOTICE TO ALL USERS

There have been multiple reports of memory problems, performance problems (that may be memory related), and OOM errors. I have been telling everyone to use: pio train -- --driver-memory 14g --executor-memory 14g --master spark://master-address:7077 To increase the memory for Spark and

Re: Remove engine registration

nly as code being a dependency for > application related models/algorithms. So you would register an engine - as > a code once and run training for some domain specific data (app) and > algorithm parameters, what would result in a different identifier, that > would be later used f

Re: Batch import, Java

f849d3 <https://github.com/PredictionIO/PredictionIO-Java-SDK/commit/6691144ebf1382aa1d060770a4fb7c0268f849d3> On Fri, Sep 9, 2016 at 7:59 AM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: The page is now live On Sep 8, 2016, at 11:

Re: delay of engines

still in a prototype stage. I am thinking about a fitting deployment option but am still unsure what is the fitting solution to move forward. Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> schrieb am Di., 27. Sep. 2016 um 19:36 Uhr: 2 examples of real-time mo

Re: Launching PredictionIO on aws

There probably won’t be an Apache offering because the AWS Marketplace is a commercial thing but if you private email me I can tell you about offerings my company is working on. These will be available after the PredictionIO release, which is in process right now. On Oct 3, 2016, at 2:36 PM,

Trouble with HBase and PEventStore.aggregateProperties

The use of PEventStore.aggregateProperties as shown below causes errors when a large cluster is making the query. It seems to cause a full DB scan, which results in timeouts. This may be because nearly 400 (parallelism of the cluster) threads are making requests. But should this result in a

Re: Suggest users based on item

The easiest way to do this is substitute the user-id with the item-id and vice versa. Do not change the names used in the input JSON or in the queries. Where the input is documented as (user-id, event-type, item-id) just swap the ids, the input may ask for user: user-id but send item-id

Re: Different environments

The command line for any pio command that is launched on Spark can specify the master so you can train on one cluster and deploy on another. This is typical when using the ALS recommenders, which use a big cluster to train but deploy with `pio deploy -- --master local[2]` which would use a

Re: Compilations errors in Similar-Product engine template

you are not using the right template code. It’s not io.prediction… anymore it’s org.apache.predicitionio… now The templates donated to Apache linked to on the web site are not updated to the build method yet. There are PRs for many of the repos that have versions that will build fine. For

Re: Installing on Linux/Mac through tar

All installations are the same now, download source and build with make-distribution. The tar contains source, not a built artifact. On Oct 19, 2016, at 3:28 AM, Saurav Sarkar wrote: Thanks Paul... @All: Any idea why the option of installation on Linux/MacOS was

Re: Issue while building engine

PIO is a source release, you will have to build it locally. Artifacts have been put into the Maven world but there is no prebuild verison for download only the various classes needed to build templates. Clearly the use of io.prediction means a *template’s* build.sbt is incorrect because

Re: Universal Recommender date boosts

Create categorical date ranges and attach them to items. They will be "0-10 days”, "11-20 days” etc. Something that encodes how far back from today the data is. This will, of course need to be updated periodically with a property change event. Then in your engine.json or query boost "0-10

Re: UniversalRecommender performance bottleneck in SimilarityAnalysis.cooccurrencesIDSs

The current head of the template repo repartitions input based on Spark's default parallelism, which I set on the `pio train` CLI to 4 x #-of-cores. This speeds up the math drastically. There are still some things that look like bottlenecks but taking them out make things slower. The labels you

Re: UniversalRecommender performance bottleneck in SimilarityAnalysis.cooccurrencesIDSs

strange behaviour. It seems coocurrencyIDS do not take into account Spark parellism and ParOpts. Do You have any ideas, how can I control paralelism in coocurrencyIDS, because now it use only 3 cores of 12. Sincerely, Igor Kasianov 2016-11-19 23:04 GMT+02:00 Pat Ferrel <p...@occamsm

Re: PredictionIO and Cassandra

You’d have to implement some PredicitonIO classes like PEventtStore for Cassandra. Use the HBase specific classes as a template. We’ve considered adding C* but haven’t had the time. PM me if you need help. On Nov 2, 2016, at 7:10 PM, Ali, Syed wrote: I am looking to

Re: Tuning of Recommendation Engine

s Gustavo On Thu, Dec 1, 2016 at 2:48 PM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: This is a very odd statement. How many tuning knobs do you have with MLlib’s ALS, 1, 2? There are a large number of tuning knobs for the UR to fit different

Re: reduce logging in prediction io

modify the log4j settings in dist/conf/log4j.properties On Dec 13, 2016, at 2:23 AM, Rasna Tomar wrote: Hi Is there any configuration setting in Prediction IO to reduce logging while pio build, train and deploy. I would like to capture only error logs in pio.log file

Re: Customizing Recommender engine

The UR has a new Apache PIO compatible repo here: https://github.com/actionml/universal-recommender.git git clone https://github.com/actionml/universal-recommender.git ur and proceed. The UR allows boosts or filters by properties. You are using a filter (bias -1), which does not work with

Re: A/B test on recommendation engine

oad-balancer, so I would like to modify the Serving results. I'll try to figure it out, thanks! Best regards, Amy Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> 於 2016年12月17日 週六 上午5:59寫道： Amy asked: "is there any way to modify the http response for query? (S

Re: Multiple apps problem

t one returned zero score items again . This is like closed circle and retraining each of apps causes the other app return empty results or abnormal zero scored results. Regards Hossein From: Pat Ferrel <mailto:p...@occamsmachete.com> Sent: Thursday, January 12, 2017 5:57

Re: https://install.prediction.io/install.sh timeout

http://Prediction.IO redirects to it’s new location at http://predictionio.incubator.apache.org/ so there is no https://install.prediction.io/install.sh Follow install instructions

Apache PredictionIO + Universal Recommender in an AWS AMI

If you want to experiment with something quickly, you can try the new Apache PredictionIO + Universal Recommender AMI. It will run any Apache PIO compatible Template and has the UR pre-installed. You just create and start an instance and all services are started on boot. The only thing you

Re: PredictionIO :: [error] (*:update) sbt.ResolveException: unresolved dependency: io.prediction#pio-build;0.9.0: not found

mailto:yasoth...@vishwak.com> Vishwak Solutions Pvt Ltd ( 044 - 4222 2300 | Extn - 439 From: Pat Ferrel [mailto:p...@occamsmachete.com <mailto:p...@occamsmachete.com>] Sent: 11 January 2017 00:24 To: user@predictionio.incubator.apache.org <mailto:user@predictionio.incubator.apache.o

Re: DNS Down?

That domain will never be restored. The project is now an Apache project and so install.sh will hosted on apache.org. Where did you find this link? It should be fixed. On Dec 2, 2016, at 2:20 AM, Munish Malhotra wrote: Hello, Is

Re: Incremental model training in real time event processing

No, lambda has nothing to do with how much data is used in training. Lambda just say that there is a batch/background process that account for changes in data in non-real-time. It is theoretically possible but not supported yet. However you may be training too often... The Universal

Re: Tuning of Recommendation Engine

according to score in elastic search. I didn't understand why the 2nd and third parameters are taken, also if anyone can explain the correctness of the method, That is why does it work rather how it works? Regards Harsh Mathur On Dec 1, 2016 11:01 PM, "Pat Ferrel" <p.

Re: Tuning of Recommendation Engine

anything you want or modify the source to tune anything your intuition says might work. On Dec 1, 2016, at 11:48 AM, Pat Ferrel <p...@occamsmachete.com> wrote: This is a very odd statement. How many tuning knobs do you have with MLlib’s ALS, 1, 2? There are a large number of tuning

Re: Recommending for new products

PredictionIO is not a recommender. It is a Framework you add templates to. The templates do all the machine learning and can be of many types. That said if you are using the Universal Recommender here: https://github.com/actionml/universal-recommender

Re: PredictionIO :: [error] (*:update) sbt.ResolveException: unresolved dependency: io.prediction#pio-build;0.9.0: not found

ile2 path: vsadmin@predictionio:~/SPIO/apache-predictionio-0.10.0-incubating$ sudo nano build.sbt Regards, Yasho. From: Pat Ferrel [mailto:p...@occamsmachete.com] Sent: 04 January 2017 22:00 To: user@predictionio.incubator.apache.org Cc: Sankar M <san...@vishwak.com>; Sheik Dawood Jainull

Re: PredictionIO :: [error] (*:update) sbt.ResolveException: unresolved dependency: io.prediction#pio-build;0.9.0: not found

the plugin is in project/pio-build.sbt. Remove it and once you can build it should be looking for the version in your build.sbt On Jan 5, 2017, at 10:56 AM, Pat Ferrel <p...@occamsmachete.com> wrote: I may have it. There is an SBT plugin that you are using that should be removed. The

Re: PredictionIO :: [error] (*:update) sbt.ResolveException: unresolved dependency: io.prediction#pio-build;0.9.0: not found

io services and started again, and while doing pio build, getting following error, Is it possible to receive a support call, to demo the code walk through to identify the subject clearly. Regards, Yasho. From: Pat Ferrel [mailto:p...@occamsmachete.com] Sent: 06 January 2017 01:43 To: user@p

Re: PredictionIO :: [error] (*:update) sbt.ResolveException: unresolved dependency: io.prediction#pio-build;0.9.0: not found

Please send the text of the error you are seeing, screen shots are very hard to read. What does `pio version` report? On Jan 3, 2017, at 2:26 AM, Yasothai Rasappan wrote: Hi Rasna, Is it possible to have a call to discuss this issue? Regards, Yasho. From: Yasothai

Re: Misconfigured date information, either your engine.json date settings or your query's dateRange is incorrect.

no, that is talking about using a date range in the query. Answer this first: Do you want a fixed date attached to itmes with the rang in the query or an expired/available attached to items and the corrent date that must fall between them? Pick on or the other. Below you are setting up a

Re: Misconfigured date information, either your engine.json date settings or your query's dateRange is incorrect.

on or the other. Below you are setting up a date attached to items and have called it “releaseDate" in one place but set it using $set events to be “release_date”, different strings. This is probably your error, you didn’t send the error. On Jan 9, 2017, at 8:56 AM, Pat Ferr

Re: PIO Stops working suddenly after few days

I’d guess that #2 may be caused by #1 since PIO is unable to lookup metadata without ES or they are both caused by some resource being used up. What template are you using? If ES is complaining I’d guess it’s the Universal Recommender? Is so, for some reason the connection to ES at query time

Re: Data clean up

There was a bug in this feature in the Apache PIO version that has been fixed in the SNAPSHOT. We will do a source tag to fix it before the next release . The page you reference is being changed now to advise an Apache PIO install as the root source of the project going forward. Keep and eye

Re: beginner to ML

As a beginner you have chosen a multi-layer problem, each of which would be a good beginner problem. I’ve found it useful to think of ML in 3 broad categories, classifiers, recommenders, and regressions. Event NLP is a classifier, taking some words and classifying each. As Gustav mentioned

Re: Decrease score of user viewed item instead of excluding

No. I think this might make sense but my first question is are you using multiple indicators? If you have a lot of users that only get recommendations they already know about, you are not getting a lot of value from the recommender—adding more data might help. If you’ve done the above,

Re: Data clean up

t; Thanks for your time and help, much appreciated! Bruno 2016-12-18 18:58 GMT+01:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: There was a bug in this feature in the Apache PIO version that has been fixed in the SNAPSHOT. We will do a source tag to fix it before

Re: Need a Suggessations

Then I would use PIO and UR to do the hard work, and get back the result either like an API which I think already works in PIO or saved somewhere in database like mysql or something like that. Thanks On Fri, Mar 24, 2017 at 1:03 AM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occam

Re: Can I train and deploy on different machine

Spark must be installed locally (so spark-submit will work) but Spark is only used to launch the PredictionServer. No job is run on Spark for the UR during query serving. We typically train on a Spark driver machine that is like part of the Spark cluster and deploy on a server separate from

Re: Items blacklisted in the query made to Elasticsearch by UR

"blacklistEvents": [[]], should be "blacklistEvents": [], On Mar 30, 2017, at 8:57 AM, Bruno LEBON wrote: Hello, We test the universal recommender on a cluster made following the tutorial from actionML. Once the build/train/deploy is done we send PIO a request to get

Re: Can I train and deploy on different machine

>>: For the host where we run the training, do we have to put the path to ES_CONF_DIR and HADOOP_CONF_DIR in pio-env.sh even if we use remote ES and Haddop clulsters? 2017-03-30 21:58 GMT+04:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: To run locally in th

Re: Need a Suggessations

Actually it is very easy to mix item and user recs, just put both item and user ids in the query. You can also boost item over user or user over item since they both allow special boosts in the query. No need to consult the EventServer. Note here: http://actionml.com/docs/ur_queries

Re: Can I train and deploy on different machine

to run the driver outside the host where I'll deploy the engine? I mean for deploying I'm reading documentation about Spark right now for having insight on how I can do it but I want to know if someone has tried to do something similar. 2017-03-28 19:34 GMT+04:00 Pat Ferrel <p...@occamsmachete.com

Re: pio train error java.lang.NegativeArraySizeException

yes There is very little validation of events done by PredictionIO since they are Template specific and the EventSever is not. Any usage event that does not have "entityType": “user” is ignored so ti the UR you have not data. Also user properties encoded in this way are ignored. User data

Re: Can I train and deploy on different machine

ccepted any resources" error message. 2017-03-29 22:18 GMT+04:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: yes My answer below was needlessly verbose. On Mar 28, 2017, at 8:41 AM, Marius Rabenarivo <mariusrabenar...@gmail.com <mailto:mariusrabenar

Re: UR: connection between entities and properties

Yes, I call this method a “trainer”. However in other apps we have done we pick popular videos from several clusters based on similarity of usage. This reaults in a list of video (music in your case). Then allow the user to pick or like/dislike the music. After this training, which can go on as

Re: microsoft azure

Get an Ubuntu instance and install PredictionIO On Apr 10, 2017, at 8:18 AM, YOUSSEF ASSATA <assatayous...@gmail.com> wrote: ah :/ and so how ? please ? ᐧ 2017-04-10 16:17 GMT+01:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: I believe I said “

Re: [PIO 0.10.0][Universtal Recommender 0.5] Exception when using remote Elasticsearch while training

not an immediate issue but just wanted to make that clear. On Apr 10, 2017, at 8:27 AM, Marius Rabenarivo <mariusrabenar...@gmail.com> wrote: Yes, I set the clustername in Elasticsearch config too. Thank you for your advices about fields. 2017-04-10 19:07 GMT+04:00 Pat Ferrel <p...@occamsma

Re: Existing javascript SDK for predicitonIO (0.10) ?

On Mon, Apr 10, 2017 at 8:13 AM Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: using Javascript from the client is a problem because you will make it possible for some malicious agent to see your access key by examining your client code. Although PIO s

Re: How Can I count events In The Event Server?

As you may know from setting up other databases the storage in indexes for a DB define it’s performance so the EventServer is tuned for use with Templates. There are a few queries (thanks Marius) but they are not extensive. I suggest you keep them in your own DB along side the EventServer if

Re: Error while pio status

magination To Reality Skype:- infoquestsolutions Gtalk:- infoquestindia On Mon, Apr 3, 2017 at 6:52 PM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: If you are still using the UR you don’t need HDFS as a storage backend. In setup instructions, “some-m

Re: Error while pio status

<http://actionml.com/> here http://actionml.com/docs/single_machine <http://actionml.com/docs/single_machine> Its all i have copied from. And it also suggest aml version of prediction which is also incorrect. On Mon, 3 Apr 2017 at 8:41 PM, Pat Ferrel <p...@occamsmachete.com <mailt

Re: Items blacklisted in the query made to Elasticsearch by UR

ot;: { "appName": "piourcluster", "indexName": "urindex", "typeName": "items", "eventNames": ["facet", "view"], "blacklistEvents": [], "maxEventsPerEve

Re: Errors please help

For PredicitonIO related questions ask the PredictionIO user group(CCed). This group is for the Universal Recommender and accompanying startup instructions. We do not support Postgres for the UR. On Apr 12, 2017, at 4:06 AM, gautamrbharad...@gmail.com wrote: Hi, I am trying to install

Re: classification template

We support the Universal Recommender here. See the PredictionIO mailing list for further support (CCed) On Apr 12, 2017, at 7:16 AM, YOUSSEF ASSATA wrote: hello everyone please can you suggest me a classification template or a tuto based on items and their

Re: Terminology in event creation API

Actually each Template has different “event” interpretation. @Vaghawan is giving the interpretation of a recommender. Other Templates will use the event fields in different ways so we should backup to that a Template is and does and what the rest of PIO does. - Template: code that implements

Re: Terminology in event creation API

xample this : https://github.com/detrevid/predictionio-template-classification-dl4j <https://github.com/detrevid/predictionio-template-classification-dl4j> it's on your templates but it not working anymore so ? ᐧ 2017-04-12 17:01 GMT+01:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...

Re: Adding a new application is slow

Hmm, interesting. I have heard of this being a problem in PredictionIO but haven’t heard this explanation before IIRC. On Apr 6, 2017, at 9:47 AM, juha.syrj...@gmail.com wrote: Ah, I just found the problem: a fresh AWS instance takes a long time to generate enough entropy so that a random

Re: [PIO 0.10.0][Universtal Recommender 0.5] Exception when using remote Elasticsearch while training

m monday. 2017-04-07 22:23 GMT+04:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: We use a clustername different from hostname all the time. In fact if you have more than one node you will have to make them different since there are multiple hostnames and one

Re: Use whitelist or blacklist in query

Using properties of items there are new exclusion rules is in the next release of v0.6.0, which will be released shortly after PIO v0.11.0 and Mahout v0.13.0, both are going release now. “Bias" in The Universal Recommender v0.6.0: 0: exclude items with properties specified (must_not in ES

Re: Cart/Complementary purchase recommendation with UR

"fields": [ > { > "name": "store_id", > "values": ["2"] > } > ] > }' http://10.10.10.2:8123/queries.json <http://10.10.10.2:8123/queries.json> It works without bias. But I don't think it's a valid

Re: Dose v.011 support Spark ML, DataFrame and Pipeline

There is no restriction in templates for what they use of Spark. The ones you are looking at simply don’t need those interfaces. If you need them and are writing templates you can use them. In fact I maintain a template that does not use Spark for the Algorithm, only for IO. If you think some

Re: Similar product template

I’m surprised that ALS seemed clear because is is based on a complicated matrix factorization algorithm that transforms the user vectors into a smaller dimensional space that is composed of “important” features. These are not interactions with items like “buys”, they can only be described as

PredictionServer Timeouts

I have a PredictionServer timeout when issuing a query for a non-existent user. We can only use a weeks worth of data so doing the db clean every day to drop events that are too old, without messing with $whatever events. Users are never created with $set. So we are asking for a list of event

Re: Dose v.011 support Spark ML, DataFrame and Pipeline

PIO, which are using RDD instead of DataFrame. Can I also implement a template algorithm with SparkML and DataFrame? Is there any guide online? @Pat Ferrel <mailto:p...@occamsmachete.com> Is the template that you maintaining on the github? If yes, could you provide the link? Many Thanks, F

Re: Similar product template

preference for every user event, and category preference as well. Let's say I trained the model and queried with the preference parameter, in that case is it using multi model for each preference? If you could describe a bit about this, it would be reall On Thu, Apr 13, 2017 at 9:15 PM, Pat Ferr

Re: Use whitelist or blacklist in query

not have A2 in property 2)" as query? It seems that this cannot be done in the version you mentioned, since the query is used as "and" but not "or"? Any advice? Thank you so much! Best regards, Amy Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>&

Re: PredictionIO with remote Spark and Elasticsearch

Yes, PIO uses the TransportClient and this is being deprecated by ES. PIO has a feature branch that adds support for ES5 using only the REST client. Not sure this will help though since I suspect AWS is not on ES5 yet. On Mar 2, 2017, at 1:10 PM, Miller, Clifford

Re: [PIO 0.10.0][Universtal Recommender 0.5] Exception when using remote Elasticsearch while training

BTW the docs for sparkConf are here: http://actionml.com/docs/ur_config#ur-spark-conf <http://actionml.com/docs/ur_config#ur-spark-conf> On Apr 6, 2017, at 4:52 PM, Pat Ferrel <p...@occamsmachete.com> wrote: PIO in the past used the “transport client” of Elasticsearch, which is o

Re: [PIO 0.10.0][Universtal Recommender 0.5] Exception when using remote Elasticsearch while training

effect as the code I mentioned below but I still getting the same exception. 2017-04-07 5:03 GMT+04:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: BTW the docs for sparkConf are here: http://actionml.com/docs/ur_config#ur-spark-conf <http://actionml.com/

Re: Error when importing data

It should be easy to try a smaller batch of data first since we are just guessing On Aug 2, 2017, at 11:22 PM, Carlos Vidal <carlos.vi...@beeva.com> wrote: Hello Mahesh, Pat Thanks for your answers. I will try with a bigger EC2 instance. Carlos. 2017-08-02 18:42 GMT+02:00 Pat Fer

Re: Error when importing data

splitting this apart for production. On Aug 3, 2017, at 8:32 AM, Pat Ferrel <p...@occamsmachete.com> wrote: It should be easy to try a smaller batch of data first since we are just guessing On Aug 2, 2017, at 11:22 PM, Carlos Vidal <carlos.vi...@beeva.com <mailto:carlos.vi...@beeva

Re: Customers clustering

-07-06 23:13 GMT+02:00 Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>>: Actually it sounds like you already have clusters that are made up of categories and you want to know which cluster definition is most similar to what the user has bought? If so you don

Re: UR Query Based on Simulated Events

Personalization cannot work for users with no behavioral data. Your app should be sending events in real time to the EventServer. That way the events below will already be in HBase. Then you just query with the user-id. Item-sets are meant for shopping carts, not events that you know about but

Re: UR Query Based on Simulated Events

would be recommended for various use cases. This way we can avoid polluting the event store with dummy data and have to clean it up later as well. Thanks for the quick response, will look into other means to evaluate potential use cases. On Mon, Jul 17, 2017 at 11:00 AM Pat Ferrel <p...@occamsma

Re: Eventserver API in an Engine?

I/option for people to store mutable objects and always overwrite. or use better storage structure to capture the changes of mutable object. On Fri, Jun 30, 2017 at 5:29 AM, Pat Ferrel <p...@occamsmachete.com <mailto:p...@occamsmachete.com>> wrote: Actually I th

Re: Elastic search with PIO

What Template? On Jul 7, 2017, at 7:38 PM, Saarthak Chandra wrote: Hi, I am trying to use elastic search 5.5.0 with PIO 0.11.0, and am getting the following error - "None of

  1   2   3   >