Re: Modifying the eventserver

2017-01-25 Thread Donald Szeto
ta.api.Run"" but that gives out a classnotfound > error for slf4jlogger, > > Best, > -ZZ > On Tue, Jan 24, 2017 at 2:11 PM Donald Szeto <don...@apache.org> wrote: > > Hi, > > This question is more suitable for the dev list, so I am moving the thread > there. > &

Re: server.conf in SSLConfiguration is null

2017-01-19 Thread Donald Szeto
How are you calling CreateServer? Are you bypassing the command line interface? Regards, Donald On Thu, Jan 19, 2017 at 5:52 AM Venkatesh Kumar Srinivasan < venkat...@studiodiseno.com> wrote: > Hello > > > > I am trying to deploy a model by calling CreateServer class, but when > class loader

Re: server.conf in SSLConfiguration is null

2017-01-19 Thread Donald Szeto
, Jan 19, 2017 at 9:16 AM Venkatesh Kumar Srinivasan < venkat...@studiodiseno.com> wrote: > Yes. I am calling from different script. > > > > Regards > > Venki > > > > > > *From: *Donald Szeto <don...@apache.org> > *Reply-To: *<user@predicti

Re: Prediction.io vagrant

2016-08-30 Thread Donald Szeto
Hi Ibrahim, You could use that script for now. We are working on fixing everything else once we have an official Apache release. Thank you for your patience. Regards, Donald On Tuesday, August 30, 2016, Ibrahim özgön wrote: > Hi everyone, > > I try to install

Re: Can The Classification Engine Handle Multiple Sets of Independent Data

2016-09-07 Thread Donald Szeto
Hi, If you are using the stock classification engine template, your easiest way out would be to use multiple engine servers. If that is not desired, you could modify the engine template to handle different data sets independently. Regards, Donald On Tue, Sep 6, 2016 at 5:49 AM, Dipen Patel

New PMC member and committer: Paul Li

2016-09-15 Thread Donald Szeto
Hi all, The Project Management Committee (PMC) for Apache PredictionIO (incubating) has asked Paul Li to become a PMC member and committer, and we are pleased to announce that he has accepted. Paul Li was a regular committer to the PredictionIO codebase before its donation to the Apache Software

[ANNOUNCE] Apache PredictionIO 0.10.0-incubating Release

2016-10-08 Thread Donald Szeto
The Apache PredictionIO team would like to announce the release of Apache PredictionIO 0.10.0-incubating. Apache PredictionIO (incubating) is an open source Machine Learning Server built on top of state-of-the-art open source stack, that enables developers to manage and deploy production-ready

Re: predictionIO classpath

2016-10-03 Thread Donald Szeto
Hi Cristina, Sorry for the confusion. We are pretty close to our first official release. We will send out a note and update all docs once that happens. Regards, Donald On Mon, Oct 3, 2016 at 9:05 AM, Chan Lee wrote: > Hi Cristina, > > You're right. The classpath change

Re: Launching PredictionIO on aws

2016-10-03 Thread Donald Szeto
Hi Jenna, The AWS image is no longer supported as of now. You may set up a raw AWS EC2 instance and install PredictionIO there. Regards, Donald On Mon, Oct 3, 2016 at 2:36 PM, Jenna Kwon wrote: > Hello everyone, > > I would love to deploy my engine and was wondering what

Re: How to access Spark Context in predict?

2016-09-26 Thread Donald Szeto
Hi Hasan, Does your randomForestModel contain any RDD? If so, implement your algorithm by extending PAlgorithm, have your model extend PersistentModel, and implement PersistentModelLoader to save and load your model. You will be able to perform RDD operations within predict() by using the

Re: PredictionIO with Remote Spark | pio train error

2016-10-23 Thread Donald Szeto
Hi Amal, For yarn-cluster mode, please use the --scratch-ufo argument and point it to a location on HDFS where you have write access to. PIO will copy the necessary files to the HDFS location for your yarn-cluster Spark driver to read. Regards, Donald On Tuesday, October 18, 2016, amal kumar

Re: sbt-plugin

2016-10-23 Thread Donald Szeto
Hi Georg, This plugin will probably be deprecated for 0.10.0 and onward so that the engine build can be easily built be all other IDEs. The old version plugin will still work for now though. Regards, Donald On Thursday, October 20, 2016, Georg Heiler wrote: > Hi, >

Re: Issue while training Recommendation Engine

2016-10-31 Thread Donald Szeto
Hi Amado, You have several options: 1. Train on a real Spark cluster with more executor memory. 2. Increase Spark driver memory if you want to test locally. 3. Reduce number of iterations in engine.json. Regards, Donald On Sun, Oct 30, 2016 at 7:42 AM, Amado Espinosa

Re: Empty result even though there are events

2017-04-04 Thread Donald Szeto
Are you using the appName in engine.json that corresponds to the appId you used when you did `pio import`? Setting a new appName in engine.json will not automatically create a new app. Apps are created when you do `pio app new`. On Tue, Apr 4, 2017 at 8:13 PM Vaghawan Ojha

Re: Prediction.IO error while creating new app

2017-04-11 Thread Donald Szeto
Is the java command on your search path pointing to your Java 8 installation? In any case, you can set your JAVA_HOME environment variable to make sure pio is using the right Java installation. On Tue, Apr 11, 2017 at 12:21 AM Ravi Kiran wrote: > I am starting new app

Re: pio train "wiki"

2017-04-11 Thread Donald Szeto
I haven't looked at the source code of the template but a quick look at the output of the sanity check it said "total observation, 0". Do you have any training data? On Tue, Apr 11, 2017 at 4:14 AM YOUSSEF ASSATA wrote: > please why i'm getting this error >

Re: how to unsubscribe ?

2017-04-10 Thread Donald Szeto
Send an email to user-unsubscr...@predictionio.incubator.apache.org. On Mon, Apr 10, 2017 at 8:13 PM Pengcheng Fang wrote: > how to unsubscribe ? > > > >

Re: Regarding Examples under examples/experimental

2017-07-14 Thread Donald Szeto
+1. If some of them are found useful, they should be moved to examples/ and have documentation about it. On Thu, Jul 13, 2017 at 6:55 PM takako shimamoto wrote: > Hi, > > Examples under examples/experimental have been neglected for a long time. > Probably no one won't make

Re: Eventserver API in an Engine?

2017-06-28 Thread Donald Szeto
Hey Mars, Thanks for the suggestion and I agree with your point on the metadata part. Essentially I think the app and channel concept should be instead logically grouped together with event, not metadata. I think in some advanced use cases, event storage should not even be a hard requirement as

Re: Kafka support as Event Store

2017-07-05 Thread Donald Szeto
Hi Thomas, Supporting Kafka is definitely interesting and desirable. Are you looking to sinking your Kafka messages to event store for batch processing, or stream processing directly from Kafka? The latter would require more work because Apache PIO does not yet support streaming properly. Folks

[ANNOUNCE] Apache PredictionIO 0.11.0-incubating Release

2017-04-25 Thread Donald Szeto
The Apache PredictionIO team would like to announce the release of Apache PredictionIO 0.11.0-incubating. Release notes are here: https://github.com/apache/incubator-predictionio/blob/v0.11.0-incubating/RELEASE.md Apache PredictionIO (incubating) is an open source Machine Learning Server built

New PMC member and committer: Mars Hall

2017-07-28 Thread Donald Szeto
Hi all, The Project Management Committee (PMC) for Apache PredictionIO (incubating) has asked Mars Hall to become a PMC member and committer, and we are pleased to announce that he has accepted. Mars has been working on PredictionIO since 0.10 and has suggested and made changes to the core so

Re: Spark pipeline in predictionIO

2017-05-10 Thread Donald Szeto
We are going to publish a roadmap soon and one of roadmap items is to support Spark ML pipelines natively in parallel of DASE. If you are interested in helping developing the core code to support it, please reach out in the dev mailing list. On Wed, May 10, 2017 at 1:02 PM Ravi Kiran

New PMC member and committer: Shinsuke Sugaya

2017-05-10 Thread Donald Szeto
Hi all, The Project Management Committee (PMC) for Apache PredictionIO (incubating) has asked Shinsuke Sugaya to become a PMC member and committer, and we are pleased to announce that he has accepted. He is also a committer of the Apache Portals project. He has made major contributions to the

New PMC member and committer: Takako Shimamoto

2017-05-17 Thread Donald Szeto
Hi all, The Project Management Committee (PMC) for Apache PredictionIO (incubating) has asked Takako Shimamoto to become a PMC member and committer, and we are pleased to announce that she has accepted. She has made major contributions to the PredictionIO 0.11.0 release by adding Elasticsearch 5

Re: New PMC member and committer: Takahiro Hagino

2017-05-17 Thread Donald Szeto
Correction: Takahiro is not a committer of Apache Portals. Sorry for the misinformation. On Wed, May 17, 2017 at 8:50 AM, Donald Szeto <don...@apache.org> wrote: > Hi all, > > The Project Management Committee (PMC) for Apache PredictionIO > (incubating) has asked Takahiro Hagi

New product manager: Sara Asher

2017-05-17 Thread Donald Szeto
Hi all, The Project Management Committee (PMC) for Apache PredictionIO (incubating) has asked Sara Asher to become a product manager, and we are pleased to announce that she has accepted. Sara is a Director of Product Management for Salesforce Einstein, where she creates products that let people

Re: New PMC member and committer: Takahiro Hagino

2017-05-17 Thread Donald Szeto
s also a chairman of Japan PredictionIO Users Group. > > > > He will talk about PredictionIO at JJUG Cross Community Conference > > that is a largest Java technical conference in Japan this Saturday. > > I'm looking forward to his talk! > > > > 2017-05-18 0:53

Re: PIO 0.12.0 and Graduation Time?

2017-05-20 Thread Donald Szeto
Thanks Pat for starting this. Added some edits to it. Everyone please feel free to comment. PMCs please feel free to request edit access. Very happy that we started the discussion! On Thu, May 18, 2017 at 1:50 PM Pat Ferrel wrote: > Should we apply for graduation to

Re: 32 ERROR Storage$: Error initializing storage client for source PGSQL

2017-05-20 Thread Donald Szeto
Hey Shane, One quick workaround is to manually edit this line for now: https://github.com/apache/incubator-predictionio/blob/develop/bin/pio-shell#L62 and adding the JDBC assembly JAR after the main assembly JAR. Sorry for the brief reply as I'm traveling. I will follow up with more details

Re: Can i install Apache prediction IO on Windows8 machine

2017-05-16 Thread Donald Szeto
You might want to try Docker on Windows with one of these community contributed Docker container images: http://predictionio.incubator.apache.org/community/projects/#docker-installation-for-predictionio On Tue, May 16, 2017 at 12:07 PM Naresh Peddy wrote: > Hi Team, > >

Re: PIO 0.12.0 and Graduation Time?

2017-06-05 Thread Donald Szeto
Hey Andrew, is it possible for us to create non-release binary distributions and ask Incubator PMC to help take a look without starting a voting thread? This would allow us iron out issues in parallel to working on 0.12. On Wed, May 31, 2017 at 9:08 AM, Andrew Purtell wrote:

Re: What do "testing data points" in docs/manual/source/evaluation/index.html.md?

2017-06-05 Thread Donald Szeto
Hi Marius, Test data points come from the `readEval` method. References: https://predictionio.incubator.apache.org/api/current/#org.apache.predictionio.controller.PDataSource https://github.com/apache/incubator-predictionio-template-recommender/blob/develop/src/main/scala/DataSource.scala#L66

Re: Update default build targets

2017-06-05 Thread Donald Szeto
Hey all, this has a huge impact to the default build, so If you see any issue with this, please let us know as soon as possible. On Sun, Jun 4, 2017 at 10:25 PM, Shinsuke Sugaya wrote: > Hi all, > > We have a plan to change default build targets in PIO-83 and PIO-84.

Re: Update default build targets

2017-06-08 Thread Donald Szeto
Unfortunately with OSS it is not easy to survey accurately the user base unless we provide some sort of opt-in feedback (automatically or by putting up a poll on the web site). We have many users who don't subscribe to mailing lists. I personally prefer updating source build defaults to a

Re: Error during deploy

2017-06-08 Thread Donald Szeto
Hey Emilio, How are you storing your model? Failing to invert means it cannot deserialize your model from disk. It's definitely an error message that we could improve. Regards, Donald On Tue, Jun 6, 2017 at 5:48 AM Emilio Dettori wrote: > I'm working on a modified version

Re: Sparkling Water-Deep Learning Energy Forecasting template

2017-06-08 Thread Donald Szeto
Hi Sudhanshu, What versions of Spark, Sparkling Water, PredictionIO are you running on? The community might not have tested the template on the latest versions of these technologies. Regards, Donald On Tue, Jun 6, 2017 at 9:43 PM SUDHANSHU KAUSHIK < sudhanshukaushik1.61...@gmail.com> wrote: >

Re: PredictionIO return array of objects

2017-06-16 Thread Donald Szeto
It also depends on how much you are willing to denormalize. If your items' metadata don't change, it would be fine to send items' metadata in as part of the event. If you cannot denormalize and your scale is huge, you might want to consider putting metadata in a KV store. On Fri, Jun 16, 2017 at

Re: Passing an array of objects to get predictions?

2017-06-16 Thread Donald Szeto
feature request. How do I get access to JIRA? > > Best, > > Shane > > *Shane Johnson | 801.360.3350* > LinkedIn <https://www.linkedin.com/in/shanewjohnson> | Facebook > <https://www.facebook.com/shane.johnson.71653> > > On Fri, Jun 16, 2017 at 10:10 AM, Donald

Re: PredictionIO return array of objects

2017-06-17 Thread Donald Szeto
ing to see where the properties are being stripped out. I am assuming > this is done in Serving.scala? > > > On Fri, Jun 16, 2017 at 2:18 PM Donald Szeto <don...@apache.org> wrote: > >> It also depends on how much you are willing to denormalize. If your >> item

Re: Missing lib folder and contents

2017-05-04 Thread Donald Szeto
Once you've done make-distribution.sh there should be a new tarball named PredictionIO-0.11.0-incubating.tar.gz at the root level of your codetree. We recommend extracting and using that distribution instead of directly from the codetree. The behavior you are seeing is a bug anyway, and is

Re: [ERROR] [Engine$] No engine found. Your build might have failed. Aborting. - using PredictionIO-0.11.0-incubating scala.version=2.11.6 spark.version=2.1.0 elasticsearch.version=2.3.3

2017-05-01 Thread Donald Szeto
Hi, Can you try changing scalaVersion in the template's build.sbt? Regards, Donald On Mon, May 1, 2017 at 5:17 PM Barthe van Doorn wrote: > PredictionIO-0.11.0-incubating > scala.version=2.11.6 > spark.version=2.1.0 > elasticsearch.version=2.3.3 > > When I try to

Re: Text Classification Engine Tutorial

2017-09-14 Thread Donald Szeto
.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731) > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181) > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121) > at

Re: Unable to connect to all storage backends successfully

2017-09-20 Thread Donald Szeto
Hey Jim, Did you build PIO 0.12 with ES 1.4 support? ES 1.x is being deprecated in 0.12 so the default build will use ES 5.x support. See the upcoming release notes: https://github.com/apache/incubator-predictionio/blob/release/0.12.0/RELEASE.md#behavior-changes Regards, Donald On Wed, Sep 20,

Re: Vagrant installation of PredictionIO not working

2017-09-21 Thread Donald Szeto
Hi Noelia, Sorry that you ran into the orphaned Vagrant page. We haven’t had a chance to update Vagrant yet, so we removed all links going to that page. If you recall how you arrive at that page, please let us know. Meanwhile, please install from source code, or try one of the community-built

Re: Adding Spark Context (sc) to predict method?

2017-10-10 Thread Donald Szeto
ect? >> >> @Pat Ferrel, did your team do something similar, use ids to go get >> aggregate properties in the predict method? I prototyped with the universal >> Recommendation template a couple months back and remember the predict >> endpoint only required ids. >> &

Re: Adding Spark Context (sc) to predict method?

2017-10-05 Thread Donald Szeto
Hi Shane, If you are not looking to do aggregative on Spark when you retrieve additional information from event store, you probably should look at using LEventStore that does not go through Spark. Depending on your use case, the roundtrip time of involving Spark in your predict method might not

Re: [ERROR] [LocalFSModels] Requested array size exceeds VM limit

2017-09-05 Thread Donald Szeto
Hi Abhimanyu, Have you try giving the JVM a larger heap memory, e.g. pio deploy -- --driver-memory 4g Regards, Donald On Tue, Aug 29, 2017 at 9:06 AM, Abhimanyu Nagrath < abhimanyunagr...@gmail.com> wrote: > Hi , > I am new to predictionIo I am using template https://github.com/ >

Re: Text Classification Engine Tutorial

2017-09-12 Thread Donald Szeto
Hi, What version of Elasticsearch are you running? Do you see more information from pio.log at where you ran "pio train"? Regards, Donald On Thu, Sep 7, 2017 at 1:54 AM tajrij kawakibi wrote: > Hello, > > i just finish this 2 tutorial successfully, > > >

Re: Unable to connect to all storage backends successfully

2017-09-27 Thread Donald Szeto
a custom port for HTTP: > > # > > #http.port: 9200 > > # > > # For more information, consult the network module documentation. > > # > > # - Discovery > > -- > > # > > # Pass an init

Re: PredictionIO NewRelic Monitoring

2017-09-28 Thread Donald Szeto
Hey, I think you are probably looking for a passthrough argument like this. pio deploy ... -- --conf "spark.driver.extraJavaOptions=-javaagent:..." Please take a look at http://spark.apache.org/docs/latest/configuration.html for more details. Regards, Donald On Thu, Sep 28, 2017 at 11:31 AM,

Re: Text Classification Engine Tutorial

2017-09-27 Thread Donald Szeto
kawakibi <tajrij.kawak...@gmail.com> wrote: > no.. i didnt make any changes ... > > On Thu, Sep 14, 2017 at 10:49 PM, Donald Szeto <don...@apache.org> wrote: > >> Did you make any change to the template or using a stock one? Looks like >> a Lucene incompatibil

Re: [ANNOUNCE] Apache PredictionIO 0.12.0-incubating Release

2017-09-27 Thread Donald Szeto
Congrats to everyone who is part of this, and Chan for his first Apache release! On Wed, Sep 27, 2017 at 2:40 PM Chan Lee wrote: > The Apache PredictionIO team would like to announce the release of Apache > PredictionIO 0.12.0-incubating. > > Release notes are here: > >

Re: Extracting Strings from JString with PEventStore.aggregateProperties

2017-10-03 Thread Donald Szeto
Hi Shane, Thanks for your finding! Perhaps we should improve the documentation or even privatize the `fields` member. The use of `get` is noted here: https://github.com/apache/incubator-predictionio/blob/develop/data/src/main/scala/org/apache/predictionio/data/storage/PropertyMap.scala#L29

Re: Missing accessKey error, but I am providing the access key

2017-10-03 Thread Donald Szeto
Hi Noelia, The URL should be http://localhost:7070/events.json?accessKey=myaccesskey instead. Regards, Donald On Tue, Oct 3, 2017 at 6:10 AM, Noelia Osés Fernández wrote: > Hi all, > > I'm new with Prediction IO and in order to understand how it works I'm > customizing

Re: Recommendation template

2017-10-18 Thread Donald Szeto
Hey Noelia, Since you are using PIO 0.11 you may want to use the previous template version that was targeted for PIO 0.11. The latest version is targeted to 0.12’s default stack, which is Scala 2.11. The only difference between these two template versions is targeting different PIO versions.

Re: [ERROR] [TaskSetManager] Task 2.0 in stage 10.0 had a not serializable result

2017-10-18 Thread Donald Szeto
Chiming in a bit. Looking at the serialization error, it looks like we are just one little step away from getting this to work. Noelia, what does your synthesized data look like? All data that is processed by Spark needs to be serializable. At some point, a non-serializable vector object showing