Re: Using Dataframe API vs. RDD API?

Hi Shane, I've successfully used : import org.apache.spark.ml.classification.{ RandomForestClassificationModel, RandomForestClassifier } with pio. You can access feature importance through the RandomForestClassifier also. Very simple to convert RDDs to DFs as Pat mentioned, something like:

Re: Using Dataframe API vs. RDD API?

Should have mentioned that I used org.apache.spark.rdd.JdbcRDD to read in the RDD from a postgres DB initially. This was you don't need to use an EventServer! On Fri, 5 Jan 2018 at 15:37 Daniel O' Shaughnessy < danieljamesda...@gmail.com> wrote: > Hi Shane, > > I've su

Re: Need Help Setting up prediction IO

Basically you need to make sure all your lib dependencies in build.sbt work together. On Thu, 11 Jan 2018 at 13:14 Daniel O' Shaughnessy < danieljamesda...@gmail.com> wrote: > Maybe try v2.10.4 based on this line: > > [INFO] [Console$] [error]com.chuusai:shapeless _2.10,

Re: Need Help Setting up prediction IO

>> [INFO] [Console$] at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> [INFO] [Console$] at java.lang.Thread.run(Thread.java:745) >> [INFO] [Console$] [error] (*:update) Conflicting cross-version suffixes >> in: com.chuu

Re: Need Help Setting up prediction IO

wherever you're starting your engine can you type pwd and report the result back? On Wed, 10 Jan 2018 at 11:40 Rajesh Jangid wrote: > Hi, > I have tried different template as well but still unable to get it to > work, Getting same error log. > > > On Wed, Jan 10, 2018

Re: Need Help Setting up prediction IO

to run another elastic instance. > Latest prediction IO does not support elastic 1.4.4 > > > On Wed, Jan 10, 2018 at 6:25 PM, Daniel O' Shaughnessy < > danieljamesda...@gmail.com> wrote: > >> Strangedo you absolutely need to run this with pio v0.10? >>

Re: Need Help Setting up prediction IO

Strangedo you absolutely need to run this with pio v0.10? On Wed, 10 Jan 2018 at 12:50 Rajesh Jangid <raje...@grazitti.com> wrote: > {"pio": {"version": { "min": "0.10.0-incubating" }}} > > > On Wed, Jan 10, 2018 at 6:16 PM, D

Re: Need Help Setting up prediction IO

0 Jan 2018 at 13:47 Rajesh Jangid <raje...@grazitti.com> wrote: > Yes, v0.5.0 > > On Jan 10, 2018 7:07 PM, "Daniel O' Shaughnessy" < > danieljamesda...@gmail.com> wrote: > >> Is this the template you're using? >> >> https://github.com/apache/predi

Re: Prediction IO with Oracle JDBC

Yes, our team have successfully done this using JdbcRDD On Fri, 26 Jan 2018 at 01:20, Praveen Prasannakumar < praveen2399wo...@gmail.com> wrote: > Hello Team > > Can I use Oracle db as datasource\storage (event,meta,model) for > prediction io ? > > Thanks >

Re: Using Dataframe API vs. RDD API?

te some DF code, create a Jira and we’ll easily find >>> a mentor to make suggestions. There are many benefits to this including not >>> having to support a fork of PIO through subsequent versions. Also others >>> are interested in this too. >>> >>> >>> &

Re: How to increase maxResultSize with Spark 2.1.1

Hi Shane, There's an example of PAlgorithm here : https://predictionio.apache.org/templates/vanilla/dase/ On Fri, 23 Feb 2018 at 16:10 Shane Johnson wrote: > Thanks Donald. I used this command but am still getting this error. It > doesn't seem to be adjusting

Re: Custom algorithm on Prediction.IO

Hi guido, Just to add to what Andrew said, prediction.io mainly leverages spark’s MLlib and ml libraries, there are templates which use h20 and deeplearning4j also ( and any other java/Scala libs as Andrew mentioned ) Take a look on the website for examples! Note that the templates for some