Donald.. thanks. genius and so simple. I didn't understand your suggestion yesterday when I opened the issue. It worked for incubator-predictionio-template-attribute-based-classifier. I'm still working to get the old LDA engine working.. suspect that's going to take a little more work.
Here is the build.sbt that worked for incubator-predictionio-template-attribute-based-classifier import AssemblyKeys._ assemblySettings name := "template-scala-parallel-classification" organization := "org.apache.predictionio" scalaVersion := "2.11.6" libraryDependencies ++= Seq( "org.apache.predictionio" %% "apache-predictionio-core" % "0.11.0-incubating" % "provided", "org.apache.spark" %% "spark-core" % "1.3.1" % "provided", "org.apache.spark" %% "spark-mllib" % "1.3.1" % "provided") Barthe. On Mon, May 1, 2017 at 8:25 PM, Donald Szeto <[email protected]> wrote: > Hi, > > Can you try changing scalaVersion in the template's build.sbt? > > Regards, > Donald > > On Mon, May 1, 2017 at 5:17 PM Barthe van Doorn <[email protected]> > wrote: > >> PredictionIO-0.11.0-incubating >> scala.version=2.11.6 >> spark.version=2.1.0 >> elasticsearch.version=2.3.3 >> >> When I try to build an engine, I get error [INFO] [Engine$] Looking for >> an engine... >> >> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting. >> >> I see that the build process created engine jar but they are in >> target/scala-2.10 and should have created them in target/scala-2.11. >> >> Why is the engine building for scala-2.10 instead of scala-2.11? >> >> How can I tell pio build to build for scala-2.11? >> >> I use the following to handle my environment: >> ./make-distribution.sh -Dscala.version=2.11.6 -Dspark.version=2.1.0 >> -Delasticsearch.version=2.3.3 >> >> Here are results of pio build: >> >> ubuntu1604vm:~/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template$ >> pio build --verbose >> SLF4J: Class path contains multiple SLF4J bindings. >> SLF4J: Found binding in >> [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: Found binding in >> [jar:file:/home/b/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >> explanation. >> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >> [INFO] [Engine$] Using command >> '/home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt' at >> /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template >> to build. >> [INFO] [Engine$] If the path above is incorrect, this process will fail. >> [INFO] [Engine$] Uber JAR disabled. Making sure >> lib/pio-assembly-0.11.0-incubating.jar is absent. >> [INFO] [Engine$] Going to run: >> /home/b/mnt/PredictionIO-0.11.0-incubating/sbt/sbt package >> assemblyPackageDependency in >> /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template >> [INFO] [Engine$] [info] Loading project definition from >> /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/project >> [INFO] [Engine$] [info] Set current project to >> SantimentAnalysis_BagOfWords_Model (in build >> file:/home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/) >> [INFO] [Engine$] [success] Total time: 0 s, completed Apr 30, 2017 7:53:12 PM >> [INFO] [Engine$] [info] Including from cache: scala-library-2.10.5.jar >> [INFO] [Engine$] [info] Checking every *.class/*.jar file's SHA-1. >> [INFO] [Engine$] [info] Merging files... >> [INFO] [Engine$] [warn] Merging 'META-INF/MANIFEST.MF' with strategy >> 'discard' >> [INFO] [Engine$] [warn] Strategy 'discard' was applied to a file >> [INFO] [Engine$] [info] Assembly up to date: >> /home/b/mnt/PredictionIO-0.11.0-incubating/vendors/BagOfWords_SentimentAnalysis_Template/target/scala-2.10/SantimentAnalysis_BagOfWords_Model-assembly-1.0-deps.jar >> [INFO] [Engine$] [success] Total time: 1 s, completed Apr 30, 2017 7:53:13 PM >> [INFO] [Engine$] Compilation finished successfully. >> [INFO] [Engine$] Looking for an engine... >> [ERROR] [Engine$] No engine found. Your build might have failed. Aborting. >> >> >> >> results of pio status >> >> SLF4J: Class path contains multiple SLF4J bindings. >> SLF4J: Found binding in >> [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/spark/pio-data-hdfs-assembly-0.11.0-incubating.jar!/org/slf4j/i >> mpl/StaticLoggerBinder.class] >> SLF4J: Found binding in >> [jar:file:/home/mnt/PredictionIO-0.11.0-incubating/lib/pio-assembly-0.11.0-incubating.jar!/org/slf4j/impl/StaticLogger >> Binder.class] >> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >> explanation. >> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >> [INFO] [Management$] Inspecting PredictionIO... >> [INFO] [Management$] PredictionIO 0.11.0-incubating is installed at >> /home/mnt/PredictionIO-0.11.0-incubating >> [INFO] [Management$] Inspecting Apache Spark... >> [INFO] [Management$] Apache Spark is installed at >> /home/mnt/PredictionIO-0.11.0-incubating/vendors/spark-2.1.0-bin-hadoop2.7 >> [INFO] [Management$] Apache Spark 2.1.0 detected (meets minimum requirement >> of 1.3.0) >> [INFO] [Management$] Inspecting storage backend connections... >> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)... >> [INFO] [Storage$] Verifying Model Data Backend (Source: PGSQL)... >> [INFO] [Storage$] Verifying Event Data Backend (Source: PGSQL)... >> [INFO] [Storage$] Test writing to Event Store (App Id 0)... >> [INFO] [Management$] Your system is all ready to go. >> >> env >> >> PIO_SCALA_VERSION=2.11.6 >> PIO_FS_BASEDIR=/home/tmp/.pio_store >> PIO_ELASTICSEARCH_VERSION=2.3.3 >> PIO_HADOOP_VERSION=2.7 >> PIO_SPARK_VERSION=2.1.0 >> PIO_HOME=/home/mnt/PredictionIO-0.11.0-incubating >> >> -- ______________ Barthe van Doorn | [email protected] | 703.662.3781
