See <https://builds.apache.org/job/Mahout-Quality/2589/changes>
Changes: [dlyubimov] MAHOUT-1489 : initial Mahout spark shell commit Squashed commit of the following: commit 0124072b72fcdad9ccded43745c9b1d00e7ea089 Merge: c1a2c8a c9164c1 Author: Dmitriy Lyubimov <[email protected]> Date: Tue Apr 22 11:33:17 2014 -0700 Merge branch 'trunk' into shell commit c1a2c8a414c015dcdce592b145498fc8b836addf Merge: a3491f5 a8df05b Author: Dmitriy Lyubimov <[email protected]> Date: Tue Apr 22 11:30:25 2014 -0700 Merge branch 'trunk' into shell; misc fixes Conflicts: bin/mahout commit a3491f57e77b4b789051cf131bc7fdea73ad3e41 Author: Dmitriy Lyubimov <[email protected]> Date: Mon Apr 21 17:39:06 2014 -0700 -NonLocal commit bd0c83ebfa66e48f434f0ecc81bf81dd07d27f8c Merge: ad01add 78c45c4 Author: Dmitriy Lyubimov <[email protected]> Date: Mon Apr 21 17:33:18 2014 -0700 Merge commit '78c45c4c5d96f51e9' into shell commit ad01add55c1c5a212dabcd727e31dd36162c1fd0 Author: Dmitriy Lyubimov <[email protected]> Date: Mon Apr 21 17:30:53 2014 -0700 Fixing writeDRM problems commit f9f20e364e4462b6ba0693d11ee939ef5afd43a4 Author: Dmitriy Lyubimov <[email protected]> Date: Mon Apr 21 14:58:28 2014 -0700 writeDRM broken, some unknown closure attributes yank "this", not seeing where and which commit 7ca93f70ef7313cca251470c41032c08e9e612e2 Author: Dmitriy Lyubimov <[email protected]> Date: Mon Apr 21 12:57:40 2014 -0700 script errors commit ce5bdfaba160ecb6ee433b4682f62d9e6236e0b6 Author: Dmitriy Lyubimov <[email protected]> Date: Thu Apr 17 13:51:35 2014 -0700 drmFromHDFS() fixes -- load and initiailize classtag evidence correctly. TODO: use class evidence from key for saveDRM. commit aeba609a957b9ef5aac7aa4eba01edb46004116f Author: Dmitriy Lyubimov <[email protected]> Date: Thu Apr 17 11:41:30 2014 -0700 renaming script extensions commit 9b02ac2b6aa4ff046a898876f9a8fb23936cd78b Author: Dmitriy Lyubimov <[email protected]> Date: Thu Apr 17 11:17:04 2014 -0700 build fix commit 2fbd835c4c4f8fac3ff32d06b9578d436f4bbf09 Author: Dmitriy Lyubimov <[email protected]> Date: Wed Apr 16 18:04:47 2014 -0700 WIP -- unstable commit cc87347d393709ac0a6ab2adc66200caed07e911 Author: Dmitriy Lyubimov <[email protected]> Date: Wed Apr 16 15:27:00 2014 -0700 removing examples dependencies if running spark shell. commit 435992aa99090b9a75f3903ac5d10e43e6b49357 Author: Dmitriy Lyubimov <[email protected]> Date: Wed Apr 16 14:10:22 2014 -0700 WIP spark-shell, seems to be working commit 1f4fd51c2e5e18852d1b30d5a88897e14761d9e8 Author: Dmitriy Lyubimov <[email protected]> Date: Wed Apr 16 12:55:17 2014 -0700 WIP -- implementing "mathout spark-shell" commit 5922a111405cc66c1d598b123c7d28f456229559 Author: Dmitriy Lyubimov <[email protected]> Date: Thu Apr 10 17:53:23 2014 -0700 First shell prototype works in local mode ------------------------------------------ [...truncated 12047 lines...] 6943/7312 KB 6947/7312 KB 6951/7312 KB 6955/7312 KB 6959/7312 KB 6963/7312 KB 6967/7312 KB 6971/7312 KB 6975/7312 KB 6979/7312 KB 6983/7312 KB 6987/7312 KB 6991/7312 KB 6995/7312 KB 6999/7312 KB 7003/7312 KB 7007/7312 KB 7011/7312 KB 7015/7312 KB 7019/7312 KB 7023/7312 KB 7027/7312 KB 7031/7312 KB 7035/7312 KB 7039/7312 KB 7043/7312 KB 7047/7312 KB 7051/7312 KB 7055/7312 KB 7059/7312 KB 7063/7312 KB 7067/7312 KB 7071/7312 KB 7075/7312 KB 7079/7312 KB 7083/7312 KB 7087/7312 KB 7091/7312 KB 7095/7312 KB 7099/7312 KB 7103/7312 KB 7107/7312 KB 7111/7312 KB 7115/7312 KB 7119/7312 KB 7123/7312 KB 7127/7312 KB 7131/7312 KB 7135/7312 KB 7139/7312 KB 7143/7312 KB 7147/7312 KB 7151/7312 KB 7155/7312 KB 7159/7312 KB 7163/7312 KB 7167/7312 KB 7171/7312 KB 7175/7312 KB 7179/7312 KB 7183/7312 KB 7187/7312 KB 7191/7312 KB 7195/7312 KB 7199/7312 KB 7203/7312 KB 7207/7312 KB 7211/7312 KB 7215/7312 KB 7219/7312 KB 7223/7312 KB 7227/7312 KB 7231/7312 KB 7235/7312 KB 7239/7312 KB 7243/7312 KB 7247/7312 KB 7251/7312 KB 7255/7312 KB 7259/7312 KB 7263/7312 KB 7267/7312 KB 7271/7312 KB 7275/7312 KB 7279/7312 KB 7283/7312 KB 7287/7312 KB 7291/7312 KB 7295/7312 KB 7299/7312 KB 7303/7312 KB 7307/7312 KB 7311/7312 KB 7312/7312 KB Downloaded: http://repo.maven.apache.org/maven2/org/jblas/jblas/1.2.3/jblas-1.2.3.jar (7312 KB at 7333.8 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ mahout-spark-shell --- [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ mahout-spark-shell --- [INFO] Source directory: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/generated-sources/mahout added. [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ mahout-spark-shell --- [INFO] Test Source directory: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/generated-test-sources/mahout added. [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ mahout-spark-shell --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ mahout-spark-shell --- [INFO] No sources to compile [INFO] [INFO] --- maven-scala-plugin:2.15.2:compile (default) @ mahout-spark-shell --- [INFO] Checking for multiple versions of scala [WARNING] Expected all dependencies to require Scala version: 2.10.3 [WARNING] com.twitter:chill_2.10:0.3.1 requires scala version: 2.10.0 [WARNING] Multiple versions of scala libraries detected! [INFO] includes = [**/*.scala,**/*.java,] [INFO] excludes = [] [INFO] /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/src/main/scala:-1: info: compiling [INFO] Compiling 2 source files to /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/classes at 1398200677308 [INFO] prepare-compile in 0 s [INFO] compile in 6 s [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ mahout-spark-shell --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ mahout-spark-shell --- [INFO] No sources to compile [INFO] [INFO] --- maven-scala-plugin:2.15.2:testCompile (default) @ mahout-spark-shell --- [INFO] Checking for multiple versions of scala [WARNING] Expected all dependencies to require Scala version: 2.10.3 [WARNING] com.twitter:chill_2.10:0.3.1 requires scala version: 2.10.0 [WARNING] Multiple versions of scala libraries detected! [INFO] includes = [**/*.scala,**/*.java,] [INFO] excludes = [] [WARNING] No source files found. [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ mahout-spark-shell --- [INFO] [INFO] --- scalatest-maven-plugin:1.0-M2:test (test) @ mahout-spark-shell --- WARNING: -p has been deprecated and will be reused for a different (but still very cool) purpose in ScalaTest 2.0. Please change all uses of -p to -R. [36mDiscovery starting.[0m [36mDiscovery completed in 124 milliseconds.[0m [36mRun starting. Expected test count is: 0[0m [32mDiscoverySuite:[0m [36mRun completed in 228 milliseconds.[0m [36mTotal number of tests run: 0[0m [36mSuites: completed 1, aborted 0[0m [36mTests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0[0m [32mAll tests passed.[0m [INFO] [INFO] --- build-helper-maven-plugin:1.8:remove-project-artifact (remove-old-mahout-artifacts) @ mahout-spark-shell --- [INFO] /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark-shell removed. [INFO] [INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ mahout-spark-shell --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-jar-plugin:2.4:test-jar (default) @ mahout-spark-shell --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ mahout-spark-shell --- [INFO] Building jar: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-install-plugin:2.5.1:install (default-install) @ mahout-spark-shell --- [INFO] Installing /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT.jar to /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark-shell/1.0-SNAPSHOT/mahout-spark-shell-1.0-SNAPSHOT.jar [INFO] Installing /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/pom.xml to /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark-shell/1.0-SNAPSHOT/mahout-spark-shell-1.0-SNAPSHOT.pom [INFO] Installing /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT-tests.jar to /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark-shell/1.0-SNAPSHOT/mahout-spark-shell-1.0-SNAPSHOT-tests.jar [INFO] Installing /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/mahout-spark-shell-1.0-SNAPSHOT-sources.jar to /home/jenkins/.m2/repository/org/apache/mahout/mahout-spark-shell/1.0-SNAPSHOT/mahout-spark-shell-1.0-SNAPSHOT-sources.jar [INFO] [INFO] >>> maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark-shell >>> [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-source (add-source) @ mahout-spark-shell --- [INFO] Source directory: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/generated-sources/mahout added. [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-source) @ mahout-spark-shell --- [INFO] Test Source directory: /x1/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/spark-shell/target/generated-test-sources/mahout added. [INFO] [INFO] <<< maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark-shell <<< [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:javadoc (default-cli) @ mahout-spark-shell --- [INFO] [INFO] --- findbugs-maven-plugin:2.5.2:findbugs (default-cli) @ mahout-spark-shell --- [INFO] Fork Value is true [java] Warnings generated: 1 [INFO] Done FindBugs Analysis.... [INFO] [INFO] --- maven-pmd-plugin:3.0.1:pmd (default-cli) @ mahout-spark-shell --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Mahout Build Tools ................................ SUCCESS [8.185s] [INFO] Apache Mahout ..................................... SUCCESS [3.430s] [INFO] Mahout Math ....................................... SUCCESS [2:21.769s] [INFO] Mahout MapReduce Legacy ........................... SUCCESS [13:27.312s] [INFO] Mahout Integration ................................ SUCCESS [1:29.805s] [INFO] Mahout Examples ................................... SUCCESS [52.816s] [INFO] Mahout Release Package ............................ SUCCESS [0.096s] [INFO] Mahout Math/Scala wrappers ........................ SUCCESS [1:09.835s] [INFO] Mahout Spark bindings ............................. SUCCESS [2:54.300s] [INFO] Mahout Spark bindings shell ....................... SUCCESS [21.851s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 22:52.041s [INFO] Finished at: Tue Apr 22 21:04:56 UTC 2014 [INFO] Final Memory: 74M/436M [INFO] ------------------------------------------------------------------------ [FINDBUGS] Collecting findbugs analysis files... [FINDBUGS] Finding all files that match the pattern trunk/*/target/findbugsXml.xml [FINDBUGS] Parsing 7 files in <https://builds.apache.org/job/Mahout-Quality/ws/> [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/examples/target/findbugsXml.xml> of module with 23 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/integration/target/findbugsXml.xml> of module with 14 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/math-scala/target/findbugsXml.xml> of module with 16 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/math/target/findbugsXml.xml> of module with 79 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/mrlegacy/target/findbugsXml.xml> of module with 47 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/spark-shell/target/findbugsXml.xml> of module with 1 warnings. [FINDBUGS] Successfully parsed file <https://builds.apache.org/job/Mahout-Quality/2589/artifact/trunk/spark/target/findbugsXml.xml> of module with 97 warnings. [FINDBUGS] Computing warning deltas based on reference build #2580 [PMD] Collecting PMD analysis files... [PMD] Finding all files that match the pattern trunk/*/target/site/pmd.xml [PMD] No files found in <https://builds.apache.org/job/Mahout-Quality/ws/> for pattern: trunk/*/target/site/pmd.xml [PMD] Computing warning deltas based on reference build #2580 [TASKS] Scanning folder '<https://builds.apache.org/job/Mahout-Quality/ws/'> for files matching the pattern '**/*.java' - excludes: [TASKS] Found 1574 files to scan for tasks [TASKS] Found 90 open tasks. [TASKS] Computing warning deltas based on reference build #2580 Archiving artifacts Recording test results Publishing Javadoc ERROR: Publisher hudson.tasks.JavadocArchiver aborted due to exception java.lang.IllegalStateException: basedir <https://builds.apache.org/job/Mahout-Quality/ws/trunk/core/target/site/apidocs> does not exist. at org.apache.tools.ant.DirectoryScanner.scan(DirectoryScanner.java:879) at hudson.FilePath$42.hasMatch(FilePath.java:2262) at hudson.FilePath$42.invoke(FilePath.java:2159) at hudson.FilePath$42.invoke(FilePath.java:2149) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2462) at hudson.remoting.UserRequest.perform(UserRequest.java:118) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:328) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724) Updating MAHOUT-1489
