[jira] [Created] (MAHOUT-2102) transitive and direct dependencies not being piched up in ~/lib by /bin/mahout

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2102:
--

 Summary: transitive and direct dependencies not being piched up in 
~/lib by /bin/mahout
 Key: MAHOUT-2102
 URL: https://issues.apache.org/jira/browse/MAHOUT-2102
 Project: Mahout
  Issue Type: Bug
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


need to ensure dependencies are added to {{/lib/dependencies}} or packed into 
each module jar to be picked up bu {{./bin/mahout}}

https://github.com/apache/mahout/compare/master...andrewpalumbo:dep-copy-2?expand=1



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2100) Transitive dependencies (Scopt e.g.) are not being picked on the classpath nor shipped in ./lib

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2100:
--

 Summary: Transitive dependencies (Scopt e.g.) are not being picked 
on the classpath nor shipped in ./lib
 Key: MAHOUT-2100
 URL: https://issues.apache.org/jira/browse/MAHOUT-2100
 Project: Mahout
  Issue Type: Bug
  Components: build
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2091) Apache Rat check fails: Too many files with unapproved license

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2091:
--

 Summary: Apache Rat check fails: Too many files with unapproved 
license
 Key: MAHOUT-2091
 URL: https://issues.apache.org/jira/browse/MAHOUT-2091
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1
 Attachments: rat.txt

running {{mvn clean apache-rat:check -e -DskipTests=true}} the build fails with

 
{code:java}
ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check 
(default-cli) on project mahout: Too many files with unapproved license: 2 See 
RAT report in: /Users/colleenpalumbo/sandbox/mahout/target/rat.txt -> [Help 1]
 org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal 
org.apache.rat:apache-rat-plugin:0.13:check (default-cli) on project mahout: 
Too many files with unapproved license: 2 See RAT report in: 
/Users/colleenpalumbo/sandbox/mahout/target/rat.txt{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2090) RC4 - dixstribution module is not included in src distribution

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2090:
--

 Summary: RC4 - dixstribution module is not included in src 
distribution
 Key: MAHOUT-2090
 URL: https://issues.apache.org/jira/browse/MAHOUT-2090
 Project: Mahout
  Issue Type: Bug
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2089) generate sha-256 and sha-512 checksums for all release artifacts

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2089:
--

 Summary: generate sha-256 and sha-512 checksums for all release 
artifacts
 Key: MAHOUT-2089
 URL: https://issues.apache.org/jira/browse/MAHOUT-2089
 Project: Mahout
  Issue Type: Bug
  Components: build, release
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


SHA-256 and sha-512 artifacts are not being generated during release 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2088) update Apache Parent pom to latest version (34)

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2088:
--

 Summary: update Apache Parent pom to latest version (34)
 Key: MAHOUT-2088
 URL: https://issues.apache.org/jira/browse/MAHOUT-2088
 Project: Mahout
  Issue Type: Bug
  Components: build
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


we are currently using Apache parent pom 18 which is from 2010:

http://maven.apache.org/pom/maven/

Upgrade to most recent pom: version 34.  This may alleviate some of our build 
issues?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2086) change jar naming scheme to the corredct convention

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2086:
--

 Summary: change jar naming scheme to the corredct convention
 Key: MAHOUT-2086
 URL: https://issues.apache.org/jira/browse/MAHOUT-2086
 Project: Mahout
  Issue Type: Bug
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


currently we build jars as in the {{$MAHOUT_HOME/module/target






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2085) Add scm tag for each pom.xml per asf release Guidelines

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2085:
--

 Summary: Add scm tag for each pom.xml per asf release Guidelines
 Key: MAHOUT-2085
 URL: https://issues.apache.org/jira/browse/MAHOUT-2085
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


https://www.apache.org/dev/publishing-maven-artifacts.html 

Is pretty adament about having a SCM tag in each pom.  Since our project has a 
pretty complicated structure, adding this tag back in to stay with guidelines.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2084) a default source distribution for is being created under

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2084:
--

 Summary: a default source distribution for   is being created under
 Key: MAHOUT-2084
 URL: https://issues.apache.org/jira/browse/MAHOUT-2084
 Project: Mahout
  Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo


make this behavior stop



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2083) Release sources contain pom.XmlBackup and are mising engine and hdfs submodules

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2083:
--

 Summary: Release sources contain pom.XmlBackup and are mising 
engine and hdfs submodules
 Key: MAHOUT-2083
 URL: https://issues.apache.org/jira/browse/MAHOUT-2083
 Project: Mahout
  Issue Type: Bug
  Components: release
Affects Versions: 14.1
Reporter: Trevor Grant
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2082) bump master to 2.12

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2082:
--

 Summary: bump master to 2.12
 Key: MAHOUT-2082
 URL: https://issues.apache.org/jira/browse/MAHOUT-2082
 Project: Mahout
  Issue Type: Task
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2080) fix change-scala-version.sh

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2080:
--

 Summary: fix change-scala-version.sh
 Key: MAHOUT-2080
 URL: https://issues.apache.org/jira/browse/MAHOUT-2080
 Project: Mahout
  Issue Type: Bug
Reporter: Andrew Palumbo






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2079) investigat Cuda as a backend for in core matricies.

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2079:
--

 Summary: investigat Cuda as a backend for in core matricies.
 Key: MAHOUT-2079
 URL: https://issues.apache.org/jira/browse/MAHOUT-2079
 Project: Mahout
  Issue Type: Wish
Affects Versions: 0.14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.2


with nvidia card  memories now exceeding what used to be max for some 
machines.. 16 G easily it would be good to be able to dumb into Cuda memory 
directly from a statment or assignment.  look into backing in-core matrices 
with CIDA memory or CUDA Shared memory.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2078) investigat Apache arrow as a backend for in core matricies.

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2078:
--

 Summary: investigat Apache arrow as a backend for in core 
matricies.
 Key: MAHOUT-2078
 URL: https://issues.apache.org/jira/browse/MAHOUT-2078
 Project: Mahout
  Issue Type: Wish
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


Start lokinging into Apache Arrow as an alterneate memory back end for mahout 
in-core and matrices.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2077) Clean up aftor behemoth PR

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2077:
--

 Summary: Clean up aftor behemoth PR 
 Key: MAHOUT-2077
 URL: https://issues.apache.org/jira/browse/MAHOUT-2077
 Project: Mahout
  Issue Type: New Feature
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo


left some files around afrter pr#382 -  MAHOUT-2071.  there are sume dupliucate 
files and extra files around.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2076) add a /release directory with a skeleton settings.xml for releases

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2076:
--

 Summary: add a /release directory with a skeleton settings.xml for 
releases
 Key: MAHOUT-2076
 URL: https://issues.apache.org/jira/browse/MAHOUT-2076
 Project: Mahout
  Issue Type: New Feature
  Components: release
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


add a  {{/release}} diectory with {{settins.xm}}l and all necessary variable 
changes to make a release with {{mvn release:prepare -Papache-release}} and



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2075) Cross Compile and Deploy artifacts for Scala 2.11 and 2.12

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2075:
--

 Summary: Cross Compile and Deploy artifacts for Scala 2.11 and 2.12
 Key: MAHOUT-2075
 URL: https://issues.apache.org/jira/browse/MAHOUT-2075
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


[~pferrel], Mahout's current largest known customer, has need for Scala 2.11.  
We Should be easily able to If only by hand for this version, compile and 
deploy Scala 2.11 modules.  For the next releases, we may want to consider 
keeping a Scala 2.11 branch.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2074) Dockerfile(s)

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2074:
--

 Summary: Dockerfile(s) 
 Key: MAHOUT-2074
 URL: https://issues.apache.org/jira/browse/MAHOUT-2074
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


Have a [WIP] Dockerfile for which (assuming a binary release,) pulls the 
appropriate version of Spark and places both Spark and Mahout in 
\{{/opt/spark}} and {{/opt/mahout respectivly.  }}

{{Would like full build capbilities, thouigh this may be better to migrate in 
14.2 or 15.0 to an etrire new buildchain. E.g. CMake.   [I would suggest] given 
aour large amount of native code (hopefully soon to be added :))  }}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2073) Fix jenkins back up to release nightly snapshots.

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2073:
--

 Summary: Fix jenkins back up to release nightly snapshots.
 Key: MAHOUT-2073
 URL: https://issues.apache.org/jira/browse/MAHOUT-2073
 Project: Mahout
  Issue Type: Task
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2072) upgrade to scala 2.12 spark 2.4.4 as defaults.

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2072:
--

 Summary: upgrade to scala 2.12 spark 2.4.4 as defaults.
 Key: MAHOUT-2072
 URL: https://issues.apache.org/jira/browse/MAHOUT-2072
 Project: Mahout
  Issue Type: Task
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2071) fix bin.xml and assembly to allow for a binary apache-mahout-14.0.tar.gz release

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2071:
--

 Summary: fix bin.xml and assembly to allow for a binary 
apache-mahout-14.0.tar.gz release
 Key: MAHOUT-2071
 URL: https://issues.apache.org/jira/browse/MAHOUT-2071
 Project: Mahout
  Issue Type: Task
Affects Versions: 0.14.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1


the problem is theoretically solved ... we were overwriting the apache parent 
{{pom.xml}}'s[https://github.com/apache/mahout/blob/mahout-14.1/pom.xml#L21-L25|https://slack-redir.net/link?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmahout%2Fblob%2Fmahout-14.1%2Fpom.xml%23L21-L25=3]
 {{apache-release}} profile in our own, ...i removed the {{apache-release}} 
profile from ours and added what was left to {{mahout-release}}.so i expect 
that it should be working now.  the thing that was breaking everything (im 
gambling this whole theory on is that by overwriting the parent 
pom'sdeclaration of {{}}:

                   ${mahout.skip.distribution}

 
[https://github.com/apache/mahout/blob/mahout-14.1/pom.xml#L512|https://slack-redir.net/link?url=https%3A%2F%2Fgithub.com%2Fapache%2Fmahout%2Fblob%2Fmahout-14.1%2Fpom.xml%23L512=3]
 
 
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2070) move releas branch for 14.1 from `branch-14.2` to `branch-14.1`

[Andrew Palumbo (Jira)]

Andrew Palumbo created MAHOUT-2070:
--

 Summary: move releas branch for 14.1 from `branch-14.2` to  
`branch-14.1`
 Key: MAHOUT-2070
 URL: https://issues.apache.org/jira/browse/MAHOUT-2070
 Project: Mahout
  Issue Type: Task
Affects Versions: 14.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 14.1






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (MAHOUT-2069) Typo in core/pom.xml

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2069:
--

 Summary: Typo in core/pom.xml
 Key: MAHOUT-2069
 URL: https://issues.apache.org/jira/browse/MAHOUT-2069
 Project: Mahout
  Issue Type: Task
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo


typo in \{core/pom.xml} breaks build.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (MAHOUT-2027) spark-ec2 launch scripts with ViennaCL/JCuda installation

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2027:
--

 Summary: spark-ec2 launch scripts with ViennaCL/JCuda installation
 Key: MAHOUT-2027
 URL: https://issues.apache.org/jira/browse/MAHOUT-2027
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Major
 Fix For: 0.13.2


To make things easier for new users, add a couple of scripts for launching an 
ec2 cluster, installing spark,HDFS, mahout and JCuda/ViennaCL.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2026) Add NiFi wrappers for Matrix Multiply

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2026:
--

 Summary: Add NiFi wrappers for Matrix Multiply
 Key: MAHOUT-2026
 URL: https://issues.apache.org/jira/browse/MAHOUT-2026
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
 Fix For: 0.13.2


Write a custom NiFi wrapper for Matrix Multiplication.  This will be the 
beginning of a broader effort to incorporate Mahout into NiFi.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2025) Add a script to launch an EC2 cluster, install mahout and JCuda or ViennaCL to Examples

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2025:
--

 Summary: Add a script to launch an EC2 cluster, install mahout and 
JCuda or ViennaCL to Examples
 Key: MAHOUT-2025
 URL: https://issues.apache.org/jira/browse/MAHOUT-2025
 Project: Mahout
  Issue Type: Task
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.1, 0.13.2


Create a script for {{$MAHOUT_HOME/examples/bin}} to launch a spark cluster on 
EC2 using e.g.: [spark-ec2|https://github.com/amplab/spark-ec2], to:
# launch an EC2 Cluster
# Install Mahout
# Install either JCuda or ViennaCL
# RSYNC CUDA drivers and libraries in the case of JCuda

Much of this is already done in the {{.travis.yml}} configuration.  

This should lessen the learning curve for those wishing to make use of the 
native solvers.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2024) Update doap_Mahout.rdf

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2024:
--

 Summary: Update doap_Mahout.rdf
 Key: MAHOUT-2024
 URL: https://issues.apache.org/jira/browse/MAHOUT-2024
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
 Fix For: 0.13.1


Update the {{doap_Mahout.rdf}} file to the current most recent release.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2018) missing dash delimiter in spark module in mahout-spark module pom.xml

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2018:
--

 Summary: missing dash delimiter in spark module in mahout-spark 
module pom.xml
 Key: MAHOUT-2018
 URL: https://issues.apache.org/jira/browse/MAHOUT-2018
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.1


{{}}

is misnaming a jar on copy as e.g.:   
{{mahout-spark_1.3.1-SNAPSHOTspark_1.6.jar}}
 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2010) Set Log Levels to Debug in current Solver probing code

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2010:
--

 Summary: Set Log Levels to Debug in current Solver probing code
 Key: MAHOUT-2010
 URL: https://issues.apache.org/jira/browse/MAHOUT-2010
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.2


Log4j Log levels are set to [INFO] in GPU probing.  set these to Debug to 
reduce verbosity.  

These logs are meant for debugging a cluster.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2009) Allow User Defined threshold for densityAnalysys()

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2009:
--

 Summary: Allow User Defined threshold for densityAnalysys()
 Key: MAHOUT-2009
 URL: https://issues.apache.org/jira/browse/MAHOUT-2009
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
 Fix For: 0.13.2


Stochastic `densityAnalysis(...)` is is heavily used in the breaking down of 
drms to in-core  matrix and rebuilding DRMs after operations:

https://github.com/apache/mahout/blob/08e02602e947ff945b9bd73ab5f0b45863df3e53/math-scala/src/main/scala/org/apache/mahout/math/scalabindings/package.scala#L431

the density is currently hard-coded to a quite high threshold (25%) this should 
either be lowered or should allow for the user to define a setting.  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2008) Create scripts in examples/bin for launching a Spark Cluster and configuring for CUDA 8

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2008:
--

 Summary: Create scripts in examples/bin for launching a Spark 
Cluster and configuring for CUDA 8 
 Key: MAHOUT-2008
 URL: https://issues.apache.org/jira/browse/MAHOUT-2008
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
 Fix For: 0.13.2


Create a script using e.g.: {{spark-ec2}}, to launch an ec2 spark cluster, 
Create another to RSYNC JCuda/cuda 8 installs across the cluster.  Add these to 
the {{$MAHOUT_HOME/examples/bin}} dir.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2007) Fix wikipedia xml dump url in examples

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2007:
--

 Summary: Fix wikipedia xml dump url in examples
 Key: MAHOUT-2007
 URL: https://issues.apache.org/jira/browse/MAHOUT-2007
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
 Fix For: 0.13.1


sometime after mahout 0.12.2, the URL for the xml dump changed and now 404s 
out.  This is a one line fix.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2004) Properly route all CUDAMMul calls to the correct algorithms

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2004:
--

 Summary: Properly route all CUDAMMul calls to the correct 
algorithms
 Key: MAHOUT-2004
 URL: https://issues.apache.org/jira/browse/MAHOUT-2004
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.2


{{CUDAMMul}} has been implemented and is currently routing Sparse Sparse and 
Dense Dense mmul calls correctly, Sparse Dense must be properly routed.. (as 
well as Dense Sparse).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2003) Check to see if CUSPARSE library requires sorted CSC format

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2003:
--

 Summary: Check to see if CUSPARSE library requires sorted CSC 
format   
 Key: MAHOUT-2003
 URL: https://issues.apache.org/jira/browse/MAHOUT-2003
 Project: Mahout
  Issue Type: Test
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.2


Test whether CUSPARSE requires sorted CSC(R) if not, it should be an easy win-  
toshave some time off of the conversion to compressed format without any 
sorting.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2002) Mahout CUDA integrarion

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2002:
--

 Summary: Mahout CUDA integrarion
 Key: MAHOUT-2002
 URL: https://issues.apache.org/jira/browse/MAHOUT-2002
 Project: Mahout
  Issue Type: Epic
Reporter: Andrew Palumbo


Mahout CUDA module



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-2001) Automatic Probing for GPU/OMP modules at the creation of a MahoutDistributedContext

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-2001:
--

 Summary: Automatic Probing for GPU/OMP modules at the creation of 
a MahoutDistributedContext  
 Key: MAHOUT-2001
 URL: https://issues.apache.org/jira/browse/MAHOUT-2001
 Project: Mahout
  Issue Type: New Feature
Affects Versions: 0.13.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
 Fix For: 0.13.2


Currently at each {{%*%}} call, we probe for the existence of a GPU or OpenMP 
Mahout jar on the classpath.  Update the {{RootSolverFactory}} to probe for 
these checks upon instantiation of a {{MahoutDistributedContext}} and cache any 
existing solver on the classpath to the ((SolverFactory}}'s   

{code}
protected[backend] val solverMap: Map[ClassTag[_], Any]
{code} 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1993.

Resolution: Fixed

committed in a799ead59aa77cab0596f72bbe40872b59367e35

> ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to 
> scala 2.10
> ---
>
> Key: MAHOUT-1993
> URL: https://issues.apache.org/jira/browse/MAHOUT-1993
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
> are hard-coded to scala-2.10.:
> {code}
> org.apache.mahout:mahout-native-viennacl_2.10
> org.apache.mahout:mahout-native-viennacl-omp_2.10
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (MAHOUT-1994) Remove ViennCL jars upon mvn clean.

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1994.

Resolution: Fixed

> Remove ViennCL jars upon mvn clean.
> ---
>
> Key: MAHOUT-1994
> URL: https://issues.apache.org/jira/browse/MAHOUT-1994
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> currently, after running `mvn clean` from $MAHOUT_HOME, VinenaCL jars are not 
> removed from the base level directory.
> add in something similar to: 
> {code}
>  
> maven-clean-plugin
> 3.0.0
> 
>   
> 
>   ../
>   
> mahout-spark*.jar
>   
>   false
> 
>   
> 
>   
> 
>   
> {code} 
> in both {{vienncl}} and {{viennacl-omp}} module pom.xmls



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1993:
---
Priority: Blocker  (was: Major)

> ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to 
> scala 2.10
> ---
>
> Key: MAHOUT-1993
> URL: https://issues.apache.org/jira/browse/MAHOUT-1993
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
> are hard-coded to scala-2.10.:
> {code}
> org.apache.mahout:mahout-native-viennacl_2.10
> org.apache.mahout:mahout-native-viennacl-omp_2.10
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Work started] (MAHOUT-1994) Remove ViennCL jars upon mvn clean.

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1994 started by Andrew Palumbo.
--
> Remove ViennCL jars upon mvn clean.
> ---
>
> Key: MAHOUT-1994
> URL: https://issues.apache.org/jira/browse/MAHOUT-1994
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> currently, after running `mvn clean` from $MAHOUT_HOME, VinenaCL jars are not 
> removed from the base level directory.
> add in something similar to: 
> {code}
>  
> maven-clean-plugin
> 3.0.0
> 
>   
> 
>   ../
>   
> mahout-spark*.jar
>   
>   false
> 
>   
> 
>   
> 
>   
> {code} 
> in both {{vienncl}} and {{viennacl-omp}} module pom.xmls



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Work started] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1993 started by Andrew Palumbo.
--
> ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to 
> scala 2.10
> ---
>
> Key: MAHOUT-1993
> URL: https://issues.apache.org/jira/browse/MAHOUT-1993
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.1
>
>
> in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
> are hard-coded to scala-2.10.:
> {code}
> org.apache.mahout:mahout-native-viennacl_2.10
> org.apache.mahout:mahout-native-viennacl-omp_2.10
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1993:
---
Affects Version/s: 0.13.0
Fix Version/s: 0.13.1

> ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to 
> scala 2.10
> ---
>
> Key: MAHOUT-1993
> URL: https://issues.apache.org/jira/browse/MAHOUT-1993
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.1
>
>
> in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
> are hard-coded to scala-2.10.:
> {code}
> org.apache.mahout:mahout-native-viennacl_2.10
> org.apache.mahout:mahout-native-viennacl-omp_2.10
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Assigned] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1993:
--

Assignee: Andrew Palumbo

> ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to 
> scala 2.10
> ---
>
> Key: MAHOUT-1993
> URL: https://issues.apache.org/jira/browse/MAHOUT-1993
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>
> in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
> are hard-coded to scala-2.10.:
> {code}
> org.apache.mahout:mahout-native-viennacl_2.10
> org.apache.mahout:mahout-native-viennacl-omp_2.10
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-1994) Remove ViennCL jars upon mvn clean.

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1994:
--

 Summary: Remove ViennCL jars upon mvn clean.
 Key: MAHOUT-1994
 URL: https://issues.apache.org/jira/browse/MAHOUT-1994
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.1


currently, after running `mvn clean` from $MAHOUT_HOME, VinenaCL jars are not 
removed from the base level directory.

add in something similar to: 
{code}
 
maven-clean-plugin
3.0.0

  

  ../
  
mahout-spark*.jar
  
  false

  

  

  
{code} 

in both {{vienncl}} and {{viennacl-omp}} module pom.xmls



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-1993) ViennaCL dependency-reduced.xml assembly scala versions are hardcoded to scala 2.10

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1993:
--

 Summary: ViennaCL dependency-reduced.xml assembly scala versions 
are hardcoded to scala 2.10
 Key: MAHOUT-1993
 URL: https://issues.apache.org/jira/browse/MAHOUT-1993
 Project: Mahout
  Issue Type: Bug
Reporter: Andrew Palumbo


in {{spark/src/assembly/dependency-reduced.xml}} ViennaCL deps to be shipped 
are hard-coded to scala-2.10.:
{code}
org.apache.mahout:mahout-native-viennacl_2.10
org.apache.mahout:mahout-native-viennacl-omp_2.10
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Resolved] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1992.

Resolution: Invalid

2nd d'oh of the day


> Mahout PMC + Chair Can't Create Scrum Boards 
> -
>
> Key: MAHOUT-1992
> URL: https://issues.apache.org/jira/browse/MAHOUT-1992
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
> Attachments: scrum-board.png
>
>
> Hi all,
> I've been having a problem getting the JIRA Permissions/ownership changed 
> over to myself since being made Mahout Chair.  I'm unable to create a scrum 
> board, and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062148#comment-16062148
 ] 

Andrew Palumbo edited comment on MAHOUT-1992 at 6/24/17 9:42 PM:
-

 I am not sure of the "ownership" of the board.. the previous PMC Chair was 
Suneel Marthi, and I know that he has been able to create boards in the past.
 *"ownership of the mahout Jira"?

Could someone Please assist in an Access level change to the Board/Jira that I 
May not have access to?

If I'm correct and it is an access change that needs to be made, could  the 
following PMC members be granted access:

apalumbo (myself)
rawkintrevo (Trevor Grant)
akm(Andrew Musselman)
pferrel(Pat Ferrel)

Thanks very much,

Andy


was (Author: andrew_palumbo):
 I am not sure of the "ownership" of the board.. the previous PMC Chair was 
Suneel Marthi, and I know that he has been able to create boards in the past.
 *"ownership of the mahout Jira"?

Could someone Please assist in an Access level change to the Board that I May 
not have access to?

If I'm correct and it is an access change that needs to be made, could  the 
following PMC members be granted access:

apalumbo (myself)
rawkintrevo (Trevor Grant)
akm(Andrew Musselman)
pferrel(Pat Ferrel)

Thanks very much,

Andy

> Mahout PMC + Chair Can't Create Scrum Boards 
> -
>
> Key: MAHOUT-1992
> URL: https://issues.apache.org/jira/browse/MAHOUT-1992
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
> Attachments: scrum-board.png
>
>
> Hi all,
> I've been having a problem getting the JIRA Permissions/ownership changed 
> over to myself since being made Mahout Chair.  I'm unable to create a scrum 
> board, and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062148#comment-16062148
 ] 

Andrew Palumbo commented on MAHOUT-1992:


 I am not sure of the "ownership" of the board.. the previous PMC Chair was 
Suneel Marthi, and I know that he has been able to create boards in the past.
 *"ownership of the mahout Jira"?

Could someone Please assist in an Access level change to the Board that I May 
not have access to?

If I'm correct and it is an access change that needs to be made, could  the 
following PMC members be granted access:

apalumbo (myself)
rawkintrevo (Trevor Grant)
akm(Andrew Musselman)
pferrel(Pat Ferrel)

> Mahout PMC + Chair Can't Create Scrum Boards 
> -
>
> Key: MAHOUT-1992
> URL: https://issues.apache.org/jira/browse/MAHOUT-1992
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
> Attachments: scrum-board.png
>
>
> Hi all,
> I've been having a problem getting the JIRA Permissions/ownership changed 
> over to myself since being made Mahout Chair.  I'm unable to create a scrum 
> board, and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Comment Edited] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062148#comment-16062148
 ] 

Andrew Palumbo edited comment on MAHOUT-1992 at 6/24/17 9:41 PM:
-

 I am not sure of the "ownership" of the board.. the previous PMC Chair was 
Suneel Marthi, and I know that he has been able to create boards in the past.
 *"ownership of the mahout Jira"?

Could someone Please assist in an Access level change to the Board that I May 
not have access to?

If I'm correct and it is an access change that needs to be made, could  the 
following PMC members be granted access:

apalumbo (myself)
rawkintrevo (Trevor Grant)
akm(Andrew Musselman)
pferrel(Pat Ferrel)

Thanks very much,

Andy


was (Author: andrew_palumbo):
 I am not sure of the "ownership" of the board.. the previous PMC Chair was 
Suneel Marthi, and I know that he has been able to create boards in the past.
 *"ownership of the mahout Jira"?

Could someone Please assist in an Access level change to the Board that I May 
not have access to?

If I'm correct and it is an access change that needs to be made, could  the 
following PMC members be granted access:

apalumbo (myself)
rawkintrevo (Trevor Grant)
akm(Andrew Musselman)
pferrel(Pat Ferrel)

> Mahout PMC + Chair Can't Create Scrum Boards 
> -
>
> Key: MAHOUT-1992
> URL: https://issues.apache.org/jira/browse/MAHOUT-1992
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
> Attachments: scrum-board.png
>
>
> Hi all,
> I've been having a problem getting the JIRA Permissions/ownership changed 
> over to myself since being made Mahout Chair.  I'm unable to create a scrum 
> board, and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1992:
--

 Summary: Mahout PMC + Chair Can't Create Scrum Boards 
 Key: MAHOUT-1992
 URL: https://issues.apache.org/jira/browse/MAHOUT-1992
 Project: Mahout
  Issue Type: Bug
Reporter: Andrew Palumbo


Hi all,
I've been having a problem getting the JIRA Permissions/ownership changed over 
to myself since being made Mahout Chair.  I'm unable to create a scrum board, 
and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (MAHOUT-1992) Mahout PMC + Chair Can't Create Scrum Boards

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1992:
---
Attachment: scrum-board.png

> Mahout PMC + Chair Can't Create Scrum Boards 
> -
>
> Key: MAHOUT-1992
> URL: https://issues.apache.org/jira/browse/MAHOUT-1992
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Palumbo
> Attachments: scrum-board.png
>
>
> Hi all,
> I've been having a problem getting the JIRA Permissions/ownership changed 
> over to myself since being made Mahout Chair.  I'm unable to create a scrum 
> board, and get the attached dialog when I try. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Updated] (MAHOUT-1988) scala 2.10 is hardcoded

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1988:
---
Summary:  scala 2.10 is hardcoded   (was:  ViennaCL jars are Hard coded to 
scala 2.10  )

>  scala 2.10 is hardcoded 
> -
>
> Key: MAHOUT-1988
> URL: https://issues.apache.org/jira/browse/MAHOUT-1988
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> After building mahout against scala 2.11: 
> {code}
> mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 
> -Phadoop2  -DskipTests
> {code}
> ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
> the 0.13.1 release. 
> {code}
> mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
> mahout-hdfs-0.13.1-SNAPSHOT.jar
> mahout-math-0.13.1-SNAPSHOT.jar
> mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
> mahout-mr-0.13.1-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT.jar
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1988) scala 2.10 is hardcoded somewhere

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1988:
---
Summary:  scala 2.10 is hardcoded somewhere  (was:  scala 2.10 is hardcoded 
)

>  scala 2.10 is hardcoded somewhere
> --
>
> Key: MAHOUT-1988
> URL: https://issues.apache.org/jira/browse/MAHOUT-1988
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> After building mahout against scala 2.11: 
> {code}
> mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 
> -Phadoop2  -DskipTests
> {code}
> ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
> the 0.13.1 release. 
> {code}
> mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
> mahout-hdfs-0.13.1-SNAPSHOT.jar
> mahout-math-0.13.1-SNAPSHOT.jar
> mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
> mahout-mr-0.13.1-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT.jar
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1988) ViennaCL jars are Hard coded to scala 2.10

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023996#comment-16023996
 ] 

Andrew Palumbo commented on MAHOUT-1988:


[~pferrel] It looks like scopt is stuck at scala 2.10 as a transitive dep for 
ViennaCL.. When I check the dep tree from {{math-scala}} looks like we're 
pulling the right on scala version, but transitively we end up with 
{{com.github.scopt:scopt_2.10:jar:3.3.0}}.

This is blocking the scala 2.11 release-  Any thoughts?  I think its something 
inherently wrong with our poms..

{code}
andy@micheal:~/sandbox/mahout_cuda/math-scala$ mvn dependency:tree 
-Dscala.version=2.11.4 -Dscala.compat.version=2.11 -Phadoop2
[INFO] Scanning for projects... 
 
[INFO] 
[INFO] Building Mahout Math Scala bindings 0.13.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ 
mahout-math-scala_2.11 ---
[INFO] org.apache.mahout:mahout-math-scala_2.11:jar:0.13.1-SNAPSHOT
[INFO] +- org.apache.mahout:mahout-math:jar:0.13.1-SNAPSHOT:compile
[INFO] |  +- org.apache.commons:commons-math3:jar:3.2:compile
[INFO] |  +- com.google.guava:guava:jar:14.0.1:compile
[INFO] |  +- it.unimi.dsi:fastutil:jar:7.0.12:compile
[INFO] |  +- org.slf4j:slf4j-api:jar:1.7.22:compile
[INFO] |  \- com.tdunning:t-digest:jar:3.1:compile
[INFO] +- com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
[INFO] |  +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
[INFO] |  \- org.objenesis:objenesis:jar:2.1:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] +- com.github.scopt:scopt_2.11:jar:3.3.0:compile
[INFO] |  \- org.scala-lang:scala-library:jar:2.11.4:compile
[INFO] +- org.scalatest:scalatest_2.11:jar:2.2.4:test
[INFO] |  \- org.scala-lang.modules:scala-xml_2.11:jar:1.0.2:test
[INFO] \- org.scala-lang:scala-reflect:jar:2.11.4:compile
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1.810 s
[INFO] Finished at: 2017-05-24T18:13:23-07:00
[INFO] Final Memory: 19M/323M
[INFO] 
{code}

transitive (spark module): 
{code}
andy@micheal:~/sandbox/mahout_cuda/spark$ mvn dependency:tree 
-Dscala.version=2.11.4 -Dscala.compat.version=2.11 -Phadoop2 | grep scopt
[INFO] |  +- com.github.scopt:scopt_2.10:jar:3.3.0:compile
{code}

>  ViennaCL jars are Hard coded to scala 2.10  
> -
>
> Key: MAHOUT-1988
> URL: https://issues.apache.org/jira/browse/MAHOUT-1988
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> After building mahout against scala 2.11: 
> {code}
> mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 
> -Phadoop2  -DskipTests
> {code}
> ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
> the 0.13.1 release. 
> {code}
> mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
> mahout-hdfs-0.13.1-SNAPSHOT.jar
> mahout-math-0.13.1-SNAPSHOT.jar
> mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
> mahout-mr-0.13.1-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT.jar
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1988) ViennaCL jars are Hard coded to scala 2.10

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023978#comment-16023978
 ] 

Andrew Palumbo commented on MAHOUT-1988:


scopt stuck at 2.10:
{code}
andy@micheal:~/sandbox/mahout_cuda/viennacl$ mvn dependency:tree 
-Dscala.version=2.11.4 -Dscala.compat.version=2.11 -Phadoop2
[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for 
org.apache.mahout:mahout-native-viennacl_2.11:jar:0.13.1-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ 
org.apache.mahout:mahout-native-viennacl_${scala.compat.version}:[unknown-version],
 /home/andy/sandbox/mahout_cuda/viennacl/pom.xml, line 30, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found 
duplicate declaration of plugin org.codehaus.mojo:exec-maven-plugin @ 
org.apache.mahout:mahout-native-viennacl_${scala.compat.version}:[unknown-version],
 /home/andy/sandbox/mahout_cuda/viennacl/pom.xml, line 180, column 15
[WARNING] The expression ${version} is deprecated. Please use 
${project.version} instead.
[WARNING] The expression ${version} is deprecated. Please use 
${project.version} instead.
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten 
the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support 
building such malformed projects.
[WARNING] 
[INFO] 
[INFO] 
[INFO] Building Mahout Native VienniaCL OpenCL Bindings 0.13.1-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-dependency-plugin:2.3:tree (default-cli) @ 
mahout-native-viennacl_2.11 ---
[INFO] org.apache.mahout:mahout-native-viennacl_2.11:jar:0.13.1-SNAPSHOT
[INFO] +- org.apache.mahout:mahout-math-scala_2.11:jar:0.13.1-SNAPSHOT:compile
[INFO] |  +- org.apache.mahout:mahout-math:jar:0.13.1-SNAPSHOT:compile
[INFO] |  |  +- org.apache.commons:commons-math3:jar:3.2:compile
[INFO] |  |  +- com.google.guava:guava:jar:14.0.1:compile
[INFO] |  |  +- it.unimi.dsi:fastutil:jar:7.0.12:compile
[INFO] |  |  +- org.slf4j:slf4j-api:jar:1.7.22:compile
[INFO] |  |  \- com.tdunning:t-digest:jar:3.1:compile
[INFO] |  +- com.esotericsoftware.kryo:kryo:jar:2.24.0:compile
[INFO] |  |  +- com.esotericsoftware.minlog:minlog:jar:1.2:compile
[INFO] |  |  \- org.objenesis:objenesis:jar:2.1:compile
[INFO] |  +- com.github.scopt:scopt_2.10:jar:3.3.0:compile
[INFO] |  |  \- org.scala-lang:scala-library:jar:2.11.2:compile
[INFO] |  \- org.scala-lang:scala-reflect:jar:2.10.4:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] +- org.scalatest:scalatest_2.11:jar:2.2.4:test
[INFO] |  \- org.scala-lang.modules:scala-xml_2.11:jar:1.0.2:test
[INFO] \- org.bytedeco:javacpp:jar:1.2.4:compile
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 1.798 s
[INFO] Finished at: 2017-05-24T18:06:30-07:00
[INFO] Final Memory: 19M/323M
[INFO] 
{code}

>  ViennaCL jars are Hard coded to scala 2.10  
> -
>
> Key: MAHOUT-1988
> URL: https://issues.apache.org/jira/browse/MAHOUT-1988
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> After building mahout against scala 2.11: 
> {code}
> mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 
> -Phadoop2  -DskipTests
> {code}
> ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
> the 0.13.1 release. 
> {code}
> mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
> mahout-hdfs-0.13.1-SNAPSHOT.jar
> mahout-math-0.13.1-SNAPSHOT.jar
> mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
> mahout-mr-0.13.1-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT.jar
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1988) ViennaCL jars are Hard coded to scala 2.10

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023949#comment-16023949
 ] 

Andrew Palumbo commented on MAHOUT-1988:


{code}
org.apache.mahout:mahout-native-viennacl_2.10 
org.apache.mahout:mahout-native-viennacl-omp_2.10
{code}

Not the cause but needs a solution none the less.. badhack: just include 2.10 
and 2.11 here.

>  ViennaCL jars are Hard coded to scala 2.10  
> -
>
> Key: MAHOUT-1988
> URL: https://issues.apache.org/jira/browse/MAHOUT-1988
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.1
>
>
> After building mahout against scala 2.11: 
> {code}
> mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 
> -Phadoop2  -DskipTests
> {code}
> ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
> the 0.13.1 release. 
> {code}
> mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
> mahout-hdfs-0.13.1-SNAPSHOT.jar
> mahout-math-0.13.1-SNAPSHOT.jar
> mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
> mahout-mr-0.13.1-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
> mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
> mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
> mahout-spark_2.11-0.13.1-SNAPSHOT.jar
> {code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1988) ViennaCL jars are Hard coded to scala 2.10

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1988:
--

 Summary:  ViennaCL jars are Hard coded to scala 2.10  
 Key: MAHOUT-1988
 URL: https://issues.apache.org/jira/browse/MAHOUT-1988
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.1


After building mahout against scala 2.11: 
{code}
mvn clean install -Dscala.version=2.11.4 -Dscala.compat.version=2.11 -Phadoop2  
-DskipTests
{code}

ViennaCL jars are built hard-coded to scala 2.10.  This is currently blocking 
the 0.13.1 release. 

{code}
mahout-h2o_2.11-0.13.1-SNAPSHOT.jar
mahout-hdfs-0.13.1-SNAPSHOT.jar
mahout-math-0.13.1-SNAPSHOT.jar
mahout-math-scala_2.11-0.13.1-SNAPSHOT.jar
mahout-mr-0.13.1-SNAPSHOT.jar
mahout-native-cuda_2.10-0.13.0-SNAPSHOT.jar
mahout-native-cuda_2.10-0.13.1-SNAPSHOT.jar
mahout-native-viennacl_2.10-0.13.1-SNAPSHOT.jar
mahout-native-viennacl-omp_2.10-0.13.1-SNAPSHOT.jar
mahout-spark_2.11-0.13.1-SNAPSHOT-dependency-reduced.jar
mahout-spark_2.11-0.13.1-SNAPSHOT.jar
{code} 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1963) Signs are Flipped in the ViennaCL Sparse %*% Sparse tests

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1963.

Resolution: Fixed

resolved in 0.13.1 release

> Signs are Flipped in the ViennaCL Sparse %*% Sparse tests
> -
>
> Key: MAHOUT-1963
> URL: https://issues.apache.org/jira/browse/MAHOUT-1963
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0, 0.13.1
>
>
> Here aand in other places, In the ViennaCL (both modules) Unit tests, the 
> signs are flipped when adding random data to matrices.
> {code}
> // add some sparse data with a 20% threshold
> mxA := { (_, _, v) => if (r.nextDouble()  .20) r.nextDouble() else v }
> mxB := { (_, _, v) => if (r.nextDouble() < .20) r.nextDouble() else v }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1908) Create properties for VCL on mac

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1908:
---
Fix Version/s: (was: 0.13.0)
   0.13.1

> Create properties for VCL on mac 
> -
>
> Key: MAHOUT-1908
> URL: https://issues.apache.org/jira/browse/MAHOUT-1908
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.1
>
>
> Create a set of properties to run OMP on mac- OS X darwin and >. OpenMP is 
> not supported directly by CLANG in mac g++ (in most versions).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1946) ViennaCL not being picked up by JNI

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003780#comment-16003780
 ] 

Andrew Palumbo commented on MAHOUT-1946:


Seems that the user was running ViennaCL on mac.  We don't have properties for 
this. MAHOUT-1908 addresses this. Its a pain, but doable,, somwthing about mac 
CLANG not having OpenMP, but there is a workaround with {{gcc6}} and some other 
tweaks.

> ViennaCL not being picked up by JNI
> ---
>
> Key: MAHOUT-1946
> URL: https://issues.apache.org/jira/browse/MAHOUT-1946
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Musselman
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> Using the PR for MAHOUT-1938 but probably in master as well:
> scala> :load ./examples/bin/SparseSparseDrmTimer.mscala
> Loading ./examples/bin/SparseSparseDrmTimer.mscala...
> timeSparseDRMMMul: (m: Int, n: Int, s: Int, para: Int, pctDense: Double, 
> seed: Long)Long
> scala> timeSparseDRMMMul(100,100,100,1,.02,1234L)
> [INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
> [INFO] Successfully created org.apache.mahout.viennacl.opencl.GPUMMul solver
> gpuRWCW
> 17/02/26 13:18:54 ERROR Executor: Exception in task 0.0 in stage 3.0 (TID 3)
> java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
>   at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>   at java.lang.Runtime.loadLibrary0(Runtime.java:870)
>   at java.lang.System.loadLibrary(System.java:1122)
>   at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:726)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:501)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:434)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala:65)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$.org$apache$mahout$viennacl$opencl$GPUMMul$$gpuRWCW(GPUMMul.scala:171)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$$anonfun$11.apply(GPUMMul.scala:77)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$$anonfun$11.apply(GPUMMul.scala:77)
>   at org.apache.mahout.viennacl.opencl.GPUMMul$.apply(GPUMMul.scala:127)
>   at org.apache.mahout.viennacl.opencl.GPUMMul$.apply(GPUMMul.scala:33)
>   at 
> org.apache.mahout.math.scalabindings.RLikeMatrixOps.$percent$times$percent(RLikeMatrixOps.scala:37)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$.org$apache$mahout$sparkbindings$blas$ABt$$mmulFunc$1(ABt.scala:98)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$6.apply(ABt.scala:113)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$6.apply(ABt.scala:113)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$pairwiseApply$1.apply(ABt.scala:209)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$pairwiseApply$1.apply(ABt.scala:209)
>   at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
>   at 
> org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
>   at 
> org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:64)
>   at 
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:73)
>   at 
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
>   at org.apache.spark.scheduler.Task.run(Task.scala:89)
>   at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> 17/02/26 13:18:54 ERROR SparkUncaughtExceptionHandler: Uncaught exception in 
> thread Thread[Executor task launch worker-0,5,main]
> java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
>   at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>   at java.lang.Runtime.loadLibrary0(Runtime.java:870)
>   at java.lang.System.loadLibrary(System.java:1122)
>   at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:726)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:501)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:434)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala:65)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala)
>   at 
> 

[jira] [Work stopped] (MAHOUT-1908) Create properties for VCL on mac

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1908 stopped by Andrew Palumbo.
--
> Create properties for VCL on mac 
> -
>
> Key: MAHOUT-1908
> URL: https://issues.apache.org/jira/browse/MAHOUT-1908
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.0
>
>
> Create a set of properties to run OMP on mac- OS X darwin and >. OpenMP is 
> not supported directly by CLANG in mac g++ (in most versions).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1946) ViennaCL not being picked up by JNI

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16003753#comment-16003753
 ] 

Andrew Palumbo commented on MAHOUT-1946:


wait are has someone reported this error since I marked it as resolved? (which 
could have been an accident.. Usually i either leave commit number or have 
named the PR correctly.

Still though, is this issue persisting?
 

> ViennaCL not being picked up by JNI
> ---
>
> Key: MAHOUT-1946
> URL: https://issues.apache.org/jira/browse/MAHOUT-1946
> Project: Mahout
>  Issue Type: Bug
>Reporter: Andrew Musselman
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> Using the PR for MAHOUT-1938 but probably in master as well:
> scala> :load ./examples/bin/SparseSparseDrmTimer.mscala
> Loading ./examples/bin/SparseSparseDrmTimer.mscala...
> timeSparseDRMMMul: (m: Int, n: Int, s: Int, para: Int, pctDense: Double, 
> seed: Long)Long
> scala> timeSparseDRMMMul(100,100,100,1,.02,1234L)
> [INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
> [INFO] Successfully created org.apache.mahout.viennacl.opencl.GPUMMul solver
> gpuRWCW
> 17/02/26 13:18:54 ERROR Executor: Exception in task 0.0 in stage 3.0 (TID 3)
> java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
>   at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>   at java.lang.Runtime.loadLibrary0(Runtime.java:870)
>   at java.lang.System.loadLibrary(System.java:1122)
>   at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:726)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:501)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:434)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala:65)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$.org$apache$mahout$viennacl$opencl$GPUMMul$$gpuRWCW(GPUMMul.scala:171)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$$anonfun$11.apply(GPUMMul.scala:77)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$$anonfun$11.apply(GPUMMul.scala:77)
>   at org.apache.mahout.viennacl.opencl.GPUMMul$.apply(GPUMMul.scala:127)
>   at org.apache.mahout.viennacl.opencl.GPUMMul$.apply(GPUMMul.scala:33)
>   at 
> org.apache.mahout.math.scalabindings.RLikeMatrixOps.$percent$times$percent(RLikeMatrixOps.scala:37)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$.org$apache$mahout$sparkbindings$blas$ABt$$mmulFunc$1(ABt.scala:98)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$6.apply(ABt.scala:113)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$6.apply(ABt.scala:113)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$pairwiseApply$1.apply(ABt.scala:209)
>   at 
> org.apache.mahout.sparkbindings.blas.ABt$$anonfun$pairwiseApply$1.apply(ABt.scala:209)
>   at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
>   at 
> org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:191)
>   at 
> org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:64)
>   at 
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:73)
>   at 
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
>   at org.apache.spark.scheduler.Task.run(Task.scala:89)
>   at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> 17/02/26 13:18:54 ERROR SparkUncaughtExceptionHandler: Uncaught exception in 
> thread Thread[Executor task launch worker-0,5,main]
> java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
>   at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
>   at java.lang.Runtime.loadLibrary0(Runtime.java:870)
>   at java.lang.System.loadLibrary(System.java:1122)
>   at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:726)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:501)
>   at org.bytedeco.javacpp.Loader.load(Loader.java:434)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala:65)
>   at 
> org.apache.mahout.viennacl.opencl.javacpp.Context$.(Context.scala)
>   at 
> org.apache.mahout.viennacl.opencl.GPUMMul$.org$apache$mahout$viennacl$opencl$GPUMMul$$gpuRWCW(GPUMMul.scala:171)
>   at 
> 

[jira] [Created] (MAHOUT-1978) Implement "a provably good seeding method for k-means"

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1978:
--

 Summary: Implement "a provably good seeding method for k-means"
 Key: MAHOUT-1978
 URL: https://issues.apache.org/jira/browse/MAHOUT-1978
 Project: Mahout
  Issue Type: New Feature
  Components: Clustering
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
 Fix For: 0.13.1


When Building out our algorithm library, Implement {{ASSUMPTION-FREE K-MC^2}} 
from 
https://papers.nips.cc/paper/6478-fast-and-provably-good-seedings-for-k-means.pdf



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (MAHOUT-1861) New Mahout Clustering, Classification, Sketching and Optimization Algorithms

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1861:
--

Assignee: Trevor Grant  (was: Suneel Marthi)

> New Mahout Clustering, Classification, Sketching and Optimization  Algorithms
> -
>
> Key: MAHOUT-1861
> URL: https://issues.apache.org/jira/browse/MAHOUT-1861
> Project: Mahout
>  Issue Type: Epic
>Affects Versions: 0.12.1
>Reporter: Andrew Palumbo
>Assignee: Trevor Grant
> Fix For: 0.13.0, 0.14.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1963) Signs are Flipped in the ViennaCL Sparse %*% Sparse tests

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1963:
---

Yes .. thx.. please resolve



Sent from my Verizon Wireless 4G LTE smartphone


 Original message 
From: "Trevor Grant (JIRA)" 
Date: 04/19/2017 11:27 (GMT-08:00)
To: ap@outlook.com
Subject: [jira] [Commented] (MAHOUT-1963) Signs are Flipped in the ViennaCL 
Sparse %*% Sparse tests


[ 
https://issues.apache.org/jira/browse/MAHOUT-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975240#comment-15975240
 ]

Trevor Grant commented on MAHOUT-1963:
--

was this not resolved?




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


> Signs are Flipped in the ViennaCL Sparse %*% Sparse tests
> -
>
> Key: MAHOUT-1963
> URL: https://issues.apache.org/jira/browse/MAHOUT-1963
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0, 0.13.1
>
>
> Here aand in other places, In the ViennaCL (both modules) Unit tests, the 
> signs are flipped when adding random data to matrices.
> {code}
> // add some sparse data with a 20% threshold
> mxA := { (_, _, v) => if (r.nextDouble()  .20) r.nextDouble() else v }
> mxB := { (_, _, v) => if (r.nextDouble() < .20) r.nextDouble() else v }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1963) Signs are Flipped in the ViennaCL Sparse %*% Sparse tests

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1963:
--

 Summary: Signs are Flipped in the ViennaCL Sparse %*% Sparse tests
 Key: MAHOUT-1963
 URL: https://issues.apache.org/jira/browse/MAHOUT-1963
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Critical
 Fix For: 0.13.0, 0.13.1


Here aand in other places, In the ViennaCL (both modules) Unit tests, the signs 
are flipped when adding random data to matrices.

{code}
// add some sparse data with a 20% threshold
mxA := { (_, _, v) => if (r.nextDouble()  .20) r.nextDouble() else v }
mxB := { (_, _, v) => if (r.nextDouble() < .20) r.nextDouble() else v }
{code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Work started] (MAHOUT-1960) Flipped sign in the SparseSparseDrmTimer.mscala causes Desnse Matrix multiplication

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1960 started by Andrew Palumbo.
--
> Flipped sign in the SparseSparseDrmTimer.mscala causes Desnse Matrix 
> multiplication
> ---
>
> Key: MAHOUT-1960
> URL: https://issues.apache.org/jira/browse/MAHOUT-1960
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> In {{SparseSparseDrmTimer.mscala}} with the signature: 
>  def timeSparseDRMMMul(m: Int, n: Int, s: Int, para: Int, pctDense: Double = 
> .20, seed: Long = 1234L): Long = {
> the {{pctDense}} argument indicates the percent of nonZero elements in the 
> matrix. 
> As is the code to produce a random DRM for testing is as follows:
> {code}
>   val drmA = drmParallelizeEmpty(m , s, para).mapBlock(){
>case (keys,block:Matrix) =>
>  val R =  scala.util.Random
>  R.setSeed(seed)
>  val blockB = new SparseRowMatrix(block.nrow, block.ncol) 
>  blockB := {x => if (R.nextDouble > pctDense) R.nextDouble else x }
>(keys -> blockB)
> }
> {code}
> The greater than sign in line:
> blockB := {x => if (R.nextDouble > pctDense) R.nextDouble else x } 
> should be a less than sign; i.e.:
>  blockB := {x => if (R.nextDouble < pctDense) R.nextDouble else x } 
> This incorrect sign produces matrices of Incorrect density and can cause OOM 
> errors.
>  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1960) Flipped sign in the SparseSparseDrmTimer.mscala causes Desnse Matrix multiplication

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1960:
--

 Summary: Flipped sign in the SparseSparseDrmTimer.mscala causes 
Desnse Matrix multiplication
 Key: MAHOUT-1960
 URL: https://issues.apache.org/jira/browse/MAHOUT-1960
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.0


In {{SparseSparseDrmTimer.mscala}} with the signature: 
{code}
 def timeSparseDRMMMul(m: Int, n: Int, s: Int, para: Int, pctDense: Double = 
.20, seed: Long = 1234L): Long = {
{code}
the {{pctDense}} argument indicates the percent of nonZero elements in the 
matrix. 

As is the code to produce a random DRM for testing is as follows:

{code}
  val drmA = drmParallelizeEmpty(m , s, para).mapBlock(){
   case (keys,block:Matrix) =>
 val R =  scala.util.Random
 R.setSeed(seed)
 val blockB = new SparseRowMatrix(block.nrow, block.ncol) 
 blockB := {x => if (R.nextDouble > pctDense) R.nextDouble else x }
   (keys -> blockB)
}
{code)

The greater than sign in line:
{code}
 blockB := {x => if (R.nextDouble > pctDense) R.nextDouble else x }
{code}

 should be less than; i.e.:
{code}
 blockB := {x => if (R.nextDouble < pctDense) R.nextDouble else x }
{code}

This incorrect sign produces matrices of Incorrect density and can cause OOM 
errors.
 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Work started] (MAHOUT-1956) Update Readme Page

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1956 started by Andrew Palumbo.
--
> Update Readme Page
> --
>
> Key: MAHOUT-1956
> URL: https://issues.apache.org/jira/browse/MAHOUT-1956
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> Need to update the README page for new build instructions.  We may be able to 
> use the instructions that I recently sent out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (MAHOUT-1956) Update Readme Page

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1956:
--

Assignee: Andrew Palumbo

> Update Readme Page
> --
>
> Key: MAHOUT-1956
> URL: https://issues.apache.org/jira/browse/MAHOUT-1956
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> Need to update the README page for new build instructions.  We may be able to 
> use the instructions that I recently sent out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1957) Ensure that ViennaCL Jars are included in the binary distribution.

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931963#comment-15931963
 ] 

Andrew Palumbo commented on MAHOUT-1957:


As Discussed yesterday on dev@, we'll release a set of binaries in 0.13.1. 

> Ensure that ViennaCL Jars are included in the binary distribution.
> --
>
> Key: MAHOUT-1957
> URL: https://issues.apache.org/jira/browse/MAHOUT-1957
> Project: Mahout
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.13.1
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> The {{assembly/bin.xml}} for the binary distribution artifact does not 
> include the ViennaCL Jars:
> {{mahout-native-viennacl_2.10.jar}}
> {{mahout-native-viennacl-omp_2.10.jar}}
> https://github.com/apache/mahout/blob/master/distribution/src/main/assembly/bin.xml
> These need to be included.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1957) Ensure that ViennaCL Jars are included in the binary distribution.

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1957:
---
Affects Version/s: (was: 0.13.0)
   0.13.1

> Ensure that ViennaCL Jars are included in the binary distribution.
> --
>
> Key: MAHOUT-1957
> URL: https://issues.apache.org/jira/browse/MAHOUT-1957
> Project: Mahout
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.13.1
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> The {{assembly/bin.xml}} for the binary distribution artifact does not 
> include the ViennaCL Jars:
> {{mahout-native-viennacl_2.10.jar}}
> {{mahout-native-viennacl-omp_2.10.jar}}
> https://github.com/apache/mahout/blob/master/distribution/src/main/assembly/bin.xml
> These need to be included.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1956) Update Readme Page

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1956:
---
Priority: Critical  (was: Blocker)

> Update Readme Page
> --
>
> Key: MAHOUT-1956
> URL: https://issues.apache.org/jira/browse/MAHOUT-1956
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> Need to update the README page for new build instructions.  We may be able to 
> use the instructions that I recently sent out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1957) Ensure that ViennaCL Jars are included in the binary distribution.

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931378#comment-15931378
 ] 

Andrew Palumbo commented on MAHOUT-1957:


This should be done with the existing profiles. Ie. -Pviennacl, -Pviennacl-omp

> Ensure that ViennaCL Jars are included in the binary distribution.
> --
>
> Key: MAHOUT-1957
> URL: https://issues.apache.org/jira/browse/MAHOUT-1957
> Project: Mahout
>  Issue Type: Bug
>  Components: build
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> The {{assembly/bin.xml}} for the binary distribution artifact does not 
> include the ViennaCL Jars:
> {{mahout-native-viennacl_2.10.jar}}
> {{mahout-native-viennacl-omp_2.10.jar}}
> https://github.com/apache/mahout/blob/master/distribution/src/main/assembly/bin.xml
> These need to be included.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (MAHOUT-1956) Update Readme Page

[Andrew Palumbo (JIRA)]

[ 
https://issues.apache.org/jira/browse/MAHOUT-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931364#comment-15931364
 ] 

Andrew Palumbo commented on MAHOUT-1956:


There is a good abound of material  that could be used here:

https://docs.google.com/document/d/1PzQPLPPQaKrLehuzOJgP70kYgBM4hxf1NWFXTXdAU0A/edit?usp=sharing

> Update Readme Page
> --
>
> Key: MAHOUT-1956
> URL: https://issues.apache.org/jira/browse/MAHOUT-1956
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> Need to update the README page for new build instructions.  We may be able to 
> use the instructions that I recently sent out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1955) Viennacl jars are not being picked up by the shell startup script

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1955.

Resolution: Fixed

committeed to master

> Viennacl jars are not being picked up by the shell startup script
> -
>
> Key: MAHOUT-1955
> URL: https://issues.apache.org/jira/browse/MAHOUT-1955
> Project: Mahout
>  Issue Type: Bug
>  Components: Mahout spark shell
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> When building for ViennaCL for OpenCL or OpenMP: 
> {code}
> $ mvn clean install -Pviennacl -Phadoop2 -DskipTests
> {code}
> or
> {code}
> $ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
> {code}
> The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which 
>  are now in the top-level directory after the build. Fix is to add a copy 
> plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1957) Ensure that ViennaCL Jars are included in the binary distribution.

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1957:
--

 Summary: Ensure that ViennaCL Jars are included in the binary 
distribution.
 Key: MAHOUT-1957
 URL: https://issues.apache.org/jira/browse/MAHOUT-1957
 Project: Mahout
  Issue Type: Bug
  Components: build
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.0


The {{assembly/bin.xml}} for the binary distribution artifact does not include 
the ViennaCL Jars:

{{mahout-native-viennacl_2.10.jar}}
{{mahout-native-viennacl-omp_2.10.jar}}

https://github.com/apache/mahout/blob/master/distribution/src/main/assembly/bin.xml

These need to be included.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1929) Add Generalized Linear Models

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1929.

Resolution: Later

> Add Generalized Linear Models
> -
>
> Key: MAHOUT-1929
> URL: https://issues.apache.org/jira/browse/MAHOUT-1929
> Project: Mahout
>  Issue Type: Wish
>  Components: Algorithms
>Affects Versions: 0.13.1
>Reporter: Trevor Grant
>
> Implement generalize Linear Models (GLM)
> https://en.wikipedia.org/wiki/Generalized_linear_model



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1956) Update Readme Page

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1956:
--

 Summary: Update Readme Page
 Key: MAHOUT-1956
 URL: https://issues.apache.org/jira/browse/MAHOUT-1956
 Project: Mahout
  Issue Type: Bug
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.0


Need to update the README page for new build instructions.  We may be able to 
use the instructions that I recently sent out.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Work started] (MAHOUT-1955) Viennacl jars are not being picked up by the shell startup script

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1955 started by Andrew Palumbo.
--
> Viennacl jars are not being picked up by the shell startup script
> -
>
> Key: MAHOUT-1955
> URL: https://issues.apache.org/jira/browse/MAHOUT-1955
> Project: Mahout
>  Issue Type: Bug
>  Components: Mahout spark shell
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> When building for ViennaCL for OpenCL or OpenMP: 
> {code}
> $ mvn clean install -Pviennacl -Phadoop2 -DskipTests
> {code}
> or
> {code}
> $ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
> {code}
> The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which 
>  are now in the top-level directory after the build. Fix is to add a copy 
> plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1955) Viennacl jars are not being picked up by the shell startup script

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1955:
---
Sprint: Jan/Feb-2017

> Viennacl jars are not being picked up by the shell startup script
> -
>
> Key: MAHOUT-1955
> URL: https://issues.apache.org/jira/browse/MAHOUT-1955
> Project: Mahout
>  Issue Type: Bug
>  Components: Mahout spark shell
>Affects Versions: 0.13.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> When building for ViennaCL for OpenCL or OpenMP: 
> {code}
> $ mvn clean install -Pviennacl -Phadoop2 -DskipTests
> {code}
> or
> {code}
> $ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
> {code}
> The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which 
>  are now in the top-level directory after the build. Fix is to add a copy 
> plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1955) Viennacl jars are not being picked up by the shell startup script

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1955:
--

 Summary: Viennacl jars are not being picked up by the shell 
startup script
 Key: MAHOUT-1955
 URL: https://issues.apache.org/jira/browse/MAHOUT-1955
 Project: Mahout
  Issue Type: Bug
  Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
 Fix For: 0.13.0


When building for ViennaCL for OpenCL or OpenMP: 
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}

The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which  
are now in the top-level directory after the build. Fix is to add a copy plugin 
to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (MAHOUT-1954) Create a test module for GPU bindings.

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1954:
--

 Summary: Create a test module for GPU bindings.
 Key: MAHOUT-1954
 URL: https://issues.apache.org/jira/browse/MAHOUT-1954
 Project: Mahout
  Issue Type: Test
Reporter: Andrew Palumbo


Quick and dirty copy of VCL bindings to see how easily we can copy over the  
bindings to a different set.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (MAHOUT-1762) Pick up $SPARK_HOME/conf/spark-defaults.conf on startup

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1762:
--

Assignee: Trevor Grant  (was: Andrew Palumbo)

> Pick up $SPARK_HOME/conf/spark-defaults.conf on startup
> ---
>
> Key: MAHOUT-1762
> URL: https://issues.apache.org/jira/browse/MAHOUT-1762
> Project: Mahout
>  Issue Type: Improvement
>  Components: spark
>Reporter: Sergey Tryuber
>Assignee: Trevor Grant
> Fix For: 0.13.0
>
>
> [spark-defaults.conf|http://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties]
>  is aimed to contain global configuration for Spark cluster. For example, in 
> our HDP2.2 environment it contains:
> {noformat}
> spark.driver.extraJavaOptions  -Dhdp.version=2.2.0.0–2041
> spark.yarn.am.extraJavaOptions -Dhdp.version=2.2.0.0–2041
> {noformat}
> and there are many other good things. Actually it is expected that when a 
> user starts Spark Shell, it will be working fine. Unfortunately this does not 
> happens with Mahout Spark Shell, because it ignores spark configuration and 
> user has to copy-past lots of options into _MAHOUT_OPTS_.
> This happens because 
> [org.apache.mahout.sparkbindings.shell.Main|https://github.com/apache/mahout/blob/master/spark-shell/src/main/scala/org/apache/mahout/sparkbindings/shell/Main.scala]
>  is executed directly in [initialization 
> script|https://github.com/apache/mahout/blob/master/bin/mahout]:
> {code}
> "$JAVA" $JAVA_HEAP_MAX $MAHOUT_OPTS -classpath "$CLASSPATH" 
> "org.apache.mahout.sparkbindings.shell.Main" $@
> {code}
> In contrast, in Spark shell is indirectly invoked through spark-submit in 
> [spark-shell|https://github.com/apache/spark/blob/master/bin/spark-shell] 
> script:
> {code}
> "$FWDIR"/bin/spark-submit --class org.apache.spark.repl.Main "$@"
> {code}
> [SparkSubmit|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala]
>  contains an additional initialization layer for loading properties file (see 
> SparkSubmitArguments#mergeDefaultSparkProperties method).
> So there are two possible solutions:
> * use proper Spark-like initialization logic
> * use thin envelope like it is in H2O Sparkling Water 
> ([sparkling-shell|https://github.com/h2oai/sparkling-water/blob/master/bin/sparkling-shell])



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (MAHOUT-1762) Pick up $SPARK_HOME/conf/spark-defaults.conf on startup

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1762:
--

Assignee: Andrew Palumbo  (was: Trevor Grant)

> Pick up $SPARK_HOME/conf/spark-defaults.conf on startup
> ---
>
> Key: MAHOUT-1762
> URL: https://issues.apache.org/jira/browse/MAHOUT-1762
> Project: Mahout
>  Issue Type: Improvement
>  Components: spark
>Reporter: Sergey Tryuber
>Assignee: Andrew Palumbo
> Fix For: 0.13.0
>
>
> [spark-defaults.conf|http://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties]
>  is aimed to contain global configuration for Spark cluster. For example, in 
> our HDP2.2 environment it contains:
> {noformat}
> spark.driver.extraJavaOptions  -Dhdp.version=2.2.0.0–2041
> spark.yarn.am.extraJavaOptions -Dhdp.version=2.2.0.0–2041
> {noformat}
> and there are many other good things. Actually it is expected that when a 
> user starts Spark Shell, it will be working fine. Unfortunately this does not 
> happens with Mahout Spark Shell, because it ignores spark configuration and 
> user has to copy-past lots of options into _MAHOUT_OPTS_.
> This happens because 
> [org.apache.mahout.sparkbindings.shell.Main|https://github.com/apache/mahout/blob/master/spark-shell/src/main/scala/org/apache/mahout/sparkbindings/shell/Main.scala]
>  is executed directly in [initialization 
> script|https://github.com/apache/mahout/blob/master/bin/mahout]:
> {code}
> "$JAVA" $JAVA_HEAP_MAX $MAHOUT_OPTS -classpath "$CLASSPATH" 
> "org.apache.mahout.sparkbindings.shell.Main" $@
> {code}
> In contrast, in Spark shell is indirectly invoked through spark-submit in 
> [spark-shell|https://github.com/apache/spark/blob/master/bin/spark-shell] 
> script:
> {code}
> "$FWDIR"/bin/spark-submit --class org.apache.spark.repl.Main "$@"
> {code}
> [SparkSubmit|https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala]
>  contains an additional initialization layer for loading properties file (see 
> SparkSubmitArguments#mergeDefaultSparkProperties method).
> So there are two possible solutions:
> * use proper Spark-like initialization logic
> * use thin envelope like it is in H2O Sparkling Water 
> ([sparkling-shell|https://github.com/h2oai/sparkling-water/blob/master/bin/sparkling-shell])



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1830) Publish scaladocs for Mahout 0.13.0 release

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1830:
---
Sprint: Jan/Feb-2016

> Publish scaladocs for Mahout 0.13.0 release
> ---
>
> Key: MAHOUT-1830
> URL: https://issues.apache.org/jira/browse/MAHOUT-1830
> Project: Mahout
>  Issue Type: Task
>  Components: Documentation
>Affects Versions: 0.12.0
>Reporter: Suneel Marthi
>Priority: Critical
>  Labels: Newbie
> Fix For: 0.13.0
>
>
> Need to publish scaladocs for Mahout 0.12.0, present scaladocs out there are 
> from 0.10.2 release.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1904) Create a test harness to test mahout across different hardware configurations

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1904:
---
Sprint: Jan/Feb-2016

> Create a test harness to test mahout across different hardware configurations
> -
>
> Key: MAHOUT-1904
> URL: https://issues.apache.org/jira/browse/MAHOUT-1904
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
>  Labels: release, test
> Fix For: 0.13.1
>
>
> Creat a set of simple scala programs to be run as a test harness for Linux 
> amd/intel, mac, and avx2(default).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1830) Publish scaladocs for Mahout 0.13.0 release

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1830:
---
Sprint:   (was: Jan/Feb-2017)

> Publish scaladocs for Mahout 0.13.0 release
> ---
>
> Key: MAHOUT-1830
> URL: https://issues.apache.org/jira/browse/MAHOUT-1830
> Project: Mahout
>  Issue Type: Task
>  Components: Documentation
>Affects Versions: 0.12.0
>Reporter: Suneel Marthi
>Priority: Critical
>  Labels: Newbie
> Fix For: 0.13.0
>
>
> Need to publish scaladocs for Mahout 0.12.0, present scaladocs out there are 
> from 0.10.2 release.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1904) Create a test harness to test mahout across different hardware configurations

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1904:
---
Sprint:   (was: Jan/Feb-2017)

> Create a test harness to test mahout across different hardware configurations
> -
>
> Key: MAHOUT-1904
> URL: https://issues.apache.org/jira/browse/MAHOUT-1904
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
>  Labels: release, test
> Fix For: 0.13.1
>
>
> Creat a set of simple scala programs to be run as a test harness for Linux 
> amd/intel, mac, and avx2(default).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1919) Flink Module breaks the build regularly

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1919.

Resolution: Fixed

Flink has been both commented out of the build and removed from binary release. 
We may add a profile back in for 0.13.1 

> Flink Module breaks the build regularly
> ---
>
> Key: MAHOUT-1919
> URL: https://issues.apache.org/jira/browse/MAHOUT-1919
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> OOM Errors thrown by the flink module regularly break the Knightly Build.  
> These should be addressed before the 0.13.0 release... 
> One possibility is to Downgrade the Flink dependency in the root pom to the 
> orignal development dep: (1.0.x I believe)? 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1914) Spark tests are not picking up OpenCL/OpenMP jars

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1914:
---
   Sprint:   (was: Jan/Feb-2017)
Fix Version/s: (was: 0.13.0)
   0.13.1

I am going to bump this to 0.13.1  it really is not an issue. I was worried 
that it was a symptom of something larger, but since Spark tests pick up jars 
differently than any other {{MahoutDistributedContext}}, I'm not worried about 
it.

> Spark tests are not picking up OpenCL/OpenMP jars
> -
>
> Key: MAHOUT-1914
> URL: https://issues.apache.org/jira/browse/MAHOUT-1914
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.1
>
>
> Spark tests are not picking up the correct back-end solver Jars for VCL 
> classes. This is new, and must be fixed before release. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (MAHOUT-1919) Flink Module breaks the build regularly

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo reassigned MAHOUT-1919:
--

Assignee: Andrew Palumbo

> Flink Module breaks the build regularly
> ---
>
> Key: MAHOUT-1919
> URL: https://issues.apache.org/jira/browse/MAHOUT-1919
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> OOM Errors thrown by the flink module regularly break the Knightly Build.  
> These should be addressed before the 0.13.0 release... 
> One possibility is to Downgrade the Flink dependency in the root pom to the 
> orignal development dep: (1.0.x I believe)? 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Work started] (MAHOUT-1919) Flink Module breaks the build regularly

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Work on MAHOUT-1919 started by Andrew Palumbo.
--
> Flink Module breaks the build regularly
> ---
>
> Key: MAHOUT-1919
> URL: https://issues.apache.org/jira/browse/MAHOUT-1919
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> OOM Errors thrown by the flink module regularly break the Knightly Build.  
> These should be addressed before the 0.13.0 release... 
> One possibility is to Downgrade the Flink dependency in the root pom to the 
> orignal development dep: (1.0.x I believe)? 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1939) fastutil version clash with spark distributions

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1939.

Resolution: Fixed

committed in 4d1464ef4d7a1d278c828d29a906e8f431a2fcb5

> fastutil version clash with spark distributions
> ---
>
> Key: MAHOUT-1939
> URL: https://issues.apache.org/jira/browse/MAHOUT-1939
> Project: Mahout
>  Issue Type: Bug
>Reporter: Dmitriy Lyubimov
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.0
>
>
> Version difference in fast util breaks sparse algebra (specifically, 
> RandomAccessSparseVector in assign, e.g., vec *= 5).
> observed version in CDH:
> 
> file:/opt/cloudera/parcels/CDH-5.9.0-1.cdh5.9.0.p0.21/jars/fastutil-6.3.jar
> mahout uses 7.0.12
> java.lang.UnsupportedOperationException
> at 
> it.unimi.dsi.fastutil.ints.AbstractInt2DoubleMap$BasicEntry.setValue(AbstractInt2DoubleMap.java:146)
> at 
> org.apache.mahout.math.RandomAccessSparseVector$RandomAccessElement.set(RandomAccessSparseVector.java:235)
> at 
> org.apache.mahout.math.VectorView$DecoratorElement.set(VectorView.java:181)
> at 
> org.apache.mahout.math.AbstractVector.assign(AbstractVector.java:536)
> at 
> org.apache.mahout.math.scalabindings.RLikeVectorOps.$div$eq(RLikeVectorOps.scala:45)
> ...



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1908) Create properties for VCL on mac

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1908:
---
Sprint:   (was: Jan/Feb-2017)

> Create properties for VCL on mac 
> -
>
> Key: MAHOUT-1908
> URL: https://issues.apache.org/jira/browse/MAHOUT-1908
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.0
>
>
> Create a set of properties to run OMP on mac- OS X darwin and >. OpenMP is 
> not supported directly by CLANG in mac g++ (in most versions).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1908) Create properties for VCL on mac

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1908:
---
Sprint: Jan/Feb-2016

> Create properties for VCL on mac 
> -
>
> Key: MAHOUT-1908
> URL: https://issues.apache.org/jira/browse/MAHOUT-1908
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.2
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
> Fix For: 0.13.0
>
>
> Create a set of properties to run OMP on mac- OS X darwin and >. OpenMP is 
> not supported directly by CLANG in mac g++ (in most versions).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (MAHOUT-1938) When building on linux, haswell properties are not working.

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo resolved MAHOUT-1938.

Resolution: Fixed

> When building on linux, haswell properties are not working.
> ---
>
> Key: MAHOUT-1938
> URL: https://issues.apache.org/jira/browse/MAHOUT-1938
> Project: Mahout
>  Issue Type: Bug
>Affects Versions: 0.12.1
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Blocker
> Fix For: 0.13.0
>
>
> got a failure when building on linux with haswell.properties:
> {code}
> Warning: Could not load platform properties for class 
> org.apache.mahout.viennacl.openmp.OMPMMul$
> Generating 
> /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
> Compiling 
> /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
> g++ -I/usr/include/viennacl 
> -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include 
> -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux 
> /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
>  -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ 
> -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared 
> -s -o libjniViennaCL.so -lOpenCL
> /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0:
>  error: bad value (haswell) for -march= switch
>  // Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
>  ^
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 14.721 s
> {code}
> Need to fix



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1851) Automatic probing of in-core and back-end solvers

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1851:
---
Sprint:   (was: Jan/Feb-2017)

> Automatic probing of in-core and back-end solvers
> -
>
> Key: MAHOUT-1851
> URL: https://issues.apache.org/jira/browse/MAHOUT-1851
> Project: Mahout
>  Issue Type: New Feature
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.1
>
>
> In general, as we potentially expand the collection of in-core and 
> distributed solvers relying on particular sw/hw capabilities installed (lib 
> blas, viennacl, cuda), it would be nice to have automatic and centralized 
> capability probing  and some sort of registry/framework that enumerates 
> enabled features.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1851) Automatic probing of in-core and back-end solvers

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1851:
---
Sprint: Jan/Feb-2016

> Automatic probing of in-core and back-end solvers
> -
>
> Key: MAHOUT-1851
> URL: https://issues.apache.org/jira/browse/MAHOUT-1851
> Project: Mahout
>  Issue Type: New Feature
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Palumbo
>Priority: Critical
> Fix For: 0.13.1
>
>
> In general, as we potentially expand the collection of in-core and 
> distributed solvers relying on particular sw/hw capabilities installed (lib 
> blas, viennacl, cuda), it would be nice to have automatic and centralized 
> capability probing  and some sort of registry/framework that enumerates 
> enabled features.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (MAHOUT-1686) Create a documentattion page for ALS

[Andrew Palumbo (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Palumbo updated MAHOUT-1686:
---
Sprint:   (was: Jan/Feb-2017)

> Create a documentattion page for ALS
> 
>
> Key: MAHOUT-1686
> URL: https://issues.apache.org/jira/browse/MAHOUT-1686
> Project: Mahout
>  Issue Type: Documentation
>Affects Versions: 0.11.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Musselman
> Fix For: 0.13.1
>
>
> Following the template of the SSVD and QR pages create a page for ALS. This 
> Page would go under Algorithms-> Distributed Matrix Decomposition.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)