Jenkins build is back to stable : Mahout-h1-Quality #191

2016-04-19 Thread Apache Jenkins Server
See 



Jenkins build became unstable: Mahout-h1-Quality #190

2016-04-19 Thread Apache Jenkins Server
See 



Build failed in Jenkins: mahout-nightly #2066

2016-04-19 Thread Apache Jenkins Server
See 

Changes:

[apalumbo] (nojira): follow dl4j's travis configuration using a 30 second ping 
to

[apalumbo] reverting commits:

--
[...truncated 2352 lines...]
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-project/2.2.1/maven-project-2.2.1.jar
 (153 KB at 1541.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/2.2.1/maven-settings-2.2.1.jar
 (48 KB at 460.5 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact-manager/2.2.1/maven-artifact-manager-2.2.1.jar
 (66 KB at 554.5 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-registry/2.2.1/maven-plugin-registry-2.2.1.jar
 (30 KB at 241.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-container-default/1.0-alpha-9-stable-1/plexus-container-default-1.0-alpha-9-stable-1.jar
 (190 KB at 1481.5 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-parameter-documenter/2.2.1/maven-plugin-parameter-documenter-2.2.1.jar
 (22 KB at 166.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/2.2.1/maven-core-2.2.1.jar
 (174 KB at 1316.0 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/classworlds/classworlds/1.1/classworlds-1.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/2.2.1/maven-repository-metadata-2.2.1.jar
 (26 KB at 177.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.20/plexus-utils-3.0.20.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-error-diagnostics/2.2.1/maven-error-diagnostics-2.2.1.jar
 (13 KB at 88.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.3/commons-lang-2.3.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-descriptor/2.2.1/maven-plugin-descriptor-2.2.1.jar
 (39 KB at 257.5 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-api/1.4/enforcer-api-1.4.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-monitor/2.2.1/maven-monitor-2.2.1.jar
 (11 KB at 67.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-rules/1.4/enforcer-rules-1.4.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/classworlds/classworlds/1.1/classworlds-1.1.jar
 (37 KB at 237.0 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-api/1.4/enforcer-api-1.4.jar
 (11 KB at 64.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-dependency-tree/2.2/maven-dependency-tree-2.2.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.3/commons-lang-2.3.jar
 (240 KB at 1368.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-i18n/1.0-beta-6/plexus-i18n-1.0-beta-6.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-rules/1.4/enforcer-rules-1.4.jar
 (97 KB at 526.5 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/plugin-testing/maven-plugin-testing-harness/1.3/maven-plugin-testing-harness-1.3.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.20/plexus-utils-3.0.20.jar
 (238 KB at 1290.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/2.2/plexus-archiver-2.2.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-dependency-tree/2.2/maven-dependency-tree-2.2.jar
 (63 KB at 323.3 KB/sec)
[INFO] Downloading: 

Build failed in Jenkins: mahout-nightly » Mahout Build Tools #2066

2016-04-19 Thread Apache Jenkins Server
See 


--
[...truncated 57 lines...]
[INFO] 
[INFO] --- maven-enforcer-plugin:1.4:enforce (enforce-versions) @ 
mahout-buildtools ---
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.20/plexus-utils-3.0.20.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.20/plexus-utils-3.0.20.pom
 (4 KB at 161.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.3/commons-lang-2.3.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.3/commons-lang-2.3.pom
 (11 KB at 493.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-api/1.4/enforcer-api-1.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-api/1.4/enforcer-api-1.4.pom
 (3 KB at 128.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-rules/1.4/enforcer-rules-1.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/enforcer/enforcer-rules/1.4/enforcer-rules-1.4.pom
 (4 KB at 139.2 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom (2 
KB at 48.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom
 (2 KB at 65.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-dependency-tree/2.2/maven-dependency-tree-2.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-dependency-tree/2.2/maven-dependency-tree-2.2.pom
 (8 KB at 322.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-i18n/1.0-beta-6/plexus-i18n-1.0-beta-6.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-i18n/1.0-beta-6/plexus-i18n-1.0-beta-6.pom
 (771 B at 34.2 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.1.4/plexus-components-1.1.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.1.4/plexus-components-1.1.4.pom
 (3 KB at 84.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-container-default/1.0-alpha-8/plexus-container-default-1.0-alpha-8.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-container-default/1.0-alpha-8/plexus-container-default-1.0-alpha-8.pom
 (8 KB at 337.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/plugin-testing/maven-plugin-testing-harness/1.3/maven-plugin-testing-harness-1.3.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/plugin-testing/maven-plugin-testing-harness/1.3/maven-plugin-testing-harness-1.3.pom
 (4 KB at 153.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/plugin-testing/maven-plugin-testing/1.3/maven-plugin-testing-1.3.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/plugin-testing/maven-plugin-testing/1.3/maven-plugin-testing-1.3.pom
 (10 KB at 443.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/2.2/plexus-archiver-2.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/2.2/plexus-archiver-2.2.pom
 (4 KB at 156.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.1.20/plexus-components-1.1.20.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.1.20/plexus-components-1.1.20.pom
 (3 KB at 133.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.1/plexus-3.1.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.1/plexus-3.1.pom
 (19 KB at 826.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/2.0.4/plexus-io-2.0.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/2.0.4/plexus-io-2.0.4.pom
 (2 KB at 89.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/2.2.1/maven-artifact-2.2.1.jar
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/2.2.1/maven-plugin-api-2.2.1.jar
[INFO] Downloading: 

Jenkins build is unstable: mahout-nightly » Mahout Flink bindings #2064

2016-04-19 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : mahout-nightly » Mahout Build Tools #2063

2016-04-19 Thread Apache Jenkins Server
See 




[jira] [Commented] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248786#comment-15248786
 ] 

Hudson commented on MAHOUT-1834:


SUCCESS: Integrated in Mahout-Quality # (See 
[https://builds.apache.org/job/Mahout-Quality//])
MAHOUT-1834: Travis CI for MAhout, this closes apache/mahout#222 (smarthi: rev 
f26698dc7d8ce928229e39d152da35ac25e226e3)
* README.md
* .travis.yml


> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Suneel Marthi (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi resolved MAHOUT-1834.
---
Resolution: Implemented

> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Build failed in Jenkins: mahout-nightly » Mahout Build Tools #2062

2016-04-19 Thread Apache Jenkins Server
See 


--
[...truncated 995 lines...]
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/2.0/commons-collections-2.0.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/2.0/commons-collections-2.0.pom
 (171 B at 5.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/2.1/commons-collections-2.1.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/2.1/commons-collections-2.1.pom
 (4 KB at 105.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.0.b2/xml-apis-1.0.b2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.0.b2/xml-apis-1.0.b2.pom
 (3 KB at 70.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2/commons-collections-3.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2/commons-collections-3.2.pom
 (11 KB at 336.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-validator/commons-validator/1.3.1/commons-validator-1.3.1.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-validator/commons-validator/1.3.1/commons-validator-1.3.1.pom
 (9 KB at 267.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.0.4/commons-logging-1.0.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.0.4/commons-logging-1.0.4.pom
 (6 KB at 160.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/dom4j/dom4j/1.1/dom4j-1.1.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/dom4j/dom4j/1.1/dom4j-1.1.pom (142 B at 
4.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/sslext/sslext/1.2-0/sslext-1.2-0.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/sslext/sslext/1.2-0/sslext-1.2-0.pom (653 
B at 19.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-core/1.3.8/struts-core-1.3.8.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-core/1.3.8/struts-core-1.3.8.pom
 (5 KB at 131.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-parent/1.3.8/struts-parent-1.3.8.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-parent/1.3.8/struts-parent-1.3.8.pom
 (10 KB at 309.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-master/4/struts-master-4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-master/4/struts-master-4.pom
 (12 KB at 372.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/apache/2/apache-2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/apache/2/apache-2.pom (4 KB at 
104.0 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/antlr/antlr/2.7.2/antlr-2.7.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/antlr/antlr/2.7.2/antlr-2.7.2.pom (145 B 
at 4.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-taglib/1.3.8/struts-taglib-1.3.8.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-taglib/1.3.8/struts-taglib-1.3.8.pom
 (4 KB at 93.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-tiles/1.3.8/struts-tiles-1.3.8.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/struts/struts-tiles/1.3.8/struts-tiles-1.3.8.pom
 (3 KB at 88.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/velocity/velocity/1.6.2/velocity-1.6.2.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/velocity/velocity/1.6.2/velocity-1.6.2.pom
 (11 KB at 324.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-integration-tools/1.6/doxia-integration-tools-1.6.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-integration-tools/1.6/doxia-integration-tools-1.6.pom
 (7 KB at 212.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-tools/3/doxia-tools-3.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-tools/3/doxia-tools-3.pom
 (10 KB at 167.2 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-io/commons-io/1.4/commons-io-1.4.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-io/commons-io/1.4/commons-io-1.4.pom
 (13 KB at 378.2 KB/sec)
[INFO] Downloading: 

Build failed in Jenkins: mahout-nightly #2062

2016-04-19 Thread Apache Jenkins Server
See 

Changes:

[smarthi] NoJira: Add correct mvn version to travis.yml

[smarthi] NoJira: Add correct mvn version to travis.yml

--
[...truncated 3303 lines...]
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/14/jetty-parent-14.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/14/jetty-parent-14.pom
 (17 KB at 487.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-util/6.1.25/jetty-util-6.1.25.pom
 (4 KB at 111.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api/2.5-20081211/servlet-api-2.5-20081211.pom
 (3 KB at 81.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/mortbay/jetty/jetty-parent/7/jetty-parent-7.pom
 (13 KB at 382.3 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.5/commons-lang-2.5.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-lang/commons-lang/2.5/commons-lang-2.5.pom
 (17 KB at 506.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/12/commons-parent-12.pom
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/12/commons-parent-12.pom
 (27 KB at 796.6 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-core/1.6/doxia-core-1.6.jar
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.jar
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.0.2/httpclient-4.0.2.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/classworlds/classworlds/1.1-alpha-2/classworlds-1.1-alpha-2.jar
 (37 KB at 915.9 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.3/commons-codec-1.3.jar
 (46 KB at 1140.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/xmlunit/xmlunit/1.5/xmlunit-1.5.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.1/commons-logging-1.1.1.jar
 (60 KB at 1411.0 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/reporting/maven-reporting-exec/1.2/maven-reporting-exec-1.2.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/doxia/doxia-core/1.6/doxia-core-1.6.jar
 (159 KB at 3441.1 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/reporting/maven-reporting-exec/1.2/maven-reporting-exec-1.2.jar
 (27 KB at 348.2 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.0/maven-core-3.0.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/xmlunit/xmlunit/1.5/xmlunit-1.5.jar (96 KB 
at 1109.0 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.0/maven-repository-metadata-3.0.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-util/1.7/aether-util-1.7.jar
 (106 KB at 1211.7 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.0/maven-model-builder-3.0.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar
 (169 KB at 1705.4 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.0/maven-aether-provider-3.0.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.0/maven-repository-metadata-3.0.jar
 (30 KB at 238.8 KB/sec)
[INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/aether/aether-impl/1.7/aether-impl-1.7.jar
[INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.0/maven-core-3.0.jar
 (515 KB at 4052.7 KB/sec)
[INFO] Downloading: 

[jira] [Commented] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248526#comment-15248526
 ] 

ASF GitHub Bot commented on MAHOUT-1834:


Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/222


> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248510#comment-15248510
 ] 

ASF GitHub Bot commented on MAHOUT-1834:


GitHub user smarthi opened a pull request:

https://github.com/apache/mahout/pull/222

MAHOUT-1834: SetupTravis CI for Mahout



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/smarthi/mahout MAHOUT-1834

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/222.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #222


commit 461955b0114342a8e350da6b2765173b12a28f05
Author: smarthi 
Date:   2016-04-19T20:02:54Z

MAHOUT-1834: SetupTravis CI for Mahout




> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Andrew Palumbo (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248471#comment-15248471
 ] 

Andrew Palumbo commented on MAHOUT-1834:


filed https://issues.apache.org/jira/browse/INFRA-11708

> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Andrew Palumbo (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248442#comment-15248442
 ] 

Andrew Palumbo commented on MAHOUT-1834:


we may have to file with infra to get the webhooks setup:  
https://issues.apache.org/jira/browse/INFRA-11265.  Probably don't want to do 
that until we have the {{.travis.yml}} file setup.

> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


RE: [jira] [Created] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Andrew Palumbo
I thought I remembered something like that.. maybe going through ASF will 
help.. the mirrors have an actual purchased Travis CI account.

 Original message 
From: Andrew Musselman 
Date: 04/19/2016 2:50 PM (GMT-05:00)
To: dev@mahout.apache.org
Subject: Re: [jira] [Created] (MAHOUT-1834) Setup Travis CI for Mahout

Someone on my team tried that once but the builds were blowing up with OOM
as I recall.

On Tuesday, April 19, 2016, Andrew Palumbo (JIRA)  wrote:

> Andrew Palumbo created MAHOUT-1834:
> --
>
>  Summary: Setup Travis CI for Mahout
>  Key: MAHOUT-1834
>  URL: https://issues.apache.org/jira/browse/MAHOUT-1834
>  Project: Mahout
>   Issue Type: Task
> Affects Versions: 0.12.0
> Reporter: Andrew Palumbo
>  Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an
> account with Travis and configuring a {{travis.yml}} file.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>


[jira] [Assigned] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Suneel Marthi (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suneel Marthi reassigned MAHOUT-1834:
-

Assignee: Suneel Marthi

> Setup Travis CI for Mahout
> --
>
> Key: MAHOUT-1834
> URL: https://issues.apache.org/jira/browse/MAHOUT-1834
> Project: Mahout
>  Issue Type: Task
>Affects Versions: 0.12.0
>Reporter: Andrew Palumbo
>Assignee: Suneel Marthi
> Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an 
> account with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [jira] [Created] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Andrew Musselman
Someone on my team tried that once but the builds were blowing up with OOM
as I recall.

On Tuesday, April 19, 2016, Andrew Palumbo (JIRA)  wrote:

> Andrew Palumbo created MAHOUT-1834:
> --
>
>  Summary: Setup Travis CI for Mahout
>  Key: MAHOUT-1834
>  URL: https://issues.apache.org/jira/browse/MAHOUT-1834
>  Project: Mahout
>   Issue Type: Task
> Affects Versions: 0.12.0
> Reporter: Andrew Palumbo
>  Fix For: 0.12.1
>
>
> We need to get Travis CI setup for mahout.  This involves setting up an
> account with Travis and configuring a {{travis.yml}} file.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>


[jira] [Created] (MAHOUT-1834) Setup Travis CI for Mahout

2016-04-19 Thread Andrew Palumbo (JIRA)
Andrew Palumbo created MAHOUT-1834:
--

 Summary: Setup Travis CI for Mahout
 Key: MAHOUT-1834
 URL: https://issues.apache.org/jira/browse/MAHOUT-1834
 Project: Mahout
  Issue Type: Task
Affects Versions: 0.12.0
Reporter: Andrew Palumbo
 Fix For: 0.12.1


We need to get Travis CI setup for mahout.  This involves setting up an account 
with Travis and configuring a {{travis.yml}} file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [jira] [Commented] (MAHOUT-1788) spark-itemsimilarity integration test script cleanup

2016-04-19 Thread Khurrum Nasim
okay thanks - i’ll run those tests. i actually ran a few others as well like 
the MatrixWritableTest.  

> On Apr 18, 2016, at 8:22 PM, Dmitriy Lyubimov  wrote:
> 
> I am not sure of your question about tests...
> 
> there are in-memory tests which you can by 'mvn test' in /math-scala
> module; distributed tests are done per engine under 'spark', 'h2o' or
> 'flink' modules.
> 
> 
> On Mon, Apr 18, 2016 at 5:19 PM, Dmitriy Lyubimov  wrote:
> 
>> i meant "not so much a library"
>> 
>> On Mon, Apr 18, 2016 at 5:18 PM, Dmitriy Lyubimov 
>> wrote:
>> 
>>> Khurrum,
>>> 
>>> mahout is so much  a library at this point.
>>> 
>>> if you mean if it can be used to build networks with 2d inputs, yes i did
>>> some of that. multi-epoch SGD based systems should be easy enough to build,
>>> and will probably have a reasonable performance -- although I think
>>> dedicated CNN systems like Caffe would still run faster at this point. Full
>>> batch trainers are somewhat slow for larger problems though, my
>>> investigation points that  there are architectural problems in spark that
>>> are hard to overcome at this point for high IO algorithms.
>>> 
>>> On Mon, Apr 18, 2016 at 11:49 AM, Khurrum Nasim >> 
 Hi Guys,
 
 Can Mahout be used for things like face detection ?Also which unit
 tests or integration tests do you recommend I should run just to get a
 better feel of the execution flow.
 
 I’m still slowly acclimating to the project.  But hopefully should come
 up to speed soon.
 
 
 Many Thanks,
 
 Khurrum
 
 
 
 
> On Mar 30, 2016, at 3:10 PM, Suneel Marthi  wrote:
> 
> Thanks Khurrum for stepping up.
> 
> You just need basic programming skills - Java/Scala to be able to
> contribute. We can help you with the algorithms and linear algebra
 stuff.
> 
> 
> Welcome aboard !!
> 
> 
> On Wed, Mar 30, 2016 at 3:05 PM, Khurrum Nasim <
 khurrum.na...@useitc.com>
> wrote:
> 
>> Thanks for the advice Dimitry.  I’m already signed up on ASF jira.
 My
>> handle is “nasimk”
>> 
>> Do I need to be a linear algebra expert and or math phd  to
 contribute ?
>> I have 10 plus years of computer programming experience.  my
 background is
>> comp sci.
>> 
>> Khurrum
>> 
>> 
>> 
>> 
>> 
>>> On Mar 30, 2016, at 2:57 PM, Dmitriy Lyubimov 
 wrote:
>>> 
>>> PS You may also want to sign up with ASF Jira so we can assign
 issues to
>>> yourself.
>>> 
>>> On Wed, Mar 30, 2016 at 11:52 AM, Dmitriy Lyubimov <
 dlie...@gmail.com>
>>> wrote:
>>> 
 
 
 On Wed, Mar 30, 2016 at 11:43 AM, Khurrum Nasim <
>> khurrum.na...@useitc.com>
 wrote:
 
> Thanks Dimirtry.
> 
> I take a look at see where I can start pitching in.  Do I need
> contributor access ? how  would I create feature branch of my work
 ?
> 
 
 Khurrum,
 
 you only need github account. What you need is to create mahout's
 master
 fork in your github space and keep it in sync, as possible, with
 master
>> as
 you go (by doing regular pulls). That way you have the most chance
 of
 having least conflicts possible.
 
 At any point in time (I recommend at perhaps when you feel you are
 about
 50 to 70% done or just need a code advice), you can create a github
 pull
 request to the apache/mahout master. Make sure to include MAHOUT-XXX
>> issue
 in the head of the pull request, that way ASF will automatically
>> propagate
 code comments to jira, and so all discussion can be done entirely on
>> github.
 
 Again, if you take on a signficant contribution (such as a new
 numerical
 method contribution), I recommend to discuss the proposal on the
 @dev
>> list
 
 thanks.
 
 
> 
> Khurrum
> 
>> On Mar 30, 2016, at 1:12 PM, Dmitriy Lyubimov 
> wrote:
>> 
>> Oh but of course! please do!
>> 
>> You may work on any issue, this or any other of your choice, or
 even
>> on
> any
>> new issue you can think of (for sizeable contributions it is
> recommended to
>> start discussion on the @dev list first though, to make sure to
>> benefit
>> from experience of others. Please file any new issue first to
 jira).
>> 
>> On Wed, Mar 30, 2016 at 9:05 AM, shashi bushan dongur (JIRA) <
>> j...@apache.org> wrote:
>> 
>>> 
>>> [
>>> 
> 
>> 
 

[jira] [Commented] (MAHOUT-1572) blockify() to detect (naively) the data sparsity in the loaded data

2016-04-19 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247992#comment-15247992
 ] 

ASF GitHub Bot commented on MAHOUT-1572:


Github user dlyubimov commented on the pull request:

https://github.com/apache/mahout/pull/10#issuecomment-211983401
  
yes this is not the way to do it 
actually it seems vectors are not reporting density faithfully, i had to do 
a more thorough analysis of data density elsewhere before doing things. this 
probably needs to be patched with a more thorough technique. 
+1


> blockify() to detect (naively) the data sparsity in the loaded data 
> 
>
> Key: MAHOUT-1572
> URL: https://issues.apache.org/jira/browse/MAHOUT-1572
> Project: Mahout
>  Issue Type: Bug
>Reporter: Dmitriy Lyubimov
> Fix For: 0.10.0
>
>
> per [~ssc]:
> .bq a dense matrix is converted into a SparseRowMatrix with dense row vectors 
> by blockify(), after serialization this becomes a dense matrix in sparse 
> format (triggering OOMs)! 
> i guess we can look at first row vector and go on to either DenseMatrix or 
> SparseRowMatrix



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1686) Create a documentattion page for ALS

2016-04-19 Thread Saikat Kanjilal (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247974#comment-15247974
 ] 

Saikat Kanjilal commented on MAHOUT-1686:
-

Andrew,
This issue seems old, does this still need to be done, if so I can take it on, 
let me know.
Thanks

> Create a documentattion page for ALS
> 
>
> Key: MAHOUT-1686
> URL: https://issues.apache.org/jira/browse/MAHOUT-1686
> Project: Mahout
>  Issue Type: Documentation
>Affects Versions: 0.11.0
>Reporter: Andrew Palumbo
>Assignee: Andrew Musselman
> Fix For: 0.12.1
>
>
> Following the template of the SSVD and QR pages create a page for ALS. This 
> Page would go under Algorithms-> Distributed Matrix Decomposition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1791) Automatic threading for java based mmul in the front end and the backend.

2016-04-19 Thread Saikat Kanjilal (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247966#comment-15247966
 ] 

Saikat Kanjilal commented on MAHOUT-1791:
-

Andrew/Dmitry,
I am wondering if there is any coding related efforts here that I can help 
investigate or are there enough engineers already working on this?

> Automatic threading for java based mmul in the front end and the backend.
> -
>
> Key: MAHOUT-1791
> URL: https://issues.apache.org/jira/browse/MAHOUT-1791
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.11.1, 0.12.0, 0.11.2
>Reporter: Dmitriy Lyubimov
>Assignee: Andrew Musselman
> Fix For: 0.12.1
>
>
> As we know, we are still struggling with decisions which path to take for 
> bare metal accelerations in in-core math. 
> Meanwhile, a simple no-brainer improvement though is to add decision paths 
> and apply multithreaded matrix-matrix multiplication (and maybe even others; 
> but mmul perhaps is the most prominent beneficiary here at the moment which 
> is both easy to do and to have a statistically significant improvement) 
> So multithreaded logic addition to mmul is one path. 
> Another path is automatic adjustment of multithreading. 
> In front end, we probably want to utilize all cores available. 
> in the backend, we can oversubscribe cores but probably doing so by more than 
> 2x or 3x is unadvisable because of point of diminishing returns driven by 
> growing likelihood of context switching overhead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: [jira] [Commented] (MAHOUT-1788) spark-itemsimilarity integration test script cleanup

2016-04-19 Thread Suneel Marthi
On Tue, Apr 19, 2016 at 11:08 AM, Khurrum Nasim 
wrote:

> Thank you Dimitry.
>
> So is there an architectural blueprint for mahout ?   What I mean is how
> can get the 1000 feet overview ? Or the bird eye view of the project.
> I do see Mahout is very modularized - however I’m still trying to make
> heads and tails out it :)
>
> @Dimitry -
> "my investigation points that  there are architectural problems in spark
> that
> are hard to overcome at this point for high IO algorithms.”  - Can you
> share some more details about this - I’m just curious.
>

Long story short - "Distributed != Scalable"

>
>
> > On Apr 18, 2016, at 8:18 PM, Dmitriy Lyubimov  wrote:
> >
> > Khurrum,
> >
> > mahout is so much  a library at this point.
> >
> > if you mean if it can be used to build networks with 2d inputs, yes i did
> > some of that. multi-epoch SGD based systems should be easy enough to
> build,
> > and will probably have a reasonable performance -- although I think
> > dedicated CNN systems like Caffe would still run faster at this point.
> Full
> > batch trainers are somewhat slow for larger problems though, my
> > investigation points that  there are architectural problems in spark that
> > are hard to overcome at this point for high IO algorithms.
> >
> > On Mon, Apr 18, 2016 at 11:49 AM, Khurrum Nasim <
> khurrum.na...@useitc.com>
> > wrote:
> >
> >> Hi Guys,
> >>
> >> Can Mahout be used for things like face detection ?Also which unit
> >> tests or integration tests do you recommend I should run just to get a
> >> better feel of the execution flow.
> >>
> >> I’m still slowly acclimating to the project.  But hopefully should come
> up
> >> to speed soon.
> >>
> >>
> >> Many Thanks,
> >>
> >> Khurrum
> >>
> >>
> >>
> >>
> >>> On Mar 30, 2016, at 3:10 PM, Suneel Marthi  wrote:
> >>>
> >>> Thanks Khurrum for stepping up.
> >>>
> >>> You just need basic programming skills - Java/Scala to be able to
> >>> contribute. We can help you with the algorithms and linear algebra
> stuff.
> >>>
> >>>
> >>> Welcome aboard !!
> >>>
> >>>
> >>> On Wed, Mar 30, 2016 at 3:05 PM, Khurrum Nasim <
> khurrum.na...@useitc.com
> >>>
> >>> wrote:
> >>>
>  Thanks for the advice Dimitry.  I’m already signed up on ASF jira.
> My
>  handle is “nasimk”
> 
>  Do I need to be a linear algebra expert and or math phd  to
> contribute ?
>  I have 10 plus years of computer programming experience.  my
> background
> >> is
>  comp sci.
> 
>  Khurrum
> 
> 
> 
> 
> 
> > On Mar 30, 2016, at 2:57 PM, Dmitriy Lyubimov 
> >> wrote:
> >
> > PS You may also want to sign up with ASF Jira so we can assign issues
> >> to
> > yourself.
> >
> > On Wed, Mar 30, 2016 at 11:52 AM, Dmitriy Lyubimov <
> dlie...@gmail.com>
> > wrote:
> >
> >>
> >>
> >> On Wed, Mar 30, 2016 at 11:43 AM, Khurrum Nasim <
>  khurrum.na...@useitc.com>
> >> wrote:
> >>
> >>> Thanks Dimirtry.
> >>>
> >>> I take a look at see where I can start pitching in.  Do I need
> >>> contributor access ? how  would I create feature branch of my work
> ?
> >>>
> >>
> >> Khurrum,
> >>
> >> you only need github account. What you need is to create mahout's
> >> master
> >> fork in your github space and keep it in sync, as possible, with
> >> master
>  as
> >> you go (by doing regular pulls). That way you have the most chance
> of
> >> having least conflicts possible.
> >>
> >> At any point in time (I recommend at perhaps when you feel you are
> >> about
> >> 50 to 70% done or just need a code advice), you can create a github
> >> pull
> >> request to the apache/mahout master. Make sure to include MAHOUT-XXX
>  issue
> >> in the head of the pull request, that way ASF will automatically
>  propagate
> >> code comments to jira, and so all discussion can be done entirely on
>  github.
> >>
> >> Again, if you take on a signficant contribution (such as a new
> >> numerical
> >> method contribution), I recommend to discuss the proposal on the
> @dev
>  list
> >>
> >> thanks.
> >>
> >>
> >>>
> >>> Khurrum
> >>>
>  On Mar 30, 2016, at 1:12 PM, Dmitriy Lyubimov 
> >>> wrote:
> 
>  Oh but of course! please do!
> 
>  You may work on any issue, this or any other of your choice, or
> even
>  on
> >>> any
>  new issue you can think of (for sizeable contributions it is
> >>> recommended to
>  start discussion on the @dev list first though, to make sure to
>  benefit
>  from experience of others. Please file any new issue first to
> jira).
> 
>  On Wed, Mar 30, 2016 at 9:05 AM, shashi bushan dongur (JIRA) <
>  j...@apache.org> wrote:
> 
> >
> > [
> 

[jira] [Commented] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Suneel Marthi (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247585#comment-15247585
 ] 

Suneel Marthi commented on MAHOUT-1833:
---

Thanks Edmond, please create a PR. Its easier to comment and review a PR.

> One more svec function accepting cardinality as parameter 
> --
>
> Key: MAHOUT-1833
> URL: https://issues.apache.org/jira/browse/MAHOUT-1833
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.12.0
> Environment: Mahout Spark Shell 0.12.0,
> Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1, 
> Centos7 64bit
>Reporter: Edmond Luo
>
> It will be nice to add one more wrapper function like below to 
> org.apache.mahout.math.scalabindings
> {code}
> /**
>  * create a sparse vector out of list of tuple2's with specific 
> cardinality(size),
>  * throws IllegalArgumentException if cardinality is not bigger than required 
> cardinality of sdata
>  * @param cardinality sdata
>  * @return
>  */
> def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
>   val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
>   if (cardinality < required) {
> throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
> bigger than required[%required]!")
>   }
>   val initialCapacity = sdata.size
>   val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
>   sdata.foreach(t ⇒ sv.setQuick(t._1, 
> t._2.asInstanceOf[Number].doubleValue()))
>   sv
> }
> {code}
> So user can specify the cardinality for the created sparse vector.
> This is very useful and convenient if user wants to create a DRM with many 
> sparse vectors and the vectors are not with the same actual size(but with the 
> same logical size, e.g. rows of a sparse matrix).
> Below code should demonstrate the case:
> {code}
> var cardinality = 20
> val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
> (line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
> v2).map(row => (row._1, svec(cardinality, row._2)))
> val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))
> // All element wise opperation will fail for those DRM with not 
> cardinality-consistent SparseVector
> val drm2 = drm + drm
> val drm3 = drm - drm
> val drm4 = drm * drm
> val drm5 = drm / drm
> {code}
> Notice that in the last map, the svec acceptted one more cardinality 
> parameter, so the cardinality of those created SparseVector can be consistent.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


RE: [jira] [Updated] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Andrew Palumbo
Hi Edmond.  Could you open a pull request so that we can review this?

Thank you,

Andy


 Original message 
From: "Edmond Luo (JIRA)" 
Date: 04/19/2016 4:29 AM (GMT-05:00)
To: dev@mahout.apache.org
Subject: [jira] [Updated] (MAHOUT-1833) One more svec function accepting 
cardinality as parameter


 [ 
https://issues.apache.org/jira/browse/MAHOUT-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Edmond Luo updated MAHOUT-1833:
---
Description:
It will be nice to add one more wrapper function like below to 
org.apache.mahout.math.scalabindings

{code}
/**
 * create a sparse vector out of list of tuple2's with specific 
cardinality(size),
 * throws IllegalArgumentException if cardinality is not bigger than required 
cardinality of sdata
 * @param cardinality sdata
 * @return
 */
def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
  val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
  if (cardinality < required) {
throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
bigger than required[%required]!")
  }

  val initialCapacity = sdata.size
  val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
  sdata.foreach(t ⇒ sv.setQuick(t._1, t._2.asInstanceOf[Number].doubleValue()))
  sv
}
{code}

So user can specify the cardinality for the created sparse vector.

This is very useful and convenient if user wants to create a DRM with many 
sparse vectors and the vectors are not with the same actual size(but with the 
same logical size, e.g. rows of a sparse matrix).

Below code should demonstrate the case:
{code}
var cardinality = 20
val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
(line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
v2).map(row => (row._1, svec(cardinality, row._2)))

val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))

// All element wise opperation will fail for those DRM with not 
cardinality-consistent SparseVector
val drm2 = drm + drm
val drm3 = drm - drm
val drm4 = drm * drm
val drm5 = drm / drm
{code}

Notice that in the last map, the svec acceptted one more cardinality parameter, 
so the cardinality of those created SparseVector can be consistent.


  was:
It will be nice to add one more wrapper function like below to 
org.apache.mahout.math.scalabindings

{code}
/**
 * create a sparse vector out of list of tuple2's with specific 
cardinality(size),
 * throws IllegalArgumentException if cardinality is not bigger than required 
cardinality of sdata
 * @param cardinality sdata
 * @return
 */
def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
  val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
  if (cardinality < required) {
throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
bigger than required[%required]!")
  }

  val initialCapacity = sdata.size
  val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
  sdata.foreach(t ⇒ sv.setQuick(t._1, t._2.asInstanceOf[Number].doubleValue()))
  sv
}
{code}

So user can specify the cardinality for the created sparse vector.

This is very useful and convenient if user wants to create a DRM with many 
sparse vectors and the vectors are not with the same actual size(but with the 
same logical size, e.g. rows of a sparse matrix).

Below code should demonstrate the case:
{code}
var cardinality = 20
val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
(line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
v2).map(row => (row._1, svec(cardinality, row._2)))

val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))

// All element wise opperation will fail for those DRM with not 
cardinality-consistent SparseVector
val drm2 = drm + drm
val drm3 = drm - drm
val drm4 = drm * drm
val drm5 = drm / drm
{code}

Notice that in the last map, the svec in above accepts one more parameter, so 
the cardinality of those created SparseVector can be consistent.



> One more svec function accepting cardinality as parameter
> --
>
> Key: MAHOUT-1833
> URL: https://issues.apache.org/jira/browse/MAHOUT-1833
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.12.0
> Environment: Mahout Spark Shell 0.12.0,
> Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1,
> Centos7 64bit
>Reporter: Edmond Luo
>
> It will be nice to add one more wrapper function like below to 
> org.apache.mahout.math.scalabindings
> {code}
> /**
>  * create a sparse vector out of list of tuple2's with specific 
> cardinality(size),
>  * throws IllegalArgumentException if cardinality is not bigger than required 
> cardinality of sdata
>  * @param cardinality sdata
>  * @return
>  */
> def svec(cardinality: Int, sdata: 

[jira] [Updated] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Edmond Luo (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAHOUT-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Edmond Luo updated MAHOUT-1833:
---
Description: 
It will be nice to add one more wrapper function like below to 
org.apache.mahout.math.scalabindings

{code}
/**
 * create a sparse vector out of list of tuple2's with specific 
cardinality(size),
 * throws IllegalArgumentException if cardinality is not bigger than required 
cardinality of sdata
 * @param cardinality sdata
 * @return
 */
def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
  val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
  if (cardinality < required) {
throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
bigger than required[%required]!")
  }

  val initialCapacity = sdata.size
  val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
  sdata.foreach(t ⇒ sv.setQuick(t._1, t._2.asInstanceOf[Number].doubleValue()))
  sv
}
{code}

So user can specify the cardinality for the created sparse vector.

This is very useful and convenient if user wants to create a DRM with many 
sparse vectors and the vectors are not with the same actual size(but with the 
same logical size, e.g. rows of a sparse matrix).

Below code should demonstrate the case:
{code}
var cardinality = 20
val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
(line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
v2).map(row => (row._1, svec(cardinality, row._2)))

val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))

// All element wise opperation will fail for those DRM with not 
cardinality-consistent SparseVector
val drm2 = drm + drm
val drm3 = drm - drm
val drm4 = drm * drm
val drm5 = drm / drm
{code}

Notice that in the last map, the svec acceptted one more cardinality parameter, 
so the cardinality of those created SparseVector can be consistent.


  was:
It will be nice to add one more wrapper function like below to 
org.apache.mahout.math.scalabindings

{code}
/**
 * create a sparse vector out of list of tuple2's with specific 
cardinality(size),
 * throws IllegalArgumentException if cardinality is not bigger than required 
cardinality of sdata
 * @param cardinality sdata
 * @return
 */
def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
  val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
  if (cardinality < required) {
throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
bigger than required[%required]!")
  }

  val initialCapacity = sdata.size
  val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
  sdata.foreach(t ⇒ sv.setQuick(t._1, t._2.asInstanceOf[Number].doubleValue()))
  sv
}
{code}

So user can specify the cardinality for the created sparse vector.

This is very useful and convenient if user wants to create a DRM with many 
sparse vectors and the vectors are not with the same actual size(but with the 
same logical size, e.g. rows of a sparse matrix).

Below code should demonstrate the case:
{code}
var cardinality = 20
val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
(line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
v2).map(row => (row._1, svec(cardinality, row._2)))

val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))

// All element wise opperation will fail for those DRM with not 
cardinality-consistent SparseVector
val drm2 = drm + drm
val drm3 = drm - drm
val drm4 = drm * drm
val drm5 = drm / drm
{code}

Notice that in the last map, the svec in above accepts one more parameter, so 
the cardinality of those created SparseVector can be consistent.



> One more svec function accepting cardinality as parameter 
> --
>
> Key: MAHOUT-1833
> URL: https://issues.apache.org/jira/browse/MAHOUT-1833
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.12.0
> Environment: Mahout Spark Shell 0.12.0,
> Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1, 
> Centos7 64bit
>Reporter: Edmond Luo
>
> It will be nice to add one more wrapper function like below to 
> org.apache.mahout.math.scalabindings
> {code}
> /**
>  * create a sparse vector out of list of tuple2's with specific 
> cardinality(size),
>  * throws IllegalArgumentException if cardinality is not bigger than required 
> cardinality of sdata
>  * @param cardinality sdata
>  * @return
>  */
> def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
>   val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
>   if (cardinality < required) {
> throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
> bigger than required[%required]!")
>   }
>   val initialCapacity = sdata.size
>   val sv = new 

[jira] [Comment Edited] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Edmond Luo (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247368#comment-15247368
 ] 

Edmond Luo edited comment on MAHOUT-1833 at 4/19/16 8:27 AM:
-

I have implemented the new wrapper function as shown above and added some 
testing code for the new function, 
However, I am not sure if I should add some DRM test cases using sparse vector, 
seems now we do not have any test case for those DRM built from sparse vector.


was (Author: resec):
I have implemented all above code and added some testing code for the new 
function, 
However, I am not sure if I should add some DRM test cases using sparse vector, 
seems now we do not have any test case for those DRM built from sparse vector.

> One more svec function accepting cardinality as parameter 
> --
>
> Key: MAHOUT-1833
> URL: https://issues.apache.org/jira/browse/MAHOUT-1833
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.12.0
> Environment: Mahout Spark Shell 0.12.0,
> Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1, 
> Centos7 64bit
>Reporter: Edmond Luo
>
> It will be nice to add one more wrapper function like below to 
> org.apache.mahout.math.scalabindings
> {code}
> /**
>  * create a sparse vector out of list of tuple2's with specific 
> cardinality(size),
>  * throws IllegalArgumentException if cardinality is not bigger than required 
> cardinality of sdata
>  * @param cardinality sdata
>  * @return
>  */
> def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
>   val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
>   if (cardinality < required) {
> throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
> bigger than required[%required]!")
>   }
>   val initialCapacity = sdata.size
>   val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
>   sdata.foreach(t ⇒ sv.setQuick(t._1, 
> t._2.asInstanceOf[Number].doubleValue()))
>   sv
> }
> {code}
> So user can specify the cardinality for the created sparse vector.
> This is very useful and convenient if user wants to create a DRM with many 
> sparse vectors and the vectors are not with the same actual size(but with the 
> same logical size, e.g. rows of a sparse matrix).
> Below code should demonstrate the case:
> {code}
> var cardinality = 20
> val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
> (line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
> v2).map(row => (row._1, svec(cardinality, row._2)))
> val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))
> // All element wise opperation will fail for those DRM with not 
> cardinality-consistent SparseVector
> val drm2 = drm + drm
> val drm3 = drm - drm
> val drm4 = drm * drm
> val drm5 = drm / drm
> {code}
> Notice that in the last map, the svec in above accepts one more parameter, so 
> the cardinality of those created SparseVector can be consistent.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Edmond Luo (JIRA)

[ 
https://issues.apache.org/jira/browse/MAHOUT-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247368#comment-15247368
 ] 

Edmond Luo commented on MAHOUT-1833:


I have implemented all above code and added some testing code for the new 
function, 
However, I am not sure if I should add some DRM test cases using sparse vector, 
seems now we do not have any test case for those DRM built from sparse vector.

> One more svec function accepting cardinality as parameter 
> --
>
> Key: MAHOUT-1833
> URL: https://issues.apache.org/jira/browse/MAHOUT-1833
> Project: Mahout
>  Issue Type: Improvement
>Affects Versions: 0.12.0
> Environment: Mahout Spark Shell 0.12.0,
> Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1, 
> Centos7 64bit
>Reporter: Edmond Luo
>
> It will be nice to add one more wrapper function like below to 
> org.apache.mahout.math.scalabindings
> {code}
> /**
>  * create a sparse vector out of list of tuple2's with specific 
> cardinality(size),
>  * throws IllegalArgumentException if cardinality is not bigger than required 
> cardinality of sdata
>  * @param cardinality sdata
>  * @return
>  */
> def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
>   val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
>   if (cardinality < required) {
> throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
> bigger than required[%required]!")
>   }
>   val initialCapacity = sdata.size
>   val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
>   sdata.foreach(t ⇒ sv.setQuick(t._1, 
> t._2.asInstanceOf[Number].doubleValue()))
>   sv
> }
> {code}
> So user can specify the cardinality for the created sparse vector.
> This is very useful and convenient if user wants to create a DRM with many 
> sparse vectors and the vectors are not with the same actual size(but with the 
> same logical size, e.g. rows of a sparse matrix).
> Below code should demonstrate the case:
> {code}
> var cardinality = 20
> val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
> (line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
> v2).map(row => (row._1, svec(cardinality, row._2)))
> val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))
> // All element wise opperation will fail for those DRM with not 
> cardinality-consistent SparseVector
> val drm2 = drm + drm
> val drm3 = drm - drm
> val drm4 = drm * drm
> val drm5 = drm / drm
> {code}
> Notice that in the last map, the svec in above accepts one more parameter, so 
> the cardinality of those created SparseVector can be consistent.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (MAHOUT-1833) One more svec function accepting cardinality as parameter

2016-04-19 Thread Edmond Luo (JIRA)
Edmond Luo created MAHOUT-1833:
--

 Summary: One more svec function accepting cardinality as parameter 
 Key: MAHOUT-1833
 URL: https://issues.apache.org/jira/browse/MAHOUT-1833
 Project: Mahout
  Issue Type: Improvement
Affects Versions: 0.12.0
 Environment: Mahout Spark Shell 0.12.0,
Spark 1.6.0 Cluster on Hadoop Yarn 2.7.1, 
Centos7 64bit
Reporter: Edmond Luo


It will be nice to add one more wrapper function like below to 
org.apache.mahout.math.scalabindings

{code}
/**
 * create a sparse vector out of list of tuple2's with specific 
cardinality(size),
 * throws IllegalArgumentException if cardinality is not bigger than required 
cardinality of sdata
 * @param cardinality sdata
 * @return
 */
def svec(cardinality: Int, sdata: TraversableOnce[(Int, AnyVal)]) = {
  val required = if (sdata.nonEmpty) sdata.map(_._1).max + 1 else 0
  if (cardinality < required) {
throw new IllegalArgumentException(s"Cardinality[%cardinality] must be 
bigger than required[%required]!")
  }

  val initialCapacity = sdata.size
  val sv = new RandomAccessSparseVector(cardinality, initialCapacity)
  sdata.foreach(t ⇒ sv.setQuick(t._1, t._2.asInstanceOf[Number].doubleValue()))
  sv
}
{code}

So user can specify the cardinality for the created sparse vector.

This is very useful and convenient if user wants to create a DRM with many 
sparse vectors and the vectors are not with the same actual size(but with the 
same logical size, e.g. rows of a sparse matrix).

Below code should demonstrate the case:
{code}
var cardinality = 20
val rdd = sc.textFile("/some/file.txt").map(_.split(",")).map(line => 
(line(0).toInt, Array((line(1).toInt,1.reduceByKey((v1, v2) => v1 ++ 
v2).map(row => (row._1, svec(cardinality, row._2)))

val drm = drmWrap(rdd.map(row => (row._1, row._2.asInstanceOf[Vector])))

// All element wise opperation will fail for those DRM with not 
cardinality-consistent SparseVector
val drm2 = drm + drm
val drm3 = drm - drm
val drm4 = drm * drm
val drm5 = drm / drm
{code}

Notice that in the last map, the svec in above accepts one more parameter, so 
the cardinality of those created SparseVector can be consistent.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)