Re: Jenkins build is back to normal : mahout-nightly » Mahout Integration #1288

2013-07-10 Thread Stevo Slavić
This one is successful again, but just because it ran on different Jenkins node (ubuntu1) which had enough disk space, compared to Jenkins node where it regularly fails (solaris1) which doesn't have that much disk space. MAHOUT-1275 will help with this but there are more things we can do about

Mahout release process

2013-07-10 Thread Stevo Slavić
This is continuation of my and Grant's discussion on https://issues.apache.org/jira/browse/MAHOUT-1275 which I believe is better suited to be continued here on the dev mailing list. Apologies for my ignorance, if this discussion took place earlier in the project lifetime. There is no 0.8 branch

Re: Mahout release process

2013-07-10 Thread Sean Owen
Yes you can do all of this in a branch, which would let things continue to change on HEAD. Otherwise HEAD has to be frozen. I think here there's not enough velocity of change to make freezing HEAD that big of a deal, but yes you could manage the process yourself in a branch if you wanted to. Tags

[jira] [Updated] (MAHOUT-1004) Distributed User-based Collaborative Filtering

2013-07-10 Thread Saleem Ansari (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saleem Ansari updated MAHOUT-1004: -- Attachment: MAHOUT-1004-trunk-rebased-but-tests-fail.patch This patch is to re-base earlier

[jira] [Commented] (MAHOUT-1004) Distributed User-based Collaborative Filtering

2013-07-10 Thread Saleem Ansari (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704407#comment-13704407 ] Saleem Ansari commented on MAHOUT-1004: --- To understand how the user-based

[jira] [Created] (MAHOUT-1277) Lose dependency on custom commons-cli

2013-07-10 Thread Stevo Slavic (JIRA)
Stevo Slavic created MAHOUT-1277: Summary: Lose dependency on custom commons-cli Key: MAHOUT-1277 URL: https://issues.apache.org/jira/browse/MAHOUT-1277 Project: Mahout Issue Type: Bug

[jira] [Updated] (MAHOUT-1277) Lose dependency on custom commons-cli

2013-07-10 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated MAHOUT-1277: - Issue Type: Improvement (was: Bug) Lose dependency on custom commons-cli

[jira] [Created] (MAHOUT-1278) Improve inheritance of Apache parent pom

2013-07-10 Thread Stevo Slavic (JIRA)
Stevo Slavic created MAHOUT-1278: Summary: Improve inheritance of Apache parent pom Key: MAHOUT-1278 URL: https://issues.apache.org/jira/browse/MAHOUT-1278 Project: Mahout Issue Type:

[jira] [Updated] (MAHOUT-1278) Improve inheritance of Apache parent pom

2013-07-10 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated MAHOUT-1278: - Description: We should update dependency on Apache parent pom (currently we depend on version

[jira] [Created] (MAHOUT-1279) The test TestMinHashClustering fails in Mahout core

2013-07-10 Thread Erhan Bagdemir (JIRA)
Erhan Bagdemir created MAHOUT-1279: -- Summary: The test TestMinHashClustering fails in Mahout core Key: MAHOUT-1279 URL: https://issues.apache.org/jira/browse/MAHOUT-1279 Project: Mahout

[jira] [Commented] (MAHOUT-1279) The test TestMinHashClustering fails in Mahout core

2013-07-10 Thread Suneel Marthi (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704618#comment-13704618 ] Suneel Marthi commented on MAHOUT-1279: --- 1. Are you working off of present project

Re: 0.8 progress

2013-07-10 Thread Andrew Musselman
Getting this error when I run the mahout program on a cluster running Hadoop 2.0.0-cdh4.2.1; are we not supporting that new a version of Hadoop? $ ./bin/mahout Running on hadoop, using /usr/bin/hadoop and HADOOP_CONF_DIR= MAHOUT-JOB:

Re: 0.8 progress

2013-07-10 Thread Suneel Marthi
I don't think we are presently supporting Hadoop 2.0.0, still on Hadoop 1.x. Please correct me here. From: Andrew Musselman andrew.mussel...@gmail.com To: dev@mahout.apache.org Sent: Wednesday, July 10, 2013 11:16 AM Subject: Re: 0.8 progress Getting this

Re: 0.8 progress

2013-07-10 Thread Stevo Slavić
In Mahout parent module pom following property is defined: hadoop.version=1.1.2 In Mahout core module pom there are two profiles: profiles profile idhadoop-0.20/id activation property name!hadoop.version/name /property /activation

[jira] [Commented] (MAHOUT-1279) The test TestMinHashClustering fails in Mahout core

2013-07-10 Thread Erhan Bagdemir (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704667#comment-13704667 ] Erhan Bagdemir commented on MAHOUT-1279: Hi Suneel, i just checked out the

Re: Mahout release process

2013-07-10 Thread Jake Mannix
So quick question: is an intentional side-effect of the current release process that when we build on trunk now, we build artifacts named e.g. mahout-examples-0.9-SNAPSHOT-job.jar ? On Wed, Jul 10, 2013 at 2:33 AM, Sean Owen sro...@gmail.com wrote: Yes you can do all of this in a branch, which

Re: Mahout release process

2013-07-10 Thread Andrew Musselman
That's how the maven release plugin does it in my experience, and yes that's what I get now too. On Wed, Jul 10, 2013 at 10:54 AM, Jake Mannix jake.man...@gmail.com wrote: So quick question: is an intentional side-effect of the current release process that when we build on trunk now, we build

Pilot Mentoring Programme with India ICFOSS - Mentor Request Mail

2013-07-10 Thread Reshmi Raji
I am currently persuading my Masters degree ( 2nd year ) from Indian Institute Of Information Technology And Management-Kerala ,India. I am one among the 50 Student Candidate who participated in Pilot Mentoring Programme with India ICFOSS under Mr.Luciano

Re: Mahout release process

2013-07-10 Thread Suneel Marthi
+1 From: Andrew Musselman andrew.mussel...@gmail.com To: dev@mahout.apache.org Sent: Wednesday, July 10, 2013 1:00 PM Subject: Re: Mahout release process That's how the maven release plugin does it in my experience, and yes that's what I get now too. On

Re: Mahout release process

2013-07-10 Thread Suneel Marthi
...not to mention that we are back to executing the tests serially = no more random test failures and longer build times. From: Andrew Musselman andrew.mussel...@gmail.com To: dev@mahout.apache.org Sent: Wednesday, July 10, 2013 1:00 PM Subject: Re: Mahout

Re: Mahout release process

2013-07-10 Thread Jake Mannix
On Wed, Jul 10, 2013 at 10:00 AM, Andrew Musselman andrew.mussel...@gmail.com wrote: That's how the maven release plugin does it in my experience, and yes that's what I get now too. Ok, that's fine if it's intended, but it seems to put us in a little bit of a weird state. We tell our users

Re: Mahout release process

2013-07-10 Thread Andrew Musselman
I have to admit I spent as little time as possible learning how to do maven releases so I don't know the answer to this. On Wed, Jul 10, 2013 at 11:06 AM, Jake Mannix jake.man...@gmail.com wrote: On Wed, Jul 10, 2013 at 10:00 AM, Andrew Musselman andrew.mussel...@gmail.com wrote: That's

[jira] [Work stopped] (MAHOUT-797) MapReduce SSVD: provide alternative B-pipeline per B=R' ^{-1} Y'A

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAHOUT-797 stopped by Dmitriy Lyubimov. MapReduce SSVD: provide alternative B-pipeline per B=R' ^{-1} Y'A

[jira] [Resolved] (MAHOUT-797) MapReduce SSVD: provide alternative B-pipeline per B=R' ^{-1} Y'A

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov resolved MAHOUT-797. - Resolution: Won't Fix Ok, I am punting this for now, this is stale. While it is easy to

[jira] [Created] (MAHOUT-1280) Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
Dmitriy Lyubimov created MAHOUT-1280: Summary: Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix. Key: MAHOUT-1280 URL: https://issues.apache.org/jira/browse/MAHOUT-1280

[jira] [Created] (MAHOUT-1281) Wean distributed SSVD from apache-math dependency.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
Dmitriy Lyubimov created MAHOUT-1281: Summary: Wean distributed SSVD from apache-math dependency. Key: MAHOUT-1281 URL: https://issues.apache.org/jira/browse/MAHOUT-1281 Project: Mahout

Build failed in Jenkins: Mahout-Examples-Cluster-Reuters-II #538

2013-07-10 Thread Apache Jenkins Server
See https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters-II/538/ -- [...truncated 2171 lines...] [INFO] Writing to

[jira] [Updated] (MAHOUT-1280) Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1280: - Attachment: MAHOUT-1280.patch-1 Move out UpperTriangular matrix out of ssvd into

[jira] [Work started] (MAHOUT-1280) Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAHOUT-1280 started by Dmitriy Lyubimov. Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

[jira] [Updated] (MAHOUT-1280) Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1280: - Affects Version/s: 0.8 Status: Patch Available (was: In Progress)

EigenDecomposition

2013-07-10 Thread Dmitriy Lyubimov
It looks like values out of our ported EigenDecomposition are coming out sorted in inverse order. Shouldn't it be the other way around?

Re: EigenDecomposition

2013-07-10 Thread Dmitriy Lyubimov
changing line 329 of EigenDecomposition.java from if (d.getQuick(j) p) { to if (d.getQuick(j) p) { makes my MAHOUT-1281 patch work. should i keep the change? (question for Ted, i guess) thanks. -D On Wed, Jul 10, 2013 at 11:59 AM, Dmitriy Lyubimov

Re: EigenDecomposition

2013-07-10 Thread Dmitriy Lyubimov
Looks like Lanczos is having the same problem and need to undo some workarounds : EigenDecomposition decomp = new EigenDecomposition(triDiag); Matrix eigenVects = decomp.getV(); Vector eigenVals = decomp.getRealEigenvalues(); endTime(TimingSection.TRIDIAG_DECOMP);

[jira] [Updated] (MAHOUT-1280) Move out UpperTriangular matrix out of ssvd into mahout-math. Add SymmetricMatrix.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1280: - Attachment: MAHOUT-1280.patch-2 Move out UpperTriangular matrix out of ssvd into

[jira] [Updated] (MAHOUT-1281) Wean distributed SSVD from apache-math dependency.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1281: - Attachment: MAHOUT-1281.patch-1 SSVDSolver and LanczosSover Tests seem working. also

[jira] [Updated] (MAHOUT-1281) Wean distributed SSVD from apache-math dependency.

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1281: - Affects Version/s: 0.8 Status: Patch Available (was: Open) Wean

Re: Mahout release process

2013-07-10 Thread Dmitriy Lyubimov
i thought maven release:prepare changes from 0.8-SNAPSHOT to 0.8 (and eliminates snapshot dependencies). and release:perform goes from 0.8 to 0.9-SNAPSHOT. I.e. it guarantees that by the time you have 0.9-SNAPSHOT set, you also have a released 0.8 build. but for some reason it is not what is

Re: EigenDecomposition

2013-07-10 Thread Ted Dunning
Please file. Looks completely innocuous and it is good to be standard. On Wed, Jul 10, 2013 at 12:59 PM, Dmitriy Lyubimov dlie...@gmail.comwrote: Looks like Lanczos is having the same problem and need to undo some workarounds : EigenDecomposition decomp = new

Re: Jenkins build is back to normal : mahout-nightly » Mahout Integration #1288

2013-07-10 Thread Ted Dunning
These changes look like a really good idea. That is, except that it might be nice to keep builds for, say, 30 days for reference purposes. Even 10 days would be helpful. On Wed, Jul 10, 2013 at 12:52 AM, Stevo Slavić ssla...@gmail.com wrote: This one is successful again, but just because it

Re: EigenDecomposition

2013-07-10 Thread Dmitriy Lyubimov
fixed as part of MAHOUT-1281 patch now. I will push after code freeze. On Wed, Jul 10, 2013 at 2:06 PM, Ted Dunning ted.dunn...@gmail.com wrote: Please file. Looks completely innocuous and it is good to be standard. On Wed, Jul 10, 2013 at 12:59 PM, Dmitriy Lyubimov dlie...@gmail.com

Re: EigenDecomposition

2013-07-10 Thread Dmitriy Lyubimov
meant, after code freeze is over. On Wed, Jul 10, 2013 at 2:13 PM, Dmitriy Lyubimov dlie...@gmail.com wrote: fixed as part of MAHOUT-1281 patch now. I will push after code freeze. On Wed, Jul 10, 2013 at 2:06 PM, Ted Dunning ted.dunn...@gmail.comwrote: Please file. Looks completely

left/right diagonal matrix multiply not optimized?

2013-07-10 Thread Dmitriy Lyubimov
Hello, it looks like DiagonalMatrix does not do anything special about multiplication (left or right). Seems like a waste (especially if diagonal is a sparse vector). Would it make sense to add an optimized multiplication?

Jenkins build is back to normal : Mahout-Quality #2141

2013-07-10 Thread Apache Jenkins Server
See https://builds.apache.org/job/Mahout-Quality/2141/

Re: left/right diagonal matrix multiply not optimized?

2013-07-10 Thread Ted Dunning
Yes. It definitely would make sense (if people do this). I can see that if multiplication by a diagonal matrix is optimized that this would be a very nice way to express row (left multiplication) or column (right multiplication) scaling or weighting. The only down-side of this approach is that

Re: left/right diagonal matrix multiply not optimized?

2013-07-10 Thread Dmitriy Lyubimov
yes, i need this ok already got it added, will file a jira fo review of the patch -d On Wed, Jul 10, 2013 at 5:44 PM, Ted Dunning ted.dunn...@gmail.com wrote: Yes. It definitely would make sense (if people do this). I can see that if multiplication by a diagonal matrix is optimized that

Re: left/right diagonal matrix multiply not optimized?

2013-07-10 Thread Ted Dunning
Cool. On Wed, Jul 10, 2013 at 5:51 PM, Dmitriy Lyubimov dlie...@gmail.com wrote: yes, i need this ok already got it added, will file a jira fo review of the patch -d On Wed, Jul 10, 2013 at 5:44 PM, Ted Dunning ted.dunn...@gmail.com wrote: Yes. It definitely would make sense (if

[jira] [Created] (MAHOUT-1282) Optimize Diagonal matrix multiplication. add left/right multiply versions

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
Dmitriy Lyubimov created MAHOUT-1282: Summary: Optimize Diagonal matrix multiplication. add left/right multiply versions Key: MAHOUT-1282 URL: https://issues.apache.org/jira/browse/MAHOUT-1282

[jira] [Work started] (MAHOUT-1282) Optimize Diagonal matrix multiplication. add left/right multiply versions

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on MAHOUT-1282 started by Dmitriy Lyubimov. Optimize Diagonal matrix multiplication. add left/right multiply versions

[jira] [Updated] (MAHOUT-1282) Optimize Diagonal matrix multiplication. add left/right multiply versions

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1282: - Attachment: MAHOUT-1282.patch-1 first round on left/right multiplication in Diagonal

[jira] [Updated] (MAHOUT-1282) Optimize Diagonal matrix multiplication. add left/right multiply versions

2013-07-10 Thread Dmitriy Lyubimov (JIRA)
[ https://issues.apache.org/jira/browse/MAHOUT-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitriy Lyubimov updated MAHOUT-1282: - Affects Version/s: 0.8 Status: Patch Available (was: In Progress)