Re: Matrix Market format with metadata file

2016-02-15 Thread Shirish Tatikonda
Ok. Cool. On Mon, Feb 15, 2016 at 4:57 PM, Deron Eriksson wrote: > Very good eye! I used "m = matrix("1 2 3 0 0 0 7 8 9 0 0 0", rows=4, > cols=3)" to generate the mm file, so the 4th row did indeed contain all > zeros. > > > On Mon, Feb 15, 2016 at 4:50 PM, Shirish Tatikonda < > shirish.tatiko..

Re: Matrix Market format with metadata file

2016-02-15 Thread Deron Eriksson
Very good eye! I used "m = matrix("1 2 3 0 0 0 7 8 9 0 0 0", rows=4, cols=3)" to generate the mm file, so the 4th row did indeed contain all zeros. On Mon, Feb 15, 2016 at 4:50 PM, Shirish Tatikonda < shirish.tatiko...@gmail.com> wrote: > Btw (Just to be precise), in your example of "mm" file..

Re: Matrix Market format with metadata file

2016-02-15 Thread Shirish Tatikonda
Btw (Just to be precise), in your example of "mm" file.. the metadata is "4 3 6" but the following non-zero values are only up to row number 3. So, either it was a typo or the 4th row contains all zeros. On Mon, Feb 15, 2016 at 4:26 PM, Shirish Tatikonda < shirish.tatiko...@gmail.com> wrote: >

Re: Matrix Market format with metadata file

2016-02-15 Thread Deron Eriksson
Thank you, Shirish. That makes sense. I'll update the docs to include this information. Deron On Mon, Feb 15, 2016 at 4:26 PM, Shirish Tatikonda < shirish.tatiko...@gmail.com> wrote: > Both "mm" and "text" formats are identical except for a couple of > differences: > > 1) for "mm": the matrix m

Re: Matrix Market format with metadata file

2016-02-15 Thread Shirish Tatikonda
Both "mm" and "text" formats are identical except for a couple of differences: 1) for "mm": the matrix metadata is included in the first two lines; and for "text": the metadata is present in the associated .mtd file 2) "mm" data must be in a single file (i.e., no *part* files) where "text" data ca

Re: Matrix Market format with metadata file

2016-02-15 Thread Deron Eriksson
Hi, I have a question with regards to text vs mm. Isn't the mm coordinate format identical to the text format but the mm data file happens to include the metadata line for rows, cols, and nnzs, so shouldn't they scale the same since the text row values (i,j,v) correspond to the mm rows? If we hav

Re: Matrix Market format with metadata file

2016-02-15 Thread Matthias Boehm
The meta data file is still useful in order to get the format. In case of matrix market, errors will be raised if included meta data is inconsistent. So no, we should not disallow to specify the meta data. In general, we anyway recommend using text (textcell) instead mm (matrix market) for scalabi

Matrix Market format with metadata file

2016-02-15 Thread Deron Eriksson
Hi, The Matrix Market coordinate format contains # rows, # columns, and # non-zero values as metadata near the top of a matrix data file. If I write a matrix in mm format using SystemML, no metadata file is created since the metadata is stored within the data file. However, when reading a matrix

Re: SystemML Notebook docker image

2016-02-15 Thread Sourav Mazumder
I tried that too. But didn't work. Regards, Sourav On Mon, Feb 15, 2016 at 12:27 PM, Deron Eriksson wrote: > Hi Sourav, > > Actually, looking at the error message again, perhaps the issue was that > you need to use your github username for authentication (sourav-mazumder) > rather than the emai

Re: SystemML Notebook docker image

2016-02-15 Thread Deron Eriksson
Hi Sourav, Actually, looking at the error message again, perhaps the issue was that you need to use your github username for authentication (sourav-mazumder) rather than the email address. Thank you for filing the JIRA. Deron On Mon, Feb 15, 2016 at 12:16 PM, Deron Eriksson wrote: > Hi Soura

Re: SystemML Notebook docker image

2016-02-15 Thread Sourav Mazumder
Done. The JIRA is SYSTEMML-519 . Please ensure that the structure /2BCHR4T1Q/notes.json is preserved while adding the same to the relevant folder path /samples/zeppelin-notebooks/. Regards, Sourav On Mon, Feb 15, 2016 at 12:07 PM, Luciano Resen

Re: SystemML Notebook docker image

2016-02-15 Thread Deron Eriksson
Hi Sourav, I see Luciano just offered to handle it if you create a JIRA with the notebook attached. Thank you Luciano. In case you want to do pull requests in the future, there are a couple things you might want to check. 1) If you try "git remote -v", the remote repos should be similar to the f

Re: SystemML Notebook docker image

2016-02-15 Thread Luciano Resende
Sourav, To make things simple, if you could create a jira and attach the notebook, I will handle the rest. On Mon, Feb 15, 2016 at 11:54 AM, Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Hi Deron, > > I tried following your instruction. But while pushing my changes back I'm > getting t

Re: SystemML Notebook docker image

2016-02-15 Thread Sourav Mazumder
Hi Deron, I tried following your instruction. But while pushing my changes back I'm getting the error saying git push --set-upstream origin systemml-zeppelin-spark-example Username for 'https://github.com': sourav.mazumde...@gmail.com Password for 'https://sourav.mazumde...@gmail.com@github.com r

[ANNOUNCE] Apache SystemML 0.9.0-incubating released

2016-02-15 Thread Luciano Resende
The Apache SystemML team is pleased to announce the release of Apache SystemML version 0.9.0-incubating. This is the first release as an Apache project. Apache SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generat