[ANNOUNCE] Apache SystemML 0.14.0-incubating released.

[Arvind Surve]

The Apache SystemML team is pleased to announce the release of ApacheSystemML 
version 0.14.0-incubating.Apache SystemML provides declarative large-scale 
machine learning (ML) thataims at a flexible specification of ML algorithms and 
automatic generationof hybrid runtime plans ranging from single-node, in-memory 
computations,to distributed computations on Apache Hadoop MapReduce and Apache 
Spark.
For detailed information about the updates, please access the release notes.  
https://github.com/apache/incubator-systemml-website/blob/master/0.14.0-incubating/release_notes.md
 
To download the distribution, and learn more about SystemML project, pleasego 
to :
http://systemml.apache.org/
The Apache SystemML Team
---Apache SystemML is an effort undergoing 
Incubation<https://incubator.apache.org/index.html> at The Apache Software 
Foundation(ASF), sponsored by the Incubator. Incubation is required of all 
newlyaccepted projects until a further review indicates that the 
infrastructure,communications, and decision making process have stabilized in a 
mannerconsistent with other successful ASF projects. While incubation status 
isnot necessarily a reflection of the completeness or stability of the code,it 
does indicate that the project has yet to be fully endorsed by the ASF. 
-    
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

Re: New Google Summer of Code 2017 Student - Krishna Kalyan

[Arvind Surve]

Welcome Krishna
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Niketan Pansare <npan...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Friday, May 5, 2017 3:45 PM
 Subject: Re: New Google Summer of Code 2017 Student - Krishna Kalyan
   
Welcome Krishna !!


Krishna Kalyan ---05/05/2017 03:36:59 PM---Thank you so much, Looking forward 
to work with every one in this community. Thank you for all

From: Krishna Kalyan <krishnakaly...@gmail.com>
To: Nakul Jindal <naku...@gmail.com>
Cc: dev@systemml.incubator.apache.org
Date: 05/05/2017 03:36 PM
Subject: Re: New Google Summer of Code 2017 Student - Krishna Kalyan



Thank you so much,
Looking forward to work with every one in this community. Thank you for all
the feedback and this amazing opportunity.

Regards,
Krishna





On May 5, 2017 19:05, "Nakul Jindal" <naku...@gmail.com> wrote:

Hi All,

Let us all welcome Krishna Kalyan as a student of Google Summer of Code to
work on SystemML.
He will be working on automating the performance testing process of
SystemML.

His project proposal is attached and the JIRA tracking his project can be
found at https://issues.apache.org/jira/browse/SYSTEMML-1451

He has already been active with the community (https://www.mail-archive.com/
dev@systemml.incubator.apache.org/msg01209.html) since January.

@Krishna - Even though I am officially the mentor, I encourage you to
address questions to various members of the community with issues you
encounter throughout the project. Dig through Pull Requests and discussions
to figure out who is familiar with which components.

(I can help a bit with my background - I have worked on the DML grammar and
ANTLR parser layer previously and am working on the GPU backend now. I also
ran the perf tests and am somewhat familiar with the work needed to
automate it.)

Welcome!

-Nakul





   

[NOTICE] New Apache SystemML Committer and PPMC Member

[Arvind Surve]

I would like to welcome Felix Schueler as a new
Committer and PPMC member of Apache SystemML.

Thanks for all your work, and welcome !!!

 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

[RESULT][VOTE] Apache SystemML 0.14.0-incubating (RC4) (Correction)

[Arvind Surve]

Correction to following mail:    Members voted are PPMC members, I need to send 
VOTE mail for PMC members soon.
ThanksArvind ---Arvind Surve | Spark Technology Center  | 
http://www.spark.tc/

 
- Forwarded Message -
 From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Monday, May 1, 2017 9:29 AM
 Subject: [RESULT][VOTE] Apache SystemML 0.14.0-incubating (RC4)
   
Vote has passed with 5 +1 binding votes with help from following PPMC members.  
    Matthias Boehm      Glenn Weidner      Arvind Surve      Michael Dusenberry 
     Nakul Jindal
Thanks all for your help
-- Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Wednesday, April 19, 2017 4:17 PM
 Subject: [VOTE] Apache SystemML 0.14.0-incubating (RC4)
  
Please vote on releasing the following candidate as Apache SystemML version 
0.14.0-incubating !
The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.
[ ] +1 Release this package as Apache SystemML 0.14.0-incubating[ ] -1 Do not 
release this package because ...
To learn more about Apache SystemML, please see http://systemml.apache.org/
The tag to be voted on is v0.14.0-incubating-rc4 
(8bdcf106ca9bd04c0f68924ad5827eb7d7d54952)
https://github.com/apache/incubator-systemml/commit/8bdcf106ca9bd04c0f68924ad5827eb7d7d54952

The release artifacts can be found at 
:https://dist.apache.org/repos/dist/dev/incubator/systemml/0.14.0-incubating-rc4/
The maven release artifacts, including signatures, digests, etc. can be found 
at:https://repository.apache.org/content/repositories/orgapachesystemml-1021/org/apache/systemml/systemml/0.14.0-incubating/
=== Apache Incubator release policy 
===Please find below the guide to release 
management during 
incubation:http://incubator.apache.org/guides/releasemanagement.html
= How can I help test this release? 
=If you are a SystemML user, you can 
help us test this release by taking an existing Algorithm or workload and 
running on this release candidate, thenreporting any regressions.
== What justifies a -1 vote for 
this release? ==-1 votes should 
only occur for significant stop-ship bugs or legal related issues (e.g. wrong 
license, missing header files, etc). Minor bugs or regressions should not block 
this release.
 -Arvind
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

   

   

[RESULT][VOTE] Apache SystemML 0.14.0-incubating (RC4)

[Arvind Surve]

Vote has passed with 5 +1 binding votes with help from following PMC members.   
   Matthias Boehm      Glenn Weidner      Arvind Surve      Michael Dusenberry  
    Nakul Jindal
Thanks all for your help
-- Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Wednesday, April 19, 2017 4:17 PM
 Subject: [VOTE] Apache SystemML 0.14.0-incubating (RC4)
   
Please vote on releasing the following candidate as Apache SystemML version 
0.14.0-incubating !
The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.
[ ] +1 Release this package as Apache SystemML 0.14.0-incubating[ ] -1 Do not 
release this package because ...
To learn more about Apache SystemML, please see http://systemml.apache.org/
The tag to be voted on is v0.14.0-incubating-rc4 
(8bdcf106ca9bd04c0f68924ad5827eb7d7d54952)
https://github.com/apache/incubator-systemml/commit/8bdcf106ca9bd04c0f68924ad5827eb7d7d54952

The release artifacts can be found at 
:https://dist.apache.org/repos/dist/dev/incubator/systemml/0.14.0-incubating-rc4/
The maven release artifacts, including signatures, digests, etc. can be found 
at:https://repository.apache.org/content/repositories/orgapachesystemml-1021/org/apache/systemml/systemml/0.14.0-incubating/
=== Apache Incubator release policy 
===Please find below the guide to release 
management during 
incubation:http://incubator.apache.org/guides/releasemanagement.html
= How can I help test this release? 
=If you are a SystemML user, you can 
help us test this release by taking an existing Algorithm or workload and 
running on this release candidate, thenreporting any regressions.
== What justifies a -1 vote for 
this release? ==-1 votes should 
only occur for significant stop-ship bugs or legal related issues (e.g. wrong 
license, missing header files, etc). Minor bugs or regressions should not block 
this release.
 -Arvind
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

   

Re: Build passed/failed messages for pull requests

[Arvind Surve]

Agree, these messages are distractions.
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Matthias Boehm <mboe...@googlemail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Friday, April 28, 2017 11:05 AM
 Subject: Re: Build passed/failed messages for pull requests
   
as I commented on one of these github comments, I'm strongly against 
these kind of unnecessary messages because they distract from the actual 
discussions. I already had to change my notification settings 
accordingly - essentially I'm not watching SystemML's PR activity any 
more.

Regards,
Matthias

On 4/28/2017 10:42 AM, Deron Eriksson wrote:
> Hi,
>
> When a pull request is created or another commit is pushed to that pull
> request, a build including running our test suite is performed (Jenkins at
> https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/).
> This is the same model that other projects such as Apache Spark use
> (Jenkins at
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/).
>
> A few days ago, automated build passed/failed pull request messages were
> introduced to our pull requests, following the same type of Spark model.
> A) SystemML example: https://github.com/apache/incubator-systemml/pull/442
> B) Spark example: https://github.com/apache/spark/pull/17765
>
> Personally I like these messages because for contributors that do pull
> requests, it automatically tells them the status of the build for their
> pull requests and gives them a direct link to the build/test results. An
> opposing viewpoint would be that these messages are somewhat like spam.
>
> So we should make a public decision on the mailing list what to do about
> these automated build status messages.
>
> Some options:
> (1) keep the automated messages exactly as they are
> (2) keep the automated messages, but consolidate the two messages into one
> (such as "Build successful" and "Refer to this link...").
> (3) get rid of the automated messages
>
> I like (2). Any other opinions or options?
>
> Thoughts?
>
> Deron
>
>


   

Re: [VOTE] Apache SystemML 0.14.0-incubating (RC4)

[Arvind Surve]

+1
Completed following verifications   - License and Notice validations   - Binary 
runtime validations    - Source code compilation and runtime validations   - 
Python scripts validations using Python 2 Arvind Surve | Spark Technology 
Center  | http://www.spark.tc/

  From: Glenn Weidner <gweid...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Monday, April 24, 2017 9:30 PM
 Subject: Re: [VOTE] Apache SystemML 0.14.0-incubating (RC4)
   
+1

Successfully ran Linear Regression, Logistic Regression, Naive Bayes, SVM in
Python notebooks with Spark 2.0.2 (in cloud environment) and Spark 2.1 (on 
local test cluster) after pip install of RC4 python artifact
systemml-0.14.0-incubating-python.tgz. Also ran Linear Regression Conjugate 
Gradient in Scala notebooks.

Regards,
Glenn

Matthias Boehm ---04/24/2017 02:02:12 AM---+1 I ran large-scale experiments on 
Spark 2.1 for L2SVM, GLM, MLogreg,

From: Matthias Boehm <mboe...@googlemail.com>
To: dev@systemml.incubator.apache.org
Date: 04/24/2017 02:02 AM
Subject: Re: [VOTE] Apache SystemML 0.14.0-incubating (RC4)



+1

I ran large-scale experiments on Spark 2.1 for L2SVM, GLM, MLogreg,
LinregCG, LinregDS, and PCA over scaled versions of MNIST and ImageNet (up
to 1TB, with uncompressed and compressed linear algebra) without any
issues.

Compared to previous experiments with SystemML 0.11 and Spark 1.6, I've
seen substantial performance improvements of >2x for iterative algorithms
with RDD operations in the inner loop over out-of-core datasets.

Regards,
Matthias

On Wed, Apr 19, 2017 at 4:17 PM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Please vote on releasing the following candidate as Apache SystemML
> version 0.14.0-incubating !
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
> [ ] +1 Release this package as Apache SystemML 0.14.0-incubating[ ] -1 Do
> not release this package because ...
> To learn more about Apache SystemML, please see http://systemml.apache.
> org/
> The tag to be voted on is v0.14.0-incubating-rc4 (
> 8bdcf106ca9bd04c0f68924ad5827eb7d7d54952)
> https://github.com/apache/incubator-systemml/commit/
> 8bdcf106ca9bd04c0f68924ad5827eb7d7d54952
>
> The release artifacts can be found at :https://dist.apache.org/
> repos/dist/dev/incubator/systemml/0.14.0-incubating-rc4/
> The maven release artifacts, including signatures, digests, etc. can
> be found at:https://repository.apache.org/content/repositories/
> orgapachesystemml-1021/org/apache/systemml/systemml/0.14.0-incubating/
> === Apache Incubator release policy
> ===Please find below the guide to
> release management during incubation:http://incubator.apache.org/guides/
> releasemanagement.html
> = How can I help test this
> release? =If you are a SystemML
> user, you can help us test this release by taking an existing Algorithm or
> workload and running on this release candidate, thenreporting any
> regressions.
> == What justifies a -1
> vote for this release? ==-1
> votes should only occur for significant stop-ship bugs or legal
> related issues (e.g. wrong license, missing header files, etc). Minor bugs
> or regressions should not block this release.
>  -Arvind
>  Arvind Surve | Spark Technology Center  | http://www.spark.tc/





   

Re: Branch 0.14 based on SystemML-0.14 RC1 has been deleted

[Arvind Surve]

At this point we are not restricting anyone to put code on SystemML master 
branch unless its breaking backward compatibility.
When we cut RC3, it will be cut based on master branch. So any fixes put since 
RC1 has cut will go in RC3 as well.


 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Deron Eriksson <deroneriks...@gmail.com>
 To: dev@systemml.incubator.apache.org 
Cc: Arvind Surve <ac...@yahoo.com>
 Sent: Thursday, April 13, 2017 2:06 PM
 Subject: Re: Branch 0.14 based on SystemML-0.14 RC1 has been deleted
   
I'm growing a bit concerned about this strategy of not having a 0.14 branch. 
Right now it's been 10 days since RC1 was cut, and RC3 is going to be cut from 
master. I feel this is starting to affect the project moving foward. As an 
example, the Apache Commons CLI PR has still not been merged into master since 
it is waiting on the 0.14 validation and voting to be finished. If it takes 
another total of 10 days for RC3 to be approved (by us and the IPMC), it means 
that during 1/3 of our 2-month release cycle we can't commit forward-thinking 
features on master.
We could easily remedy this with a 0.14 branch when RC3 is cut.
Deron



On Thu, Apr 6, 2017 at 11:40 AM, Luciano Resende <luckbr1...@gmail.com> wrote:

+1

On Thu, Apr 6, 2017 at 9:03 AM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Hi,
> Branch 0.14 based on SystemML-0.14 RC1 has been deleted.
> Going forward unless there is immediate need for a branch, branch based on
>  Release Candidate (RC) won't be created until RC build gets approved.
> -Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/




--
Luciano Resende
http://twitter.com/ lresende1975
http://lresende.blogspot.com/




-- 
Deron ErikssonSpark Technology Centerhttp://www.spark.tc/



   

Branch 0.14 based on SystemML-0.14 RC1 has been deleted

[Arvind Surve]

Hi,
Branch 0.14 based on SystemML-0.14 RC1 has been deleted.
Going forward unless there is immediate need for a branch, branch based on  
Release Candidate (RC) won't be created until RC build gets approved.
-Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/

[VOTE] Apache SystemML 0.14.0-incubating (RC2)

[Arvind Surve]

Please vote on releasing the following candidate as Apache SystemML version 
0.14.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.14.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.14.0-incubating-rc2 
(16245f3b2001695fd596a20ddab5f4fb6c43dae3)

https://github.com/apache/incubator-systemml/commit/16245f3b2001695fd596a20ddab5f4fb6c43dae3

The release artifacts can be found at :
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.14.0-incubating-rc2/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1019/org/apache/systemml/systemml/0.14.0-incubating/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.
 -Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/

[VOTE] Apache SystemML 0.14.0-incubating (RC1)

[Arvind Surve]

Please vote on releasing the following candidate as Apache SystemML version 
0.14.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.14.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.14.0-incubating-rc1 
(c8b71564edd99ef4dc8c4ff52ca75986ca617db4)

https://github.com/apache/incubator-systemml/commit/c8b71564edd99ef4dc8c4ff52ca75986ca617db4

The release artifacts can be found at :
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.14.0-incubating-rc1/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1018/org/apache/systemml/systemml/0.14.0-incubating/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.
 -Arvind
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

SystemML 0.14 release build plan

[Arvind Surve]

Hi,
We will be building SystemML 0.14 on Monday 04/03/2017 PST.
Please plan on getting your changes by EOW 04/02/2017 PST 
Thanks,    
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

 
   

Re: Release cadence

[Arvind Surve]

We have released SystemML 0.13, first code based on Spark 2.0.x, on March 2nd 
2017.Some users may have transformed to SystemML 0.13 with some effort. Its not 
good idea to go out immediately with SystemML 1.0 as it has high potential to 
break backward compatibility.In that case, SystemML 0.13 users who need to get 
later version/fix, they have to go with additional changes due to losing 
backward compatibility.
To avoid immediate burden on current users I am proposing following.
Lets cut SystemML 0.14 branch with current changes based on master branch.Then 
onward master branch can be used to do changes specific to SystemML 1.0 based 
code and any fixes based on current code.Whoever add any fix to SystemML 1.0 
(master branch then) will need to put fixes on SystemML 0.14 branch as well as 
applicable to SystemML 0.13 code.Features added in SystemML 1.0 (master branch 
then) should not go into SystemML 0.14 branch.
If there is no disagreement, then I will create new release SystemML 0.14 on 
03/30/2017. Please make sure to get your code in by EOD 03/29/2017.
-Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Berthold Reinwald <reinw...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Sunday, March 12, 2017 5:54 PM
 Subject: Re: Release cadence
   
i am fine with 1.0 but let us stage it in a way that back porting of 
possible bug fixes will not be too difficult in the next few weeks or 
small nbr of month.

Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinw...@us.ibm.com



From:  Matthias Boehm <mboe...@googlemail.com>
To:    dev@systemml.incubator.apache.org
Date:  03/12/2017 05:15 PM
Subject:        Re: Release cadence



ok great - as the majority is in favor of a 1.0 release and there is no
veto, I think we came to an agreement here: our next release will be
SystemML 1.0.

Regards,
Matthias


On Tue, Mar 7, 2017 at 11:30 AM, <dusenberr...@gmail.com> wrote:

> +1 for immediately starting work on SystemML 1.0 as our next release.
>
> At this point, the project and our users will benefit most from a 
thorough
> cleanup, as it will make the project simpler to use and easier to
> maintain.  Simplicity will allow users and maintainers to regain focus 
on
> ML research and products, which is a win for the entire community.  We
> should create a solid list of items that we, and the rest of the 
community,
> want to address for the 1.0 release and make sure that they are indeed
> completed.  At the same time, we should ensure that we don't drag out 
the
> release process.
>
> -Mike
>
> --
>
> Mike Dusenberry
> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/mikedusenberry
>
> Sent from my iPhone.
>
>
> > On Mar 6, 2017, at 10:14 AM, Luciano Resende <luckbr1...@gmail.com>
> wrote:
> >
> > +1 for SystemML 1.0 as the next release.
> >
> > On Sat, Mar 4, 2017 at 10:23 AM, Deron Eriksson 
<deroneriks...@gmail.com
> >
> > wrote:
> >
> >> Personally I would like the next release to be 1.0. We have been an
> >> incubator project since November 2015 and I believe that after over
> 1,000
> >> commits since then that the project is about ready for a 1.0 release.
> >>
> >> I agree with Matthias that we need to make a decision regarding this
> topic.
> >> For new issues and fixed issues in JIRA, we need to be able to assign
> the
> >> correct version, or else someone potentially needs to go through and 
fix
> >> the version numbers, as Glenn has been doing. Additionally, it would 
be
> >> nice to do some of the 1.0 code updates (such as removing the old
> >> MLContext) now rather than waiting additional months. Also I would 
like
> to
> >> be able to correctly identify our next version in the online
> documentation.
> >>
> >>
> > How about just make SystemML Next and change the release name when we 
do
> > the release ?
> >
> >
> >
> >> Deron
> >>
> >>
> >> On Sat, Mar 4, 2017 at 12:47 AM, Matthias Boehm 
<mboe...@googlemail.com
> >
> >> wrote:
> >>
> >>> thanks Arvind for bringing some structure to the release process. I
> >> think a
> >>> fixed cadence of 2 months is useful as it makes upcoming releases 
more
> >>> predictable for devs and users.
> >>>
> >>> However, we're discussing a major 1.0 release for a while now. I 
think
> it
> >>> would be useful to come to an agreement if we go for 1.0 in April or
> not.
> >>> There are some pending changes such as removing the old MLContext,
> >> removing
> >>> the file-based tran

Re: GSoc 2017

[Arvind Surve]

Thanks Krishna for your interest.
Unfortunately we could not submit topic to GSoc on time.However please feel 
free to leverage SystemML for your use cases and do possible contribution to 
SystemML.
Please let us know if you have any question.
 
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Krishna Kalyan <krishnakaly...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Saturday, March 18, 2017 8:18 AM
 Subject: Re: GSoc 2017
   
Hello All,
A Gentle ping. Student applications open in a couple of days. I like to
work on 'Support for Python DSLs'.
However for now I am not sure on how to proceed.

Thank you,
Krishna

On Thu, Jan 12, 2017 at 6:08 PM, <dusenberr...@gmail.com> wrote:

> Yeah helping to build out our Python DSL into a full-out replacement for
> the current "DML" language would be great, and we'd be quite supportive!
>
> -Mike
>
> --
>
> Mike Dusenberry
> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/mikedusenberry
>
> Sent from my iPhone.
>
>
> > On Jan 12, 2017, at 2:58 PM, fschue...@posteo.de wrote:
> >
> > Hi Krishna,
> >
> > cool to see that you're interested in SystemML!
> >
> > From your list I personally think that a) and d) would be well suited
> for projects, especially a good python DSL is a high priority.
> >
> > We will apply as an organization to GSoC once organization applications
> are open (Jan. 19th) and I think we will find mentors for at least a) and
> d). If you already want to take a look at what is currently there, I
> suggest to look at our python APIs and documentation. If you want to take
> on the DSL project it might also be a good idea to look into the DML
> documentation and related papers to see what we need to support.
> >
> > The proposals will probably circulate on the mailinglist, too, so keep
> an eye on that :)
> >
> > -Felix
> >
> > Am 12.01.2017 23:13 schrieb Krishna Kalyan:
> >> Hello All,
> >> Thank you for your wonderful replies.
> >> Tasks that I am interested in:
> >> a) Support for Python DSLs
> >> b) Python wrappers for all existing algorithms
> >> c) GPU support
> >> d) Perftest : automated performance tests of algorithms
> >> I am also willing to work on the tasks that SystemML community think are
> >> important.
> >> Regards,
> >> Krishna
> >> On Fri, Jan 6, 2017 at 10:14 PM, Mike Dusenberry <
> dusenberr...@gmail.com>
> >> wrote:
> >>> Hi Krishna!  Welcome, and thanks for your interest!
> >>> We would definitely be excited to collaborate with you on a GSOC
> project.
> >>> We've started another thread to discuss possible new proposals, and we
> >>> would also be quite interested in any particular proposal that you
> might
> >>> like to generate tailored towards your interests.  Copied from the
> other
> >>> thread, some possible ideas could include: building out a full ML demo
> to
> >>> solve a real, large-scale problem that would benefit from a distributed
> >>> approach; overall performance improvements that address a full class,
> or
> >>> wider area, of ML algorithms, rather than a single, specific script;
> >>> infrastructure for [performance] testing, and identification of wide
> areas
> >>> of improvement; helping with building out fully-featured, clean,
> >>> well-tested DSLs in Python & Scala (we've started, but it would be
> good to
> >>> continue stressing them -- we could even aim to replace DML with the
> DSLs);
> >>> etc.  Overall, we want to improve the ability of the user to work on a
> wide
> >>> range of large-scale, distributed ML problems in a simple and easy
> manner
> >>> on top of Spark.
> >>> In the meantime, you could explore our recent open issues [1] and even
> >>> begin discussions or contributions on any of the items.  You could also
> >>> view our recent roadmap discussion thread on the mailing list, starting
> >>> with the first email [2]:
> >>> [1]:
> >>> https://issues.apache.org/jira/issues/?jql=project%20%3D%
> 20SYSTEMML%20AND%
> >>> 20resolution%20%3D%20Unresolved%20ORDER%20BY%20updated%20DESC%2C%
> >>> 20priority%20DESC
> >>> [2]:
> >>> http://mail-archives.apache.org/mod_mbox/incubator-
> >>> systemml-dev/201701.mbox/%3C9eb780f0-ff28-c702-117c-
> >>> bad740599...@gmail.com%3E
> >>> - Mike
> >>> --
> >>> Michael W. Dusenberry
> >>> GitHub: github.com/

Re: Next Steps in the graduation process

[Arvind Surve]

There is typo in last name of DB, instead of Tsai its listed as Tsa
-- Arvind Surve | Spark Technology 
Center  | http://www.spark.tc/

  From: Luciano Resende <luckbr1...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Friday, March 10, 2017 2:14 PM
 Subject: Re: Next Steps in the graduation process
   
I have updated the community/project portion of the SystemML podling page

http://incubator.apache.org/projects/systemml.html

Please take a look and let me know if I missed anything.


On Wed, Mar 8, 2017 at 11:47 AM, Luciano Resende <luckbr1...@gmail.com>
wrote:

> Great, thank you for the link correction...
>
> On Tue, Mar 7, 2017 at 10:48 PM, Matthias Boehm <mboe...@googlemail.com>
> wrote:
>
>> I could help doing this assessment. Btw, here is a working link:
>> https://community.apache.org/apache-way/apache-project-matur
>> ity-model.html
>>
>> Regards,
>> Matthias
>>
>> On Tue, Mar 7, 2017 at 1:38 PM, Luciano Resende <luckbr1...@gmail.com>
>> wrote:
>>
>> > On Tue, Mar 7, 2017 at 11:59 AM, Arvind Surve <ac...@yahoo.com.invalid>
>> > wrote:
>> >
>> > > I will start looking at discussion and drafting a board resolution for
>> > > SystemML as a TLP project Arvind Surve | Spark Technology Center  |
>> > > http://www.spark.tc/
>> > >
>> > >
>> > Thank you,
>> >
>> > We might also need a Maturity Model assessment, any other volunteer that
>> > could help with the task?
>> >
>> > Here is some documentation about MM
>> > https://community.apache.org/apache-way/apache-project-matur
>> ity-model.htm
>> >
>> > And here is an example from another podling that is working on
>> graduating
>> > as well
>> > https://cwiki.apache.org/confluence/pages/viewpage.action?
>> pageId=68714623
>> >
>> > --
>> > Luciano Resende
>> > http://twitter.com/lresende1975
>> > http://lresende.blogspot.com/
>> >
>>
>
>
>
> --
> Luciano Resende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
>



-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


   

Re: [DISCUSS] Board resolution for SystemML as a TLP project

[Arvind Surve]

Thanks Luciano,
I have to include Nakul's name in the initial member list.
 * Nakul Jindal          <naku...@apache.org>

 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Luciano Resende <luckbr1...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Wednesday, March 8, 2017 11:44 AM
 Subject: Re: [DISCUSS] Board resolution for SystemML as a TLP project
   
Minor change on first paragraph:



    WHEREAS, the Board of Directors deems it to be in the best
    interests of the Foundation and consistent with the
    Foundation's purpose to establish a Project Management
    Committee charged with the creation and maintenance of
    open-source software, for distribution at no charge to the
    public, related to declarative, large-scale machine learning.


    NOW, THEREFORE, BE IT RESOLVED, that a Project Management
    Committee (PMC), to be known as the "Apache SystemML Project", be
    and hereby is established pursuant to Bylaws of the Foundation;
    and be it further

    RESOLVED, that the Apache SystemML Project be and hereby is
    responsible for the creation and maintenance of software related to
    declarative, large-scale machine learning.

    RESOLVED, that the office of "Vice President, Apache SystemML" be and
    hereby is created, the person holding such office to serve at the
    direction of the Board of Directors as the chair of the Apache
    SystemML Project, and to have primary responsibility for management of
    the projects within the scope of responsibility of the Apache SystemML
    Project; and be it further

    RESOLVED, that the persons listed immediately below be and hereby are
    appointed to serve as the initial members of the Apache SystemML
    Project:

        * Alexandre V Evfimievski  <ae2...@apache.org>
        * Arvind Surve              <ac...@apache.org>
        * Berthold Reinwald        <reinw...@apache.org>
        * DB Tsai                  <dbt...@apache.org>
        * Deron Eriksson            <de...@apache.org>
        * Faraz Makari              <fmak...@apache.org>
        * Fred Reiss                <fre...@apache.org>
        * Glenn Weidner            <gweid...@apache.org>
        * Henry Saputra            <hsapu...@apache.org>
        * Holden Karau              <hol...@apache.org>
        * Joseph Bradley            <jkbrad...@apache.org>
        * Luciano Resende          <lrese...@apache.org>
        * Matthias Boehm            <mboe...@apache.org>
        * Mike Dusenberry          <dusenberr...@apache.org>
        * Niketan Pansare          <niketanpans...@apache.org>
        * Patrick Wendell          <pwend...@apache.org>
        * Prithviraj Sen            <prit...@apache.org>
        * Reynold Xin              <r...@apache.org>
        * Rich Bowen                <rbo...@apache.org>
        * Shirish Tatikonda        <shiri...@apache.org>
        * Xiangrui Meng            <m...@apache.org>

    NOW, THEREFORE, BE IT FURTHER RESOLVED, that XXX be appointed to the
    office of Vice President, Apache SystemML, to serve in accordance with
    and subject to the direction of the Board of Directors and the Bylaws
    of the Foundation until death, resignation, retirement, removal or
    disqualification, or until a successor is appointed; and be it further

    RESOLVED, that the initial Apache SystemML PMC be and hereby is tasked
    with the creation of a set of bylaws intended to encourage open
    development and increased participation in the Apache SystemML
    Project; and be it further

    RESOLVED, that the Apache SystemML Project be and hereby is tasked
    with the migration and rationalization of the Apache Incubator
    SystemML podling; and be it further

    RESOLVED, that all responsibilities pertaining to the Apache Incubator
    SystemML podling encumbered upon the Apache Incubator PMC are hereafter
    discharged.


-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


   

Re: Next Steps in the graduation process

[Arvind Surve]

I will start looking at discussion and drafting a board resolution for SystemML 
as a TLP project Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Luciano Resende <luckbr1...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Tuesday, March 7, 2017 11:26 AM
 Subject: Next Steps in the graduation process
   
I am going to start a formal community vote for graduation, and in
parallel, update our project incubator page.

Could someone please help with the discussion and drafting a board
resolution for SystemML as a TLP project (see details below)

http://incubator.apache.org/guides/graduation.html#tlp-resolution


We will also need to identify a project chair (see responsibilities below)

https://www.apache.org/dev/pmc.html#chair

-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


   

Re: Dropping Java 6 and 7 support

[Arvind Surve]

+1 on dropping support for Java 6 and Java 7. Arvind Surve | Spark Technology 
Center  | http://www.spark.tc/

  From: Nakul Jindal <naku...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Tuesday, March 7, 2017 11:27 AM
 Subject: Re: Dropping Java 6 and 7 support
   
+1

-Nakul

On Tue, Mar 7, 2017 at 11:13 AM, <dusenberr...@gmail.com> wrote:

> +1
>
> --
>
> Mike Dusenberry
> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/mikedusenberry
>
> Sent from my iPhone.
>
>
> > On Mar 7, 2017, at 10:49 AM, Niketan Pansare <npan...@us.ibm.com> wrote:
> >
> > +1
> >
> > Thanks,
> >
> > Niketan Pansare
> > IBM Almaden Research Center
> > E-mail: npansar At us.ibm.com
> > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar
> >
> > Berthold Reinwald---03/06/2017 11:16:19 PM---+1 on removing java 6 and
> 7. Regards,
> >
> > From: Berthold Reinwald/Almaden/IBM@IBMUS
> > To: dev@systemml.incubator.apache.org
> > Date: 03/06/2017 11:16 PM
> > Subject: Re: Dropping Java 6 and 7 support
> >
> >
> >
> >
> > +1 on removing java 6 and 7.
> >
> > Regards,
> > Berthold Reinwald
> > IBM Almaden Research Center
> > office: (408) 927 2208; T/L: 457 2208
> > e-mail: reinw...@us.ibm.com
> >
> >
> >
> > From:  Matthias Boehm <mboe...@googlemail.com>
> > To:    dev@systemml.incubator.apache.org
> > Date:  03/06/2017 10:58 PM
> > Subject:        Dropping Java 6 and 7 support
> >
> >
> >
> > Hi all,
> >
> > I'd like to drop the support for Java 6 and 7 in our SystemML 1.0
> release.
> > Our build still refers to a java compliance level 6, which has not been
> > changed for more than 5 years now. Spark >= 1.5 anyway requires Java 7
> and
> > there has been some discussion on removing Java 7 as well because it
> > reached end of life in April 2015. Moving to Java 8 would allow us to
> > modernize the code base going forward and the 1.0 release would be the
> > perfect time for this change.
> >
> > Regards,
> > Matthias
> >
> >
> >
> >
> >
> >
> >
>


   

Re: Release cadence

[Arvind Surve]

I am not in disagreement with Matthias' point regarding removing code which no 
longer need to be supported and need additional effort to do maintenance.At the 
same time we need to avoid burden on users. Burden on users should be avoided 
at possible extent.

We have recently released SystemML 0.12 in end of Nov (Spark 1.x based) and 
SystemML 0.13 end of last week (Spark 2.x based).It will be harder for SystemML 
0.13 (and more harder for SystemML 0.12) to move to SystemML 1.0 immediately 
due to code and interface change.
To minimize impact to SystemML 0.12 and/or SystemML 0.13 users we have to back 
port code to these releases. We may need to decide how much back port needed on 
each of these releases. 
Once we break backward compatibility, maintenance will be even much harder (one 
or both releases) than to do maintain current code which to be removed.
>From users convenience I prefer to go with one or two additional releases 
>without breaking backward compatibility.

Note: If we go with code freeze by April 20, and breaking backward 
compatibility, I foresee this release will drag till end of May if not more.    
      Lets keep release cycle for 2 months. 
--- 
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Deron Eriksson <deroneriks...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Saturday, March 4, 2017 10:23 AM
 Subject: Re: Release cadence
   
Personally I would like the next release to be 1.0. We have been an
incubator project since November 2015 and I believe that after 1,000
commits since then that the project is about ready for a 1.0 release.

I agree with Matthias that we need to make a decision regarding this topic.
For new issues and fixed issues in JIRA, we need to be able to assign the
correct version, or else someone potentially needs to go through and fix
the version numbers, as Glenn has been doing. Additionally, it would be
nice to do some of the 1.0 code updates (such as removing the old
MLContext) now rather than waiting additional months. Also I would like to
be able to correctly identify our next version in the online documentation.

Deron


On Sat, Mar 4, 2017 at 12:47 AM, Matthias Boehm <mboe...@googlemail.com>
wrote:

> thanks Arvind for bringing some structure to the release process. I think a
> fixed cadence of 2 months is useful as it makes upcoming releases more
> predictable for devs and users.
>
> However, we're discussing a major 1.0 release for a while now. I think it
> would be useful to come to an agreement if we go for 1.0 in April or not.
> There are some pending changes such as removing the old MLContext, removing
> the file-based transform, isolating the matrix block library, and some
> language changes that should only be addresses in a major release as they
> break backwards compatibility. Right now, we can't touch these changes
> without knowing the target release.
>
> Personally, I don't see a good reason why we should wait. Postponing this
> major release just creates unnecessary overhead in maintaining these old
> components that will be removed eventually. Since we cut RC for 0.13 on Feb
> 20, I think having an RC around April 20 would be a good target for this
> 1.0 release.
>
>
> Regards,
> Matthias
>
>
> On Fri, Mar 3, 2017 at 5:44 PM, Arvind Surve <ac...@yahoo.com.invalid>
> wrote:
>
> > Based on last couple of release cycles, we will continue with 2 months
> > release cycles.We will do first RC build by end of first week of second
> > month.
> > We will plan on releasing next release by end of April 2017.We will have
> > RC build on ~April 6th.  -Arvind
> > Arvind Surve | Spark Technology Center  | http://www.spark.tc/
> >
> >      From: Acs S <ac...@yahoo.com.INVALID>
> >  To: "dev@systemml.incubator.apache.org" <dev@systemml.incubator.
> > apache.org>
> >  Sent: Monday, January 9, 2017 11:41 AM
> >  Subject: Re: Release cadence
> >
> > We need to release SystemML on more frequent basis to get community
> > engaged. It will provide us more feedback on functionality we add.While
> > releasing SystemML on monthly basis is challenge due to longer phase of
> > validation process we need to find a way to be quicker.
> > I can propose options to get closer to monthly release if acceptable.
> > Make every two releases available on monthly basis and third on two
> months
> > basis. This cycle will continue.
> > 1. Do minimal testing on two releases (minor releases) and release them
> on
> > monthly basis. Performance testing is one of the major time consuming
> > activity especially for larger data size. We can limit testing only upto
> > 80GB. We can do code freeze (other than fixes) at the

Re: Release cadence

[Arvind Surve]

Based on last couple of release cycles, we will continue with 2 months release 
cycles.We will do first RC build by end of first week of second month.
We will plan on releasing next release by end of April 2017.We will have RC 
build on ~April 6th.  -Arvind
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Acs S <ac...@yahoo.com.INVALID>
 To: "dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org> 
 Sent: Monday, January 9, 2017 11:41 AM
 Subject: Re: Release cadence
   
We need to release SystemML on more frequent basis to get community engaged. It 
will provide us more feedback on functionality we add.While releasing SystemML 
on monthly basis is challenge due to longer phase of validation process we need 
to find a way to be quicker.
I can propose options to get closer to monthly release if acceptable.
Make every two releases available on monthly basis and third on two months 
basis. This cycle will continue.
1. Do minimal testing on two releases (minor releases) and release them on 
monthly basis. Performance testing is one of the major time consuming activity 
especially for larger data size. We can limit testing only upto 80GB. We can do 
code freeze (other than fixes) at the end of third week and do verification on 
last week. If we find any issues we can still release the code with limitation 
documented unless issue breaks major functionality.2. Do comprehensive testing 
on third release.   This will include performance testing for all data size and 
every other testing we do. We can do code freeze (other than fixes) at the end 
of third week and start verification of code. All issues found will be 
addressed. Exception will be considered.

Meantime we need to start automating testing pieces.

Arvind SurveSpark Technology Centerhttp://www.spark.tc/

      From: Berthold Reinwald <reinw...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Saturday, January 7, 2017 1:35 AM
 Subject: Re: Release cadence
  
I think that a 2 month cycle would be a good compromise for major/minor 
releases. Fixpack release could be at a 1 month cycle.


Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinw...@us.ibm.com



From:  Deron Eriksson <deroneriks...@gmail.com>
To:    dev@systemml.incubator.apache.org
Date:  01/05/2017 02:14 PM
Subject:        Re: Release cadence



+1 for trying out a 1 month release cycle.

However, I highly agree with Matthias that there is a lot of overhead with
releases, so it would be good if we can work to streamline/automate the
process as much as possible. Also, it would be good to distribute the 
tasks
around as much as possible. This can result in cross-training and help
avoid overburdening the same contributors each month.

If the overhead slows us down too much, then we can go to a slower release
cycle.

Deron




On Thu, Jan 5, 2017 at 1:50 PM, <dusenberr...@gmail.com> wrote:

> +1 for adopting a 1 month release cycle.
>
> --
>
> Mike Dusenberry
> GitHub: github.com/dusenberrymw
> LinkedIn: linkedin.com/in/mikedusenberry
>
> Sent from my iPhone.
>
>
> > On Jan 5, 2017, at 1:35 PM, Luciano Resende <luckbr1...@gmail.com>
> wrote:
> >
> > On Thu, Jan 5, 2017 at 6:05 AM, Matthias Boehm 
<mboe...@googlemail.com>
> > wrote:
> >
> >> In general, I like the idea of aiming for consistent release cycles.
> >> However, every month is just too much, at least for me. There is a
> >> considerable overhead associated with each release for end-to-end
> >> performance tests, tests on different environments, code freeze for 
new
> >> features, etc. Hence, a too short release cycle would not be "agile" 
but
> >> would actually slow us down. From my perspective, a realistic release
> >> cadence would be 2-3 months, maybe a bit more for major releases.
> >>
> >>
> > 2-3 months of release cadence for an open source is probably a long
> > stretch, particular for a project that does not have very large set of
> 3rd
> > party dependencies.
> >
> > As for some of the overhead issues you mentioned, they are probably 
easy
> to
> > workaround:
> >
> > - code-freeze timeframe can be resolved with branches
> > - end-to-end performance regressions can be avoided by better code
> review,
> > and if you were willing to go with 2-3 months without performing these
> > tests, we could perform them only for major releases, and proactively
> > quickly build a minor release with the patch when a user report any
> > performance regression.
> >
> >
> > Anyway, I would really like to see SystemML more agile with regards to
> its
> > release process because, as I mentioned before, the release early,
&g

Re: Location of the website source code?

[Arvind Surve]

Hi Henry,
Please find link provided below.

https://github.com/apache/incubator-systemml-website


Link is shown in systemml website drop down as well.
-Arvind 

Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Thursday, March 2, 2017 8:54 AM
 Subject: Location of the website source code?
   
Hi Guys,

I can not find the information about the source code location for the
SystemML website.

I believe it is in SVN or is it using Git repo?

Thanks,

- Henry


   

[RESULT] [VOTE] Apache SystemML 0.13.0-incubating (RC2)

[Arvind Surve]

Thanks all for doing validation of SysrtemML 0.13 RC2.
Vote has passed with +1 binding votes from       Deron Eriksson       Nakul 
Jindal       Michael Dusenberry       Matthias Brehm       Glenn Wiedner       
Niketan Pansare       Arvind Surve

   +1 from non-binding votes       Imran Younus       Felix Schüler
I will send VOTE mail for PMC voting shortly.
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Wednesday, February 22, 2017 7:23 PM
 Subject: [VOTE] Apache SystemML 0.13.0-incubating (RC2)
  
Please vote on releasing the following candidate as Apache SystemML version 
0.13.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.13.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.13.0-incubating-rc2 
(ff3e741694e507f64a6b52ee71638bddecabe7af)

https://github.com/apache/incubator-systemml/commit/ff3e741694e507f64a6b52ee71638bddecabe7af

The release artifacts can be found at :
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.13.0-incubating-rc2/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1017/org/apache/systemml/systemml/0.13.0-incubating/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.
 -Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/

   

Re: [VOTE] Apache SystemML 0.13.0-incubating (RC2)

[Arvind Surve]

+1
 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: "dusenberr...@gmail.com" <dusenberr...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Monday, February 27, 2017 4:05 PM
 Subject: Re: [VOTE] Apache SystemML 0.13.0-incubating (RC2)
   
+1

Installed the Python package using the URL and ran a quick sanity test using 
MLContext.  The Python package is installed correctly, and the JAR is 
seamlessly installed in the background as desired.

--

Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry

Sent from my iPhone.


> On Feb 23, 2017, at 1:46 PM, Nakul Jindal <naku...@gmail.com> wrote:
> 
> +1
> 
> Basic sanity tests pass on Mac.
> 
> On Thu, Feb 23, 2017 at 1:14 PM, Deron Eriksson <deroneriks...@gmail.com>
> wrote:
> 
>> +1
>> 
>> Performed the following validations for artifacts at
>> https://dist.apache.org/repos/dist/dev/incubator/systemml/0.
>> 13.0-incubating-rc2/
>> :
>> 
>> 1. -bin.tgz/-bin.zip contain disclaimer, license, notice
>> 2. -bin.tgz/-bin.zip licenses reference all included dependencies with
>> correct licenses
>> 3. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar contains
>> disclaimer, license, notice
>> 3. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar contains antlr
>> runtime and wink classes
>> 4. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar license references
>> antlr runtime and wink
>> 5. -python.tgz contains disclaimer, license notice
>> 6. -python.tgz license references antlr runtime and wink with correct
>> licenses
>> 7. -python.tgz systemml/systemml-java/systemml-0.13.0-incubating.jar
>> contains disclaimer, license, notice
>> 8. -python.tgz systemml/systemml-java/systemml-0.13.0-incubating.jar
>> contains antlr runtime and wink classes
>> 9. -python.tgz systemml/systemml-java/systemml-0.13.0-incubating.jar
>> license references antlr runtime and wink
>> 10. -src.tgz/-src.zip contain disclaimer, license, notice
>> 11. -src.tgz/-src.zip licenses reference all included projects (jquery,
>> etc) with correct licenses
>> 12. -src.tgz/-src.zip contain no binaries (dll, exe, pdb, lib)
>> 13. -src.tgz/-src.zip build project artifacts (mvn clean package -P
>> distribution)
>> 14. -src.tgz/-src.zip SystemML jar runs (hello world)
>> 15. -src.tgz/-src.zip test suite runs (mvn verify)
>> 16. -bin.tgz/-bin.zip runStandaloneSystemML.sh (hello world)
>> 17. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar spark-submit
>> 2.0.2
>> (hello world)
>> 18. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar spark-submit
>> 2.1.0
>> (hello world)
>> 19. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar hadoop 2.7 (hello
>> world)
>> 20. -bin.tgz/-bin.zip runStandaloneSystemML.sh (univar stats, haberman
>> data)
>> 21. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar spark-submit
>> 2.0.2
>> (univar stats, generated data)
>> 22. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar spark-submit
>> 2.1.0
>> (univar stats, generated data)
>> 23. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar hadoop 2.7
>> default
>> exec mode (univar stats, generated data)
>> 24. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar hadoop 2.7 hadoop
>> exec mode (univar stats, generated data)
>> 25. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar MLContext
>> spark-shell 2.0.2 (univar stats, haberman data)
>> 26. -bin.tgz/-bin.zip lib/systemml-0.13.0-incubating.jar MLContext
>> spark-shell 2.1.0 (univar stats, haberman data)
>> 
>> 
>> 
>> On Wed, Feb 22, 2017 at 7:23 PM, Arvind Surve <ac...@yahoo.com.invalid>
>> wrote:
>> 
>>> Please vote on releasing the following candidate as Apache SystemML
>>> version 0.13.0-incubating !
>>> 
>>> The vote is open for at least 72 hours and passes if a majority of at
>>> least 3 +1 PMC votes are cast.
>>> 
>>> [ ] +1 Release this package as Apache SystemML 0.13.0-incubating
>>> [ ] -1 Do not release this package because ...
>>> 
>>> To learn more about Apache SystemML, please see http://systemml.apache.
>>> org/
>>> 
>>> The tag to be voted on is v0.13.0-incubating-rc2 (
>>> ff3e741694e507f64a6b52ee71638bddecabe7af)
>>> 
>>> https://github.com/apache/incubator-systemml/commit/
>>> ff3e741694e507f64a6b52ee71638bddecabe7af
>>> 
>>> The release artifacts can be found at :
>>> https://dist.apache.org/repos/dist/dev/i

SystemML 0.13 Release publish issue. (Resolved)

[Arvind Surve]

Network/Nexus issue caused issue described below.Republishing helped to 
resolved this issue.
-Arvind Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Monday, February 20, 2017 4:05 PM
 Subject: SystemML 0.13 Release publish issue.
   

Hi Luciano,
We have Maven Publish issue. As a part of Release Publish process, its supposed 
to send .asc, .md5, sha1 for every file we send to Nexus Repository,In build 
process it shows all files being sent.
But when we try to close the release for dev, it complains that .asc for every 
file don't exist.I see all files on Nexus Repository other than .asc file. 
(Uploaded screenshot)
I have opened JIRA against Apache Infrastructure.
https://issues.apache.org/jira/browse/INFRA-13548


Please let me know if there is any alternative solution to resolve it quickly.

 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

   

[VOTE] Apache SystemML 0.13.0-incubating (RC1)

[Arvind Surve]

Please vote on releasing the following candidate as Apache SystemML version 
0.13.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.13.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.13.0-incubating-rc1 
(07f26ca4ebf9471789c4535053c679f55a2291dc)

https://github.com/apache/incubator-systemml/commit/07f26ca4ebf9471789c4535053c679f55a2291dc

The release artifacts can be found at :
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.13.0-incubating-rc1/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1016/org/apache/systemml/systemml/0.13.0-incubating/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.
 -Arvind
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

SystemML 0.13 Release publish issue.

[Arvind Surve]

Hi Luciano,
We have Maven Publish issue. As a part of Release Publish process, its supposed 
to send .asc, .md5, sha1 for every file we send to Nexus Repository,In build 
process it shows all files being sent.
But when we try to close the release for dev, it complains that .asc for every 
file don't exist.I see all files on Nexus Repository other than .asc file. 
(Uploaded screenshot)
I have opened JIRA against Apache Infrastructure.
https://issues.apache.org/jira/browse/INFRA-13548


Please let me know if there is any alternative solution to resolve it quickly.

 Arvind Surve | Spark Technology Center  | http://www.spark.tc/

SystemML 0.13 Release plan (RC Build @ ~10AM PST)

[Arvind Surve]

Hi,
We will be starting SystemML 0.13 Release Candidate (RC) build around 10AM PST 
today (02/20).Once tag for SystemML 0.13 RC gets created, branch may get 
created any time later per need.Only MUST (Stop shipment) fixes for 0.13 
release will go in this newly created branch.You can continue your check-ins in 
master branch.


-Arvind 
Arvind Surve | Spark Technology Center  | http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Thursday, February 16, 2017 8:29 AM
 Subject: SystemML 0.13 Release plan
   
Hi,
We are planning to get SystemML 0.13 release out. One of the major purpose of 
this release is to provide supporting SystemML on Spark 2.1.0.We will plan to 
do Release Candidate (RC) build by end of this week. After RC build, 
verification will be done to get code ready for publish.
Once RC build gets started code for SystemML 0.13 will be frozen other than any 
stop shipment issues.If you are working on any critical issue/s, please try to 
get in change/s by EOD Friday (2/17/2017) PST.

ThanksArvind
 ------     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

   

Re: Weighted Statistical Estimates

[Arvind Surve]

+1 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

  From: Felix Schüler <fschue...@posteo.de>
 To: dev@systemml.incubator.apache.org 
 Sent: Saturday, February 18, 2017 9:42 PM
 Subject: Re: Weighted Statistical Estimates
   
Sounds good!

-Felix

On 18.02.2017 21:20, Matthias Boehm wrote:
> Going toward to our 1.0 release, I'd like to create consistency across our
> weighted statistics. Conceptually, theses weights represent frequency
> counts, i.e., multiplicities of input values.
>
> So far, our documentation does not state any restrictions on these weights
> but some runtime operations require integer data (I), while others allow
> arbitrary floating point data as indicated below:
>
> * moment
> * cov
> * aggregate
> * table
> * median (I)
> * quantile (I)
> * interQuartileMean (I)
>
> This can lead to unexpected errors as shown by recent issues such as
> SYSTEMML-1265. Looking back to R and its packages like Hmisc or reldist, it
> turns out that they all allow arbitrary weights.
>
> So, relaxing any restrictions of integer weights seems like the right
> choice. As this changes the external behavior - albeit in a generalizing
> manner - we should make this change now. If you have any concerns, let me
> know.
>
> Regards,
> Matthias
>



   

Re: SystemML 0.13 Release plan

[Arvind Surve]

We will plan to have branch based on 0.13 tag.  --     Arvind 
Surve     Spark Technology Center     http://www.spark.tc/

  From: Luciano Resende <luckbr1...@gmail.com>
 To: dev@systemml.incubator.apache.org; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 16, 2017 9:56 AM
 Subject: Re: SystemML 0.13 Release plan
   
What do you mean by frozen ? A branch will be created from the 0.13 rc tag
if needed ? or master will be frozen?

On Thu, Feb 16, 2017 at 8:29 AM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Hi,
> We are planning to get SystemML 0.13 release out. One of the major purpose
> of this release is to provide supporting SystemML on Spark 2.1.0.We will
> plan to do Release Candidate (RC) build by end of this week. After RC
> build, verification will be done to get code ready for publish.
> Once RC build gets started code for SystemML 0.13 will be frozen other
> than any stop shipment issues.If you are working on any critical issue/s,
> please try to get in change/s by EOD Friday (2/17/2017) PST.
>
> ThanksArvind
>  --    Arvind Surve    Spark Technology Center
> http://www.spark.tc/




-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/


   

SystemML 0.13 Release plan

[Arvind Surve]

Hi,
We are planning to get SystemML 0.13 release out. One of the major purpose of 
this release is to provide supporting SystemML on Spark 2.1.0.We will plan to 
do Release Candidate (RC) build by end of this week. After RC build, 
verification will be done to get code ready for publish.
Once RC build gets started code for SystemML 0.13 will be frozen other than any 
stop shipment issues.If you are working on any critical issue/s, please try to 
get in change/s by EOD Friday (2/17/2017) PST.

ThanksArvind
 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

Re: Corrupt SystemML 0.12 release download

[Arvind Surve]

Yes, thats the plan. --     Arvind Surve     Spark Technology 
Center     http://www.spark.tc/

  From: Luciano Resende <luckbr1...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Wednesday, February 15, 2017 10:59 PM
 Subject: Re: Corrupt SystemML 0.12 release download
   
Note that we Must not just update the artifact, as whatever we publish
should be voted.

I would suggest just doing a 0.12.1 release

On Wed, Feb 15, 2017 at 10:14 PM Berthold Reinwald <reinw...@us.ibm.com>
wrote:

> yes, that is the current consensus. It is probably a bug in the release
> scripts.
>
> Regards,
> Berthold Reinwald
> IBM Almaden Research Center
> office: (408) 927 2208; T/L: 457 2208
> e-mail: reinw...@us.ibm.com
>
>
>
> From:  Matthias Boehm <mboe...@googlemail.com>
> To:    dev@systemml.incubator.apache.org
> Date:  02/15/2017 09:25 PM
> Subject:        Corrupt SystemML 0.12 release download
>
>
>
> Just in case you have not seen the issue described in [1], the download of
> our 0.12 release is currently corrupted as the included SystemML.jar does
> not contain the antlr-runtime and wink-json libraries. Hence, without
> modifying the jar, SystemML fails with ClassNotFoundExceptions.
>
> I agree with Felix that we should fix this ASAP, potentially just fixing
> the links. Furthermore, I'd like to understand why there is a difference
> between the artifacts in the maven repository (which contain these
> libraries) and our download page. Could anyone clarify this discrepancy,
> please?
>
> Regards,
> Matthias
>
> [1] https://issues.apache.org/jira/browse/SYSTEMML-1250
>
>
>
>
> --
Sent from my Mobile device


   

[ANNOUNCE] Apache SystemML 0.12.0-incubating released.

[Arvind Surve]

The Apache SystemML team is pleased to announce the release of Apache
SystemML version 0.12.0-incubating.Apache SystemML provides declarative 
large-scale machine learning (ML) that
aims at a flexible specification of ML algorithms and automatic generation
of hybrid runtime plans ranging from single-node, in-memory computations,
to distributed computations on Apache Hadoop MapReduce and Apache Spark.

To provide Python interface support considerable updates have been madeto the 
release. For detailed information about the updates, please access the release
notes.  
https://github.com/apache/incubator-systemml-website/blob/master/0.12.0-incubating/release_notes.md
 

To download the distribution, and learn more about SystemML project, please
go to :

http://systemml.apache.org/

The Apache SystemML Team

---
Apache SystemML is an effort undergoing Incubation
<https://incubator.apache.org/index.html> at The Apache Software Foundation
(ASF), sponsored by the Incubator. Incubation is required of all newly
accepted projects until a further review indicates that the infrastructure,
communications, and decision making process have stabilized in a manner
consistent with other successful ASF projects. While incubation status is
not necessarily a reflection of the completeness or stability of the code,
it does indicate that the project has yet to be fully endorsed by the ASF.

 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2) - missing KEYS file

[Arvind Surve]

Hi Christian,
We never published KEYS in earlier releases. This is the first time we are 
adding KEYS per Henry's finding. Henry has an access to dev site from where he 
is going to verify release.
Once release is voted, we will move KEYS to release site. (Meantime, Luciano 
needs to add his public key as well)

ThanksArvind --     Arvind Surve     Spark Technology Center    
 http://www.spark.tc/

  From: Christian R Kadner <ckad...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
Cc: Arvind Surve <ac...@yahoo.com>; Henry Saputra <henry.sapu...@gmail.com>
 Sent: Thursday, February 2, 2017 9:06 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2) - missing KEYS file
   
Hi Arvind,

I think your KEYS file still needs to be moved by a PMC member from the staging 
repository folder /dev/

 https://dist.apache.org/repos/dist/dev/incubator/systemml/

to the release distribution folder /release/

 https://dist.apache.org/repos/dist/release/incubator/systemml/

which, I assume, will then get replicated to this folder:

 http://www.apache.org/dist/incubator/systemml/

where Henry was expecting to find it :-)

Best regards,
Christian Kadner

Arvind Surve ---02/02/2017 08:43:57 PM---Resending the link, not sure if first 
time yahoo client sent link or not. https://dist.apache.org/re

From: Arvind Surve <ac...@yahoo.com.INVALID>
To: "dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org>, 
Henry Saputra <henry.sapu...@gmail.com>, Arvind Surve <ac...@yahoo.com>
Date: 02/02/2017 08:43 PM
Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)



Resending the link, not sure if first time yahoo client sent link or not.
https://dist.apache.org/repos/dist/dev/incubator/systemml/ --   
  Arvind Surve     Spark Technology Center     http://www.spark.tc/

      From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: "dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org>; 
Henry Saputra <henry.sapu...@gmail.com>; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 5:48 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
   
Hi Henry,
Please find keys @
dist - Revision 18091: /dev/incubator/systemml

 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

      From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: Henry Saputra <henry.sapu...@gmail.com>; 
"dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org> 
 Sent: Thursday, February 2, 2017 3:11 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Hi Henry,
Yes, those files can be downloaded from following location.dist - Revision 
18090: /dev/incubator/systemml/0.12.0-incubating-rc2

If you visit above site, you can see following files

dist - Revision 18090: /dev/incubator/systemml/0.12.0-incubating-rc2
  
  - ..
  - systemml-0.12.0-incubating-bin.tgz
  - systemml-0.12.0-incubating-bin.tgz.asc
  - systemml-0.12.0-incubating-bin.tgz.md5
  - systemml-0.12.0-incubating-bin.tgz.sha
  - systemml-0.12.0-incubating-bin.zip
  - systemml-0.12.0-incubating-bin.zip.asc
  - systemml-0.12.0-incubating-bin.zip.md5
  - systemml-0.12.0-incubating-bin.zip.sha
  - systemml-0.12.0-incubating-python.tgz
  - systemml-0.12.0-incubating-python.tgz.asc
  - systemml-0.12.0-incubating-python.tgz.md5
  - systemml-0.12.0-incubating-python.tgz.sha
  - systemml-0.12.0-incubating-src.tgz
  - systemml-0.12.0-incubating-src.tgz.asc
  - systemml-0.12.0-incubating-src.tgz.md5
  - systemml-0.12.0-incubating-src.tgz.sha
  - systemml-0.12.0-incubating-src.zip
  - systemml-0.12.0-incubating-src.zip.asc
  - systemml-0.12.0-incubating-src.zip.md5
  - systemml-0.12.0-incubating-src.zip.sha


e.g. If you need KEY for   
  - systemml-0.12.0-incubating-bin.tgz
Key  for above file cane be found in   
  - systemml-0.12.0-incubating-bin.tgz.asc

I looked at the link distribution site as well, it seems they have similar 
files as well. Can you please let me know what difference you find?
Luciano,
Please comment on this if I miss anything here.
--     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

    

 From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 2:47 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Usually the is a KEYS file located in https://dist.apache.org/ 
repos/dist/dev/incubator/ systemml/
For example: http://www.apache.org/dist/flink/
- Henry
On Thu, Feb 2, 2017 at 2:44 PM, Henry Saputra <henry.sapu...@gmail.com> wrote:

Hi Arvind,
I was talking about the public key to verify the signature.
- Henry
On Mon, Jan 30, 2017 at 12:04 AM, Arvind Surve <ac...@yahoo.com.invalid> wrote:

Hi Henry,
These artifacts are signed similar t

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

Resending the link, not sure if first time yahoo client sent link or not.
https://dist.apache.org/repos/dist/dev/incubator/systemml/ --   
  Arvind Surve     Spark Technology Center     http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: "dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org>; 
Henry Saputra <henry.sapu...@gmail.com>; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 5:48 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
   
Hi Henry,
Please find keys @
dist - Revision 18091: /dev/incubator/systemml

 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

      From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: Henry Saputra <henry.sapu...@gmail.com>; 
"dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org> 
 Sent: Thursday, February 2, 2017 3:11 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Hi Henry,
Yes, those files can be downloaded from following location.dist - Revision 
18090: /dev/incubator/systemml/0.12.0-incubating-rc2

If you visit above site, you can see following files

dist - Revision 18090: /dev/incubator/systemml/0.12.0-incubating-rc2
  
  - ..
  - systemml-0.12.0-incubating-bin.tgz
  - systemml-0.12.0-incubating-bin.tgz.asc
  - systemml-0.12.0-incubating-bin.tgz.md5
  - systemml-0.12.0-incubating-bin.tgz.sha
  - systemml-0.12.0-incubating-bin.zip
  - systemml-0.12.0-incubating-bin.zip.asc
  - systemml-0.12.0-incubating-bin.zip.md5
  - systemml-0.12.0-incubating-bin.zip.sha
  - systemml-0.12.0-incubating-python.tgz
  - systemml-0.12.0-incubating-python.tgz.asc
  - systemml-0.12.0-incubating-python.tgz.md5
  - systemml-0.12.0-incubating-python.tgz.sha
  - systemml-0.12.0-incubating-src.tgz
  - systemml-0.12.0-incubating-src.tgz.asc
  - systemml-0.12.0-incubating-src.tgz.md5
  - systemml-0.12.0-incubating-src.tgz.sha
  - systemml-0.12.0-incubating-src.zip
  - systemml-0.12.0-incubating-src.zip.asc
  - systemml-0.12.0-incubating-src.zip.md5
  - systemml-0.12.0-incubating-src.zip.sha


e.g. If you need KEY for   
  - systemml-0.12.0-incubating-bin.tgz
Key  for above file cane be found in   
  - systemml-0.12.0-incubating-bin.tgz.asc

I looked at the link distribution site as well, it seems they have similar 
files as well. Can you please let me know what difference you find?
Luciano,
Please comment on this if I miss anything here.
--     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

    

 From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 2:47 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Usually the is a KEYS file located in https://dist.apache.org/ 
repos/dist/dev/incubator/ systemml/
For example: http://www.apache.org/dist/flink/
- Henry
On Thu, Feb 2, 2017 at 2:44 PM, Henry Saputra <henry.sapu...@gmail.com> wrote:

Hi Arvind,
I was talking about the public key to verify the signature.
- Henry
On Mon, Jan 30, 2017 at 12:04 AM, Arvind Surve <ac...@yahoo.com.invalid> wrote:

Hi Henry,
These artifacts are signed similar to SystemML 0.11 release.
They are signed using GPG program. Key for individual files are stored in 
corresponding file with extension .asc --     Arvind Surve     
Spark Technology Center     http://www.spark.tc/

      From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache. org
 Sent: Sunday, January 29, 2017 8:49 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

Arvind,

How did yo sign the release artifacts? Didnt see the KEYS file

- Henry

On Thu, Jan 26, 2017 at 2:42 PM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Please vote on releasing the following candidate as Apache SystemML
> version 0.12.0-incubating !
>
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache SystemML 0.12.0-incubating
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache SystemML, please see http://systemml.apache.
> org/
>
> The tag to be voted on is v0.12.0-incubating-rc2 (
> d96a17f64cef7f251d9592679ecdee 7ac17feb04)
>
> https://github.com/apache/incu bator-systemml/commit/
> d96a17f64cef7f251d9592679ecdee 7ac17feb04
>
> The release artifacts can be found at :
>
> https://dist.apache.org/repos/ dist/dev/incubator/systemml/0.
> 12.0-incubating-rc2/
>
> The maven release artifacts, including signatures, digests, etc. can
> be found at:
>
> https://repository.apache.org/ content/repositories/orgapache systemml-1013/
>
> == ===
> == Apache Incubator re

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

Hi Henry,
Please find keys @
dist - Revision 18091: /dev/incubator/systemml

 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com.INVALID>
 To: Henry Saputra <henry.sapu...@gmail.com>; 
"dev@systemml.incubator.apache.org" <dev@systemml.incubator.apache.org> 
 Sent: Thursday, February 2, 2017 3:11 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
   
Hi Henry,
Yes, those files can be downloaded from following location.dist - Revision 
18090: /dev/incubator/systemml/0.12.0-incubating-rc2

If you visit above site, you can see following files

dist - Revision 18090: /dev/incubator/systemml/0.12.0-incubating-rc2
  
  - ..
  - systemml-0.12.0-incubating-bin.tgz
  - systemml-0.12.0-incubating-bin.tgz.asc
  - systemml-0.12.0-incubating-bin.tgz.md5
  - systemml-0.12.0-incubating-bin.tgz.sha
  - systemml-0.12.0-incubating-bin.zip
  - systemml-0.12.0-incubating-bin.zip.asc
  - systemml-0.12.0-incubating-bin.zip.md5
  - systemml-0.12.0-incubating-bin.zip.sha
  - systemml-0.12.0-incubating-python.tgz
  - systemml-0.12.0-incubating-python.tgz.asc
  - systemml-0.12.0-incubating-python.tgz.md5
  - systemml-0.12.0-incubating-python.tgz.sha
  - systemml-0.12.0-incubating-src.tgz
  - systemml-0.12.0-incubating-src.tgz.asc
  - systemml-0.12.0-incubating-src.tgz.md5
  - systemml-0.12.0-incubating-src.tgz.sha
  - systemml-0.12.0-incubating-src.zip
  - systemml-0.12.0-incubating-src.zip.asc
  - systemml-0.12.0-incubating-src.zip.md5
  - systemml-0.12.0-incubating-src.zip.sha


e.g. If you need KEY for   
  - systemml-0.12.0-incubating-bin.tgz
Key  for above file cane be found in   
  - systemml-0.12.0-incubating-bin.tgz.asc

I looked at the link distribution site as well, it seems they have similar 
files as well. Can you please let me know what difference you find?
Luciano,
Please comment on this if I miss anything here.
------     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

    

 From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 2:47 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Usually the is a KEYS file located in https://dist.apache.org/ 
repos/dist/dev/incubator/ systemml/
For example: http://www.apache.org/dist/flink/
- Henry
On Thu, Feb 2, 2017 at 2:44 PM, Henry Saputra <henry.sapu...@gmail.com> wrote:

Hi Arvind,
I was talking about the public key to verify the signature.
- Henry
On Mon, Jan 30, 2017 at 12:04 AM, Arvind Surve <ac...@yahoo.com.invalid> wrote:

Hi Henry,
These artifacts are signed similar to SystemML 0.11 release.
They are signed using GPG program. Key for individual files are stored in 
corresponding file with extension .asc --     Arvind Surve     
Spark Technology Center     http://www.spark.tc/

      From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache. org
 Sent: Sunday, January 29, 2017 8:49 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

Arvind,

How did yo sign the release artifacts? Didnt see the KEYS file

- Henry

On Thu, Jan 26, 2017 at 2:42 PM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Please vote on releasing the following candidate as Apache SystemML
> version 0.12.0-incubating !
>
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache SystemML 0.12.0-incubating
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache SystemML, please see http://systemml.apache.
> org/
>
> The tag to be voted on is v0.12.0-incubating-rc2 (
> d96a17f64cef7f251d9592679ecdee 7ac17feb04)
>
> https://github.com/apache/incu bator-systemml/commit/
> d96a17f64cef7f251d9592679ecdee 7ac17feb04
>
> The release artifacts can be found at :
>
> https://dist.apache.org/repos/ dist/dev/incubator/systemml/0.
> 12.0-incubating-rc2/
>
> The maven release artifacts, including signatures, digests, etc. can
> be found at:
>
> https://repository.apache.org/ content/repositories/orgapache systemml-1013/
>
> == ===
> == Apache Incubator release policy ==
> == ===
> Please find below the guide to release management during incubation:
> http://incubator.apache.org/gu ides/releasemanagement.html
>
> == =
> == How can I help test this release? ==
> == =
> If you are a SystemML user, you can help us test this release by taking
> an existing Algorithm or workload and running on this release candidate,
> then
> reporting any regressions.
>
> == ===

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

Hi Henry,
Yes, those files can be downloaded from following location.dist - Revision 
18090: /dev/incubator/systemml/0.12.0-incubating-rc2

If you visit above site, you can see following files

dist - Revision 18090: /dev/incubator/systemml/0.12.0-incubating-rc2
   
   - ..
   - systemml-0.12.0-incubating-bin.tgz
   - systemml-0.12.0-incubating-bin.tgz.asc
   - systemml-0.12.0-incubating-bin.tgz.md5
   - systemml-0.12.0-incubating-bin.tgz.sha
   - systemml-0.12.0-incubating-bin.zip
   - systemml-0.12.0-incubating-bin.zip.asc
   - systemml-0.12.0-incubating-bin.zip.md5
   - systemml-0.12.0-incubating-bin.zip.sha
   - systemml-0.12.0-incubating-python.tgz
   - systemml-0.12.0-incubating-python.tgz.asc
   - systemml-0.12.0-incubating-python.tgz.md5
   - systemml-0.12.0-incubating-python.tgz.sha
   - systemml-0.12.0-incubating-src.tgz
   - systemml-0.12.0-incubating-src.tgz.asc
   - systemml-0.12.0-incubating-src.tgz.md5
   - systemml-0.12.0-incubating-src.tgz.sha
   - systemml-0.12.0-incubating-src.zip
   - systemml-0.12.0-incubating-src.zip.asc
   - systemml-0.12.0-incubating-src.zip.md5
   - systemml-0.12.0-incubating-src.zip.sha


e.g. If you need KEY for    
   - systemml-0.12.0-incubating-bin.tgz
Key  for above file cane be found in    
   - systemml-0.12.0-incubating-bin.tgz.asc

I looked at the link distribution site as well, it seems they have similar 
files as well. Can you please let me know what difference you find?
Luciano,
Please comment on this if I miss anything here.
--     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

 

 From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org; Arvind Surve <ac...@yahoo.com> 
 Sent: Thursday, February 2, 2017 2:47 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Usually the is a KEYS file located in https://dist.apache.org/ 
repos/dist/dev/incubator/ systemml/
For example: http://www.apache.org/dist/flink/
- Henry
On Thu, Feb 2, 2017 at 2:44 PM, Henry Saputra <henry.sapu...@gmail.com> wrote:

Hi Arvind,
I was talking about the public key to verify the signature.
- Henry
On Mon, Jan 30, 2017 at 12:04 AM, Arvind Surve <ac...@yahoo.com.invalid> wrote:

Hi Henry,
These artifacts are signed similar to SystemML 0.11 release.
They are signed using GPG program. Key for individual files are stored in 
corresponding file with extension .asc ------     Arvind Surve     
Spark Technology Center     http://www.spark.tc/

      From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache. org
 Sent: Sunday, January 29, 2017 8:49 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

Arvind,

How did yo sign the release artifacts? Didnt see the KEYS file

- Henry

On Thu, Jan 26, 2017 at 2:42 PM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Please vote on releasing the following candidate as Apache SystemML
> version 0.12.0-incubating !
>
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache SystemML 0.12.0-incubating
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache SystemML, please see http://systemml.apache.
> org/
>
> The tag to be voted on is v0.12.0-incubating-rc2 (
> d96a17f64cef7f251d9592679ecdee 7ac17feb04)
>
> https://github.com/apache/incu bator-systemml/commit/
> d96a17f64cef7f251d9592679ecdee 7ac17feb04
>
> The release artifacts can be found at :
>
> https://dist.apache.org/repos/ dist/dev/incubator/systemml/0.
> 12.0-incubating-rc2/
>
> The maven release artifacts, including signatures, digests, etc. can
> be found at:
>
> https://repository.apache.org/ content/repositories/orgapache systemml-1013/
>
> == ===
> == Apache Incubator release policy ==
> == ===
> Please find below the guide to release management during incubation:
> http://incubator.apache.org/gu ides/releasemanagement.html
>
> == =
> == How can I help test this release? ==
> == =
> If you are a SystemML user, you can help us test this release by taking
> an existing Algorithm or workload and running on this release candidate,
> then
> reporting any regressions.
>
> == ==
> == What justifies a -1 vote for this release? ==
> == ==
> -1 votes should only occur for significant stop-ship bugs or legal
> related issues (e.g. wrong license, missing header files, etc). Minor bugs
> or regressions should not block this release.
>
>
>
>
> --Arvind SurveSpark Technology CenterSpark Technology
> Center
>
> |
> |
> |
> |  |    |
>
>  |
>
>  |
> |
> |  |
> Spark Technology Center
>  The Best Thinking On Apache Spark™  |  |
>
>  |
>
>  |
>
>
>

   





   

[RESULT] [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

Vote passed with 5 (binding) +1 from
Glen Weidner
Arvind Surve
Niketan Pansare
Berthold ReinwaldMichael W Dusenberry


And 1 (non-binding) +1 from
Imran Younus


I will start the IPMC vote shortly.

 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

  From: Arvind Surve <ac...@yahoo.com>
 To: Dev <dev@systemml.incubator.apache.org> 
 Sent: Thursday, January 26, 2017 2:42 PM
 Subject: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Please vote on releasing the following candidate as Apache SystemML version 
0.12.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.12.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.12.0-incubating-rc2 
(d96a17f64cef7f251d9592679ecdee7ac17feb04)

https://github.com/apache/incubator-systemml/commit/d96a17f64cef7f251d9592679ecdee7ac17feb04

The release artifacts can be found at :

https://dist.apache.org/repos/dist/dev/incubator/systemml/0.12.0-incubating-rc2/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1013/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.




--Arvind SurveSpark Technology CenterSpark Technology Center
  
|  
|  
|  
|   ||

  |

  |
|  
|   |  
Spark Technology Center
 The Best Thinking On Apache Spark™  |   |

  |

  |

 
 

   

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

+1
 --     Arvind Surve     Spark Technology Center     
http://www.spark.tc/

  From: Glenn Weidner <gweid...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Tuesday, January 31, 2017 8:55 AM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
   
Yes (used same data as in 
https://github.com/apache/incubator-systemml/tree/master/src/main/python/tests).

+1

Thanks,
Glenn


Berthold Reinwald---01/31/2017 08:36:24 AM---Thanks, Glenn. Did you run 
LinearRegression, etc. in the Python Notebook? Regards,

From: Berthold Reinwald/Almaden/IBM@IBMUS
To: dev@systemml.incubator.apache.org
Date: 01/31/2017 08:36 AM
Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)



Thanks, Glenn. Did you run LinearRegression, etc. in the Python Notebook?


Regards,
Berthold Reinwald
IBM Almaden Research Center
office: (408) 927 2208; T/L: 457 2208
e-mail: reinw...@us.ibm.com



From:   Glenn Weidner/Silicon Valley/IBM@IBMUS
To:     dev@systemml.incubator.apache.org
Date:   01/28/2017 11:55 AM
Subject:        Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)



Verified python artifact functionality in python 2.7 notebook with new 
spark 1.6 instance via:

!pip install 
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.12.0-incubating-rc2/systemml-0.12.0-incubating-python.tgz


Successfully ran LinearRegression, LogisticRegression, NaiveBayes, SVM.

Regards,
Glenn

Glenn Weidner---01/27/2017 05:46:55 PM---Thank you Matthias! I definitely 
agree with bringing the S, M, L scenarios to within a few days.

From: Glenn Weidner/Silicon Valley/IBM@IBMUS
To: dev@systemml.incubator.apache.org
Date: 01/27/2017 05:46 PM
Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)



Thank you Matthias! I definitely agree with bringing the S, M, L scenarios 
to within a few days.

Yes, for m-svm, the classes argument was default of 150 whereas maxiter 
was set to 3 (instead of 20). I ran tests with both 0.11 and 0.12 RC1/RC2 
on same cluster for comparison and will share results separately.

Thanks,
Glenn


Matthias Boehm ---01/27/2017 03:45:47 PM---Thanks Glenn. Could you please 
also share the measurements (maybe in a jira).

From: Matthias Boehm <mboe...@googlemail.com>
To: dev@systemml.incubator.apache.org
Date: 01/27/2017 03:45 PM
Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)



Thanks Glenn. Could you please also share the measurements (maybe in a 
jira).

Furthermore, seeing that you ran only a subset of multinomial 
experiments, makes me wonder if you used the current default 
configuration of 150 classes? In the recent past, we usually ran this 
perftest with a reasonable number of about 20 which significantly 
impacts performance because broadcast constraints are exceeded. Given 
the goal of a fast release process, we might want to update the perftest 
to bring scenarions S, M, and L to something like 2 days.


Regards,
Matthias

On 1/28/2017 12:10 AM, Glenn Weidner wrote:
> Successfully completed performance testing including medium and large 
data
> sets for Binomial, Clustering, Multinomial (subset), Regression, and
> Statistics tests.
>
> Regards,
> Glenn
>
>
>
>
> From: Arvind Surve <ac...@yahoo.com.INVALID>
> To: Dev <dev@systemml.incubator.apache.org>
> Date: 01/26/2017 02:50 PM
> Subject: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
>
>
>
> Please vote on releasing the following candidate as Apache SystemML
> version 0.12.0-incubating !
>
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache SystemML 0.12.0-incubating
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache SystemML, please see 
http://systemml.apache.org/
>
> The tag to be voted on is v0.12.0-incubating-rc2
> (d96a17f64cef7f251d9592679ecdee7ac17feb04)
>
> 
https://github.com/apache/incubator-systemml/commit/d96a17f64cef7f251d9592679ecdee7ac17feb04

>
>
> The release artifacts can be found at :
>
> 
https://dist.apache.org/repos/dist/dev/incubator/systemml/0.12.0-incubating-rc2/

>
>
> The maven release artifacts, including signatures, digests, etc. can
> be found at:
>
> 
https://repository.apache.org/content/repositories/orgapachesystemml-1013/
>
> =
> == Apache Incubator release policy ==
> =
> Please find below the guide to release management during incubation:
> http://incubator.apache.org/guides/releasemanagement.html
>
> ===
> == How can I help test this release? ==
> ===
> If you are a SystemML user, you can help us test this release by taking
> an existing Algorithm or workload and running on this release candidate,
> then
&g

Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)

[Arvind Surve]

Hi Henry,
These artifacts are signed similar to SystemML 0.11 release.
They are signed using GPG program. Key for individual files are stored in 
corresponding file with extension .asc --     Arvind Surve     
Spark Technology Center     http://www.spark.tc/

  From: Henry Saputra <henry.sapu...@gmail.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Sunday, January 29, 2017 8:49 PM
 Subject: Re: [VOTE] Apache SystemML 0.12.0-incubating (RC2)
  
Arvind,

How did yo sign the release artifacts? Didnt see the KEYS file

- Henry

On Thu, Jan 26, 2017 at 2:42 PM, Arvind Surve <ac...@yahoo.com.invalid>
wrote:

> Please vote on releasing the following candidate as Apache SystemML
> version 0.12.0-incubating !
>
> The vote is open for at least 72 hours and passes if a majority of at
> least 3 +1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache SystemML 0.12.0-incubating
> [ ] -1 Do not release this package because ...
>
> To learn more about Apache SystemML, please see http://systemml.apache.
> org/
>
> The tag to be voted on is v0.12.0-incubating-rc2 (
> d96a17f64cef7f251d9592679ecdee7ac17feb04)
>
> https://github.com/apache/incubator-systemml/commit/
> d96a17f64cef7f251d9592679ecdee7ac17feb04
>
> The release artifacts can be found at :
>
> https://dist.apache.org/repos/dist/dev/incubator/systemml/0.
> 12.0-incubating-rc2/
>
> The maven release artifacts, including signatures, digests, etc. can
> be found at:
>
> https://repository.apache.org/content/repositories/orgapachesystemml-1013/
>
> =
> == Apache Incubator release policy ==
> =
> Please find below the guide to release management during incubation:
> http://incubator.apache.org/guides/releasemanagement.html
>
> ===
> == How can I help test this release? ==
> ===
> If you are a SystemML user, you can help us test this release by taking
> an existing Algorithm or workload and running on this release candidate,
> then
> reporting any regressions.
>
> 
> == What justifies a -1 vote for this release? ==
> 
> -1 votes should only occur for significant stop-ship bugs or legal
> related issues (e.g. wrong license, missing header files, etc). Minor bugs
> or regressions should not block this release.
>
>
>
>
> --Arvind SurveSpark Technology CenterSpark Technology
> Center
>
> |
> |
> |
> |  |    |
>
>  |
>
>  |
> |
> |  |
> Spark Technology Center
>  The Best Thinking On Apache Spark™  |  |
>
>  |
>
>  |
>
>
>

   

Re: [NOTICE] New Apache SystemML Committer & PPMC Member: Nakul Jindal

[Arvind Surve]

Congrats Nakul!
 --Arvind Surve Spark Technology Center http://www.spark.tc/

  From: Niketan Pansare <npan...@us.ibm.com>
 To: dev@systemml.incubator.apache.org 
 Sent: Thursday, January 19, 2017 7:42 PM
 Subject: Re: [NOTICE] New Apache SystemML Committer & PPMC Member: Nakul Jindal
   
Congratulations Nakul!

> On Jan 19, 2017, at 7:11 PM, Jeremy Anderson <jer...@objectadjective.com> 
> wrote:
> 
> Congrats Nakul!
> 
> ...
> 
> Jeremy Anderson
> 
> Github: https://github.com/objectadjective
> Twitter: https://twitter.com/ObjectAdjective
> LinkedIn: http://www.linkedin.com/in/objectadjective
> 
>> On 19 January 2017 at 18:52, Madison Myers <madisonjmy...@gmail.com> wrote:
>> 
>> Congrats Nakul!
>>> On Thu, Jan 19, 2017 at 6:35 PM <dusenberr...@gmail.com> wrote:
>>> 
>>> Hi all,
>>> 
>>> 
>>> 
>>> I'd like to welcome Nakul Jindal as a new Committer and PPMC member for
>>> the Apache SystemML project!
>>> 
>>> 
>>> 
>>> Thanks for all of the hard work so far, Nakul, and welcome!
>>> 
>>> 
>>> 
>>> 
>>> 
>>> The Apache SystemML PPMC Members
>>> 
>>> 
>>> 
>>> --
>>> 
>>> 
>>> 
>>> Mike Dusenberry
>>> 
>>> GitHub: github.com/dusenberrymw
>>> 
>>> LinkedIn: linkedin.com/in/mikedusenberry
>>> 
>>> 
>>> 
>>> Sent from my iPhone.
>>> 
>>> 
>>> 
>>> 
>> 


   

Re: Time To Release 0.13

[Arvind Surve]

We are planning to have 80GB testing for 0.13 release (to support Spark 2.0). 
It will add couple of days for overall performance testing but its worth try 
before releasing SystemML on Spark 2.0.If we find issues which are not show 
stopping then we can release Spark 2.0, but we should get 80GB testing done.

 --Arvind SurveSpark Technology Centerhttp://www.spark.tc/

  From: "dusenberr...@gmail.com" 
 To: dev@systemml.incubator.apache.org 
 Sent: Monday, January 16, 2017 6:38 PM
 Subject: Time To Release 0.13
   
Hi all,

Now that Spark 2.x support has been merged [1], I think we should go ahead and 
start a release process for 0.13.  That way, we will have an official release 
that supports 2.x, in addition to 0.12 that supports 1.6.

I'd like to propose that as long as our tests pass, and a performance suite on 
*8GB* is reasonably acceptable, we go ahead and release. We can save more 
detailed performance testing and any possible improvements for 0.13.x releases, 
or more importantly for the upcoming 1.0 release.  I think it would be a good 
idea to have one official release on Spark 2.x that the community can stress 
test before our 1.0 release.

Thoughts?

[1]: 
https://github.com/apache/incubator-systemml/commit/a4c7be78390d01a3194e726d7a184c182bd8b558

-Mike

--

Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry

Sent from my iPhone.


   

[VOTE] Apache SystemML 0.12.0-incubating (RC1)

[Arvind Surve]

 Please vote on releasing the following candidate as Apache SystemML version 
0.12.0-incubating !

The vote is open for at least 72 hours and passes if a majority of at least 3 
+1 PMC votes are cast.

[ ] +1 Release this package as Apache SystemML 0.12.0-incubating
[ ] -1 Do not release this package because ...

To learn more about Apache SystemML, please see http://systemml.apache.org/

The tag to be voted on is v0.12.0-incubating-rc1 
(a83ae1f7fbe9551da674450eedce08aaf7d19d07)

https://github.com/apache/incubator-systemml/commit/a83ae1f7fbe9551da674450eedce08aaf7d19d07

The release artifacts can be found at :

https://dist.apache.org/repos/dist/dev/incubator/systemml/0.12.0-incubating-rc1/

The maven release artifacts, including signatures, digests, etc. can be found 
at:

https://repository.apache.org/content/repositories/orgapachesystemml-1012/

=
== Apache Incubator release policy ==
=
Please find below the guide to release management during incubation:
http://incubator.apache.org/guides/releasemanagement.html

===
== How can I help test this release? ==
===
If you are a SystemML user, you can help us test this release by taking an 
existing Algorithm or workload and running on this release candidate, then
reporting any regressions.


== What justifies a -1 vote for this release? ==

-1 votes should only occur for significant stop-ship bugs or legal related 
issues (e.g. wrong license, missing header files, etc). Minor bugs or 
regressions should not block this release.




--Arvind SurveSpark Technology Centerhttp://www.spark.tc/

Build failing due to missing description for parameters

[Arvind Surve]

Hi,
I am creating RC build for SystemML 0.12 Its failing for similar reason in 
multiple places.
Exit code: 1 - 
/Users/asurve/git/systemml_build/incubator-systemml/src/main/java/org/apache/sysml/runtime/matrix/data/LibMatrixCUDA.java:248:
 warning: no description for @param[ERROR] * @param input[ERROR] ^

You can recreate this build failure by running following command.
mvn clean package -Pdistribution

 --Arvind SurveSpark Technology Centerhttp://www.spark.tc/

Re: Time To Merge Spark 2.0 Support PR

[Arvind Surve]

ok, Thanks

 Arvind SurveSpark Technology Centerhttp://www.spark.tc/

  From: Luciano Resende 
 To: dev@systemml.incubator.apache.org 
 Sent: Monday, January 9, 2017 12:33 PM
 Subject: Re: Time To Merge Spark 2.0 Support PR
   
On Mon, Jan 9, 2017 at 12:28 PM,  wrote:

> Right, so we can cut a 0.12 release branch now, and then release from
> that, while work moves forward on the master branch, including 2.0 support.
>
>
Exactly, 0.12 release will come from a brach that we will create and Spark
2.0 support gets merged into Master.


-- 
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/