Re: New Google Summer of Code 2017 Student - Krishna Kalyan

2017-05-10 Thread Deron Eriksson
project. Dig through Pull Requests and > discussions > > to figure out who is familiar with which components. > > > > (I can help a cbit with my background - I have worked on the DML grammar > and > > ANTLR parser layer previously and am working on the GPU backend now. I > also > > ran the perf tests and am somewhat familiar with the work needed to > > automate it.) > > > > Welcome! > > > > -Nakul > > > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Standard code styles for DML and Java?

2017-05-03 Thread Deron Eriksson
ng both > should use spaces though. > > Finally, I would recommend to also include common inconsistency such as > exception handling (catch all vs redundant error messages), > hashcode/equals, unnecessary branches, etc. > > Regards, > Matthias > > > On 5/2/2017 7:15 PM, Dero

Re: Podling Report Reminder - May 2017

2017-05-02 Thread Deron Eriksson
t; because being PPMC is by default as committer too, and change from PMC to > PPMC since we are still podling. > > - Henry > > On Mon, May 1, 2017 at 2:55 PM, Deron Eriksson > wrote: > > > Thanks Henry! Note that the original podling report template did not >

Standard code styles for DML and Java?

2017-05-02 Thread Deron Eriksson
3) as an improvement from our existing 1). We could also have alternate options such as spaces for DML and tabs for Java. Thoughts? Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [NOTICE] New Apache SystemML Committer and PPMC Member

2017-05-01 Thread Deron Eriksson
> > > I would like to welcome Felix Schueler as a new > > > Committer and PPMC member of Apache SystemML. > > > > > > Thanks for all your work, and welcome !!! > > > > > > Arvind Surve | Spark Technology Center | http://www.spark.tc/ > > > > > > > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Updating podlings.xml

2017-05-01 Thread Deron Eriksson
following: svn co https://svn.apache.org/repos/asf/incubator/public/trunk incubator cd incubator // modify content/podlings.xml svn status svn diff svn commit -m "This is my update to podlings.xml..." For reference, please see: http://incubator.apache.org/guides/website.html Deron -- Dero

Re: Podling Report Reminder - May 2017

2017-05-01 Thread Deron Eriksson
Mon, May 1, 2017 at 1:59 PM, Henry Saputra wrote: > Thanks, Deron for taking stab at it > > On Mon, May 1, 2017 at 11:23 AM, Deron Eriksson > wrote: > > > I volunteer to create the SystemML podling report for May. > > > > Deron > > > > > >

Re: Build passed/failed messages for pull requests

2017-05-01 Thread Deron Eriksson
ages because they distract from the actual > > discussions. I already had to change my notification settings > > accordingly - essentially I'm not watching SystemML's PR activity any > > more. > > > > Regards, > > Matthias > > > > On 4/28/2017 10:

Re: Podling Report Reminder - May 2017

2017-05-01 Thread Deron Eriksson
I volunteer to create the SystemML podling report for May. Deron On Fri, Apr 28, 2017 at 2:31 PM, Deron Eriksson wrote: > Hi, > > Would anyone else care to volunteer to create the SystemML podling report? > If there are no volunteers, I will volunteer, but since SystemML is a

Re: Podling Report Reminder - May 2017

2017-04-28 Thread Deron Eriksson
ning off reports shows that you are > following the project - projects that are not signed may raise alarms > for the Incubator PMC. > > Incubator PMC > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Build passed/failed messages for pull requests

2017-04-28 Thread Deron Eriksson
one (such as "Build successful" and "Refer to this link..."). (3) get rid of the automated messages I like (2). Any other opinions or options? Thoughts? Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: caffe and org.tensorflow licenses?

2017-04-24 Thread Deron Eriksson
her.watson.ibm.com/researcher/view.php?person=us-npansar > > [image: Inactive hide details for Deron Eriksson ---04/24/2017 01:28:58 > PM---Hi, I see after a recent commit that the main jar file now]Deron > Eriksson ---04/24/2017 01:28:58 PM---Hi, I see after a

caffe and org.tensorflow licenses?

2017-04-24 Thread Deron Eriksson
tself covered by the above license." So could someone tell me if caffe and tensorflow licenses now need to be added to the project? Even if they are not required, some confusion during artifact validation can occur since the project looks like it contains caffe and tensorflow classes. Deron

Re: function default parameters

2017-04-21 Thread Deron Eriksson
BTW, that is assuming our algorithms have been converted to functions. Deron On Fri, Apr 21, 2017 at 5:37 PM, Deron Eriksson wrote: > Thank you Matthias. I highly agree with your idea about having a default > specification similar to R WRT the function signatures for default values. &g

Re: function default parameters

2017-04-21 Thread Deron Eriksson
; to a subset of parameters. > > Regards, > Matthias > > On Fri, Apr 21, 2017 at 4:18 PM, Deron Eriksson > wrote: > > > Is there a way to set default parameter values using DML? I believe both > R > > and Python offer this capability. > > > > The only solut

function default parameters

2017-04-21 Thread Deron Eriksson
(double b) return (double a) { c = ''+b; if (c == 'NaN') { b = 2.0 } a = b + 1; } z=0.0/0.0; x = addone(z); print(x); y = addone(4.0); print(y); Is there a cleaner way to accomplish this, or is DML lacking this R feature? Deron -- Deron Eriksson Spark Te

Re: Link broken?

2017-04-19 Thread Deron Eriksson
ml/0.12.0- > incubating/systemml-0.12.0-incubating.zip > > The 0.13.0 version download link from the main page ( > https://systemml.apache.org/) works fine. > > Ethan > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Podling Press Kit

2017-04-14 Thread Deron Eriksson
rial to help > podlings incorporate incubator branding into their logos. > > Please review the Press Kit for Podlings page at > http://incubator.apache.org/guides/press-kit.html . If you have any > questions, please follow up on general AT incubator or press AT apache. > > John >

Re: Branch 0.14 based on SystemML-0.14 RC1 has been deleted

2017-04-13 Thread Deron Eriksson
ward unless there is immediate need for a branch, branch based > on > > Release Candidate (RC) won't be created until RC build gets approved. > > -Arvind Arvind Surve | Spark Technology Center | http://www.spark.tc/ > > > > > -- > Luciano Resende > http

Apache SystemML Slack Channel

2017-04-07 Thread Deron Eriksson
and I are the only SystemML committers on the ASF SystemML channel, so it would be nice to get more committers to sign up so we can utilize this great resource for open communication. Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Dropping Java 6 and 7 support

2017-03-07 Thread Deron Eriksson
re has been some discussion on removing Java 7 as well because it > reached end of life in April 2015. Moving to Java 8 would allow us to > modernize the code base going forward and the 1.0 release would be the > perfect time for this change. > > Regards, > Matthias > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Release cadence

2017-03-04 Thread Deron Eriksson
e.org > > Sent: Saturday, January 7, 2017 1:35 AM > > Subject: Re: Release cadence > > > > I think that a 2 month cycle would be a good compromise for major/minor > > releases. Fixpack release could be at a 1 month cycle. > > > > > > Regards, >

Re: [DISCUSS] SystemML Graduation

2017-03-03 Thread Deron Eriksson
or.apache.org/guides/graduation.html > [3] http://incubator.apache.org/projects/systemml.html > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Location of the website source code?

2017-03-02 Thread Deron Eriksson
e website source code? > > Hi Guys, > > I can not find the information about the source code location for the > SystemML website. > > I believe it is in SVN or is it using Git repo? > > Thanks, > > - Henry > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: incubator-systemml git commit: [maven-release-plugin] prepare for next development iteration

2017-02-24 Thread Deron Eriksson
OT > >systemml > >jar > >SystemML > > @@ -41,7 +41,7 @@ > >scm:git:git@github > > .com:apache/incubator-systemml > >scm:git:h > > ttps://git-wip-us.apache.org/repos/asf/incubator-systemml > eveloperConnection> > >https://git-wip-us.apache.org/repos/asf?p=incubator- > > systemml.git > > - v0.13.0-incubating-rc1 > > + HEAD > > > > > >JIRA > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [VOTE] Apache SystemML 0.13.0-incubating (RC2)

2017-02-23 Thread Deron Eriksson
sing header files, etc). Minor bugs > or regressions should not block this release. > -Arvind Arvind Surve | Spark Technology Center | http://www.spark.tc/ -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Minimum required Spark version

2017-02-21 Thread Deron Eriksson
and move it to a central place like SparkExecutionContext to ensure > consistency across all APIs and deployments. > > Regards, > Matthias > > > [image: Inactive hide details for Deron Eriksson ---02/20/2017 02:14:00 > PM---Hi Felix, I agree that the 2.1 hard requirement i

Re: Minimum required Spark version

2017-02-20 Thread Deron Eriksson
se have a hard requirement in MLContext > for Spark 2.1. Is this really necessary or could we set it to >= 2.0? Only > supporting the latest Spark release seems a little restrictive to me. > > > -Felix > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Proposal to add 'accuracy test suite' before 1.0 release

2017-02-17 Thread Deron Eriksson
This implies we run both the performance as well as accuracy > > > test suite before our release. Alternative is to replace simplified > > > algorithms with our released algorithms. > > > > > > Advantages of accuracy test suite approach: > > > 1. No increase the running time of integration tests on Jenkins. > > > 2. Accuracy test suite could use much larger datasets. > > > 3. Accuracy test suite could include algorithms that take longer to > > > converge (for example: Deep Learning algorithms). > > > > > > Advantage of replacing simplified algorithms: > > > 1. No commit breaks any of the existing algorithms. > > > > > > Thanks, > > > > > > Niketan Pansare > > > IBM Almaden Research Center > > > E-mail: npansar At us.ibm.com > > > http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar > > > > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Build failed in Jenkins: SystemML-DailyTest #805

2017-02-12 Thread Deron Eriksson
, Skipped: 0, Time elapsed: 115.25 >> sec - in org.apache.sysml.test.integration.applications.dml.GNMFDMLTest >> Running org.apache.sysml.test.integration.applications.dml.WelchTDMLTest >> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.286 >> sec - in org.apache.sysml.test.integration.applications.dml.WelchTDMLTest >> Running org.apache.sysml.test.integration.applications.dml.ApplyTran >> sformDMLTest >> Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.878 >> sec - in org.apache.sysml.test.integration.applications.dml.ApplyTran >> sformDMLTest >> Running org.apache.sysml.test.integration.applications.pydml.ID3PyDMLTest >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 331.351 >> sec - in org.apache.sysml.test.integration.applications.pydml. >> ID3PyDMLTest >> Running org.apache.sysml.test.integration.applications.pydml. >> GNMFPyDMLTest >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.087 >> sec - in org.apache.sysml.test.integration.applications.pydml. >> GNMFPyDMLTest >> >> Results : >> >> Tests in error: >> >> TransformCSVFrameEncodeReadTest.testFrameParReadMetaHybridCSV:79->runTransformTest:122 >> Runtime >> >> TransformCSVFrameEncodeReadTest.testFrameParReadMetaSparkCSV:74->runTransformTest:122 >> Runtime >> >> TransformCSVFrameEncodeReadTest.testFrameParReadMetaSingleNodeCSV:69->runTransformTest:122 >> Runtime >> >> Tests run: 6676, Failures: 0, Errors: 3, Skipped: 0 >> >> [INFO] >> [INFO] --- maven-failsafe-plugin:2.17:verify (default) @ systemml --- >> [INFO] Failsafe report directory: <https://sparktc.ibmcloud.com/ >> jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> >> [INFO] >> >> [INFO] BUILD FAILURE >> [INFO] >> >> [INFO] Total time: 02:54 h >> [INFO] Finished at: 2017-02-11T17:30:34-06:00 >> [INFO] Final Memory: 62M/2071M >> [INFO] >> >> [ERROR] Failed to execute goal >> org.apache.maven.plugins:maven-failsafe-plugin:2.17:verify >> (default) on project systemml: There are test failures. >> [ERROR] >> [ERROR] Please refer to <https://sparktc.ibmcloud.com/ >> jenkins/job/SystemML-DailyTest/ws/target/failsafe-reports> for the >> individual test results. >> [ERROR] -> [Help 1] >> [ERROR] >> [ERROR] To see the full stack trace of the errors, re-run Maven with the >> -e switch. >> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >> [ERROR] >> [ERROR] For more information about the errors and possible solutions, >> please read the following articles: >> [ERROR] [Help 1] http://cwiki.apache.org/conflu >> ence/display/MAVEN/MojoFailureException >> Build step 'Execute shell' marked build as failure >> Run condition [Always] enabling perform for step [[]] >> >> -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Remove documentation for old MLContext API

2017-02-07 Thread Deron Eriksson
it in 1.0). > > > > Currently the section about the old API is placed in between up-to-date > documentation and makes it pretty confusing to see what is old and what is > new. > > > > Any objections? Alternatively we could put it all the way to the end or > in a separate document. > > > > -Felix > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

0.12.0 Votes

2017-02-06 Thread Deron Eriksson
w the 0.12.0 release? Thanks! Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Pull Request Reviews

2017-02-03 Thread Deron Eriksson
1 hsaputra 1 FelixNeutatz 1 nishi-t 0 sandeep-n 0 romeokienzler 0 tgamal 0 taasawat 0 sourav-mazumder 0 kevin-bates 0 kakal 0 GrapeBaBa 0 objectadjective 0 nmanchev 0 jodersky 0 jdyer1 0 gmlewis 0 aloknsingh 0 akunft 0 ahmaurya 0 -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [DISCUSS] Enable Python Tests on Jenkins

2017-02-03 Thread Deron Eriksson
load the appropriate Spark version on > Jenkins (or on any dev machine which runs the integration tests) and set > SPARK_HOME environment variable. > > Thanks, > > Niketan Pansare > IBM Almaden Research Center > E-mail: npansar At us.ibm.com > http://researcher.watson.i

Re: February Podling Report

2017-02-01 Thread Deron Eriksson
inwald, Prithviraj Sen: SPOOF: Sum-Product > Optimization and Operator Fusion for Large-Scale Machine Learning, CIDR > 2017. > > > > Regards, > > Matthias > > > >> On 2/1/2017 7:30 AM, Deron Eriksson wrote: > >> Hi, > >> > >> I

February Podling Report

2017-01-31 Thread Deron Eriksson
write access or ask Mike, Luciano, or me to make any additions or modifications. Thanks, Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [DISCUSS]: [VOTE] Apache SystemML 0.12.0-incubating (RC1)

2017-01-26 Thread Deron Eriksson
o that they contain the expected root folder and so they do not need to be manually renamed. Deron -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Build failed in Jenkins: SystemML-DailyTest #761

2017-01-20 Thread Deron Eriksson
values in B-R: 3 > > ! B-DML<->B-R # stored values in B-DML: 3 > > ! B-DML<->B-R identical values(z=0): 0 > > ! B-DML<->B-R wrong values(z=1.0E-10): 3 > > ! B-DML<->B-R min error: 38.93887198928196 > > ! B-DML<->B-R max error: 95.5452

Re: SystemML optimizer design

2017-01-20 Thread Deron Eriksson
th a DML program, can I view (a) the DML program > > parsed > >into HOPs; (b) what rules fire and where in the plan, as well as the > > plan > >after each rule fires; and (c) the lowering and fusing of operators to > > LOPs? > > > >I know this is a lot to ask for; I'm curious how far SystemML has gone > >in this direction. > > > >3. Is there any relationship between the SystemML optimizer and Apache > >Calcite <https://calcite.apache.org/>? If not, I'd love to > understand > > > >the design decisions that differentiate the two. > > > > Thanks, Dylan Hutchison > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: [NOTICE] New Apache SystemML Committer & PPMC Member: Nakul Jindal

2017-01-20 Thread Deron Eriksson
t;>> > > >>>> I'd like to welcome Nakul Jindal as a new Committer and PPMC member > for > > >>>> the Apache SystemML project! > > >>>> > > >>>> > > >>>> > > >>>> Thanks for all of the hard work so far, Nakul, and welcome! > > >>>> > > >>>> > > >>>> > > >>>> > > >>>> > > >>>> The Apache SystemML PPMC Members > > >>>> > > >>>> > > >>>> > > >>>> -- > > >>>> > > >>>> > > >>>> > > >>>> Mike Dusenberry > > >>>> > > >>>> GitHub: github.com/dusenberrymw > > >>>> > > >>>> LinkedIn: linkedin.com/in/mikedusenberry > > >>>> > > >>>> > > >>>> > > >>>> Sent from my iPhone. > > >>>> > > >>>> > > >>>> > > >>>> > > >>> > > > > > > > > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: SystemML Branch for any fixes related to Spark 1.6x

2017-01-13 Thread Deron Eriksson
nch my_local_branch > > > > For creating dev branches for 1.6, first go to you local 1.6 branch and > > continue with your regular steps such as git branch -b JIRA-222 > > > > And good luck !!! > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Maven build failing

2017-01-09 Thread Deron Eriksson
ded only for use by the > >>> individual or entity to which it is addressed. If the reader of this > >>> message is not the intended recipient, you are hereby notified that > >>> any review, retransmission, dissemination, distribution, copying or > >>> other use of, or taking of any action in reliance upon this > >>> information is strictly prohibited. If you have received this > >>> communication in error, please contact the sender and delete the > >>> material from your computer. > >>> > >> > > > > > > > > > > The information contained in this e-mail is confidential and/or > proprietary to Capital One and/or its affiliates and may only be used > solely in performance of work or services for Capital One. The information > transmitted herewith is intended only for use by the individual or entity > to which it is addressed. If the reader of this message is not the intended > recipient, you are hereby notified that any review, retransmission, > dissemination, distribution, copying or other use of, or taking of any > action in reliance upon this information is strictly prohibited. If you > have received this communication in error, please contact the sender and > delete the material from your computer. > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Maven build failing

2017-01-06 Thread Deron Eriksson
may only be used >> solely in performance of work or services for Capital One. The >> information transmitted herewith is intended only for use by the >> individual or entity to which it is addressed. If the reader of this >> message is not the intended recipient, you are hereby notified that >> any review, retransmission, dissemination, distribution, copying or >> other use of, or taking of any action in reliance upon this >> information is strictly prohibited. If you have received this >> communication in error, please contact the sender and delete the >> material from your computer. >> > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Time To Merge Spark 2.0 Support PR

2017-01-06 Thread Deron Eriksson
is time to merge the above PR into the master branch of the > > project in order to move SystemML onto Spark 2.x. > > > > Thoughts? If no objections, I'd like to merge next week. > > > > > > Cheers! > > > > - Mike > > > > -- > > > > Michael W. Dusenberry > > GitHub: github.com/dusenberrymw > > LinkedIn: linkedin.com/in/mikedusenberry > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: GSoc 2017

2017-01-06 Thread Deron Eriksson
and Scala. > > My Webpage > kkalyan.in > > My Spark Pull Requests > https://github.com/apache/spark/pulls?utf8=%E2%9C%93&q=is%3Apr%20author% > 3Akrishnakalyan3%20 > > Thank you so much, > Krishna > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: Release cadence

2017-01-05 Thread Deron Eriksson
> release process because, as I mentioned before, the release early, > release > > often mantra is good to increase community interest, generate more > traffic > > to the list as developers discuss the roadmap and release blockers, and > > also enable users to provide feedback sooner on the areas we are > developing. > > > > > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > -- Deron Eriksson Spark Technology Center http://www.spark.tc/

Re: test suite running slowly after disable cache/sparse commit?

2016-12-09 Thread Deron Eriksson
queue. If that is not > common, we can wait. > -Arvind From: Deron Eriksson > To: dev@systemml.incubator.apache.org > Sent: Friday, December 9, 2016 7:34 AM > Subject: Re: test suite running slowly after disable cache/sparse commit? > > Hi Fred, > > The last two da

Re: test suite running slowly after disable cache/sparse commit?

2016-12-08 Thread Deron Eriksson
even > be reviewing most PRs until after they have passed the automated tests. > > Deron, are you seeing a backlog of not-yet-started builds queueing up on > the PR build server? If the queue is getting long, we can add additional > machines to the Jenkins cluster. > > Fred >

Removing unused code

2016-11-30 Thread Deron Eriksson
Hi, I just submitted a few pull requests to do some minor refactoring to remove some unused code. Please let me know if you believe any of this code is not actually dead code and should be kept, or if it should be kept with comments (such as 'TODO: operation needs to be implemented', etc). [SYST

Re: Build failed in Jenkins: SystemML-DailyTest #635

2016-11-18 Thread Deron Eriksson
6]jenkins---11/18/2016 > 03:12:48 PM---See <https://sparktc.ibmcloud.com/jenkins/job/SystemML- > DailyTest/635/changes> Changes: > > From: jenk...@spark.tc > To: Michael W Dusenberry/San Francisco/IBM@IBMUS, lrese...@apache.org, > dev@systemml.incubator.apache.org, Deron Eriksson/Sa

Re: Release process document for SystemML

2016-11-18 Thread Deron Eriksson
Hi Arvind, Thank you for bringing this up. Just wanted to let you know we have https://issues.apache.org/jira/browse/SYSTEMML-848 to address this. I would be happy to work with Luciano in the creation of such documentation. Since Luciano has had to do all of our release deployments by himself, I w

Enabled doclint javadoc checking

2016-11-18 Thread Deron Eriksson
Hi, I have enabled javadoc doclint checking. Previously the default Java 8 doclint checking was turned off by a profile because of javadoc errors in the project. Since these errors have been fixed, we can now turn on the default Java 8 doclint behavior. Javadoc errors will cause the build to fail,

Re: Release artifacts

2016-11-07 Thread Deron Eriksson
Hi Luciano, Here is my understanding of the release artifacts at a very high level. On Sun, Nov 6, 2016 at 6:10 PM, Luciano Resende wrote: > This has been causing confusion with IPMC, and I want to document my > understanding of the release artifacts: > > Source Distribution > systemml-0.11.0-i

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC5)

2016-11-03 Thread Deron Eriksson
+1 Successfully cloned the tagged version and packaged using a clean maven repo. Test suite passed on OS X. Ran in 2 hours 27 minutes using 1.7.0_80-b15. Downloaded all rc5 artifacts and verified that 'hello world' DML works for each. Verified that project can be built using src release. Single no

Re: [DRAFT] November monthly report

2016-11-02 Thread Deron Eriksson
Thank you for reviewing, Luciano. On Wed, Nov 2, 2016 at 5:12 PM, Luciano Resende wrote: > +1, Reviewed on the wiki as a mentor > > On Wed, Nov 2, 2016 at 8:45 AM, Deron Eriksson > wrote: > > > Thank you for the feedback Mike. I added the VLDB paper award. > > >

Generating podling monthly report stats

2016-11-02 Thread Deron Eriksson
Hi, In case it's useful for anyone else writing a future podling report, here are a few things that can be done to generate stats: 1) # emails Go to http://mail-archives.apache.org/mod_mbox/incubator-systemml-dev/ and add up the 3 previous months (200 + 103 + 72). 2) # new contributors See who h

Re: [DRAFT] November monthly report

2016-11-02 Thread Deron Eriksson
> > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Nov 1, 2016, at 4:43 PM, Deron Eriksson > wrote: > > > > Hello, > > > > Here is a draft of the November monthly

[DRAFT] November monthly report

2016-11-01 Thread Deron Eriksson
Hello, Here is a draft of the November monthly report due tomorrow that Felix and I put together. Feedback is welcome. Deron SystemML SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generati

Re: SystemML 0.11.0-incubating RC4 feedback

2016-10-31 Thread Deron Eriksson
t reduce this confusion by dropping our number of released artifacts, as addressed by https://issues.apache.org/jira/browse/SYSTEMML-926. Deron On Mon, Oct 31, 2016 at 10:14 AM, Deron Eriksson wrote: > Hi, > > I mentioned here that the "source-release.zip" is not something

Re: Podling Report Reminder - November 2016

2016-10-31 Thread Deron Eriksson
Thank you Felix! I really appreciate it! Deron On Mon, Oct 31, 2016 at 1:01 PM, wrote: > I will help you, Deron! > > Felix > > > Am 31.10.2016 20:26 schrieb Deron Eriksson: > >> If there are no other volunteers to help with the report, I will help. If >> any

Re: [DISCUSS] Adding tensorboard-like functionality to SystemML

2016-10-31 Thread Deron Eriksson
Hi Jeremy, I think moving forward with visualization and design is a great idea, especially since I feel there is currently momentum after the great design refactoring of the project website. Mike and Jeremy, please let me know if there's any way in which I can help. Deron On Fri, Oct 28, 2016

Re: Podling Report Reminder - November 2016

2016-10-31 Thread Deron Eriksson
If there are no other volunteers to help with the report, I will help. If anyone else is interested in writing the monthly report, I would also be very happy to provide any assistance and guidance. Contributing to the project monthly report is a great way to become familiar with ASF procedures and

Re: rc3 source-release.zip artifact

2016-10-31 Thread Deron Eriksson
2016, at 10:55 PM, Glenn Weidner > wrote: > > > > > > In my opinion it can be removed. > > > > > > Thanks, > > > Glenn > > > > > > Deron Eriksson ---10/20/2016 01:36:04 PM---The 0.11.0 rc3 artifacts are > > located at: https://di

Re: SystemML 0.11.0-incubating RC4 feedback

2016-10-31 Thread Deron Eriksson
Hi, I mentioned here that the "source-release.zip" is not something I recognize: https://www.mail-archive.com/dev@systemml.incubator.apache.org/msg00960.html Is this mystery artifact created by the script to deploy release candidates? It should definitely be removed in my opinion. Deron On S

Re: Couple of questions on website contents

2016-10-25 Thread Deron Eriksson
Hi Luciano, Since the current website updates are major improvements, I have gone ahead and published the new updates. I think we can now start publishing more frequently since important parts of the codebase have stabilized. Deron On Tue, Oct 25, 2016 at 5:40 PM, Deron Eriksson wrote: >

Re: Couple of questions on website contents

2016-10-25 Thread Deron Eriksson
Hi Luciano, Several updates to the website were merged today. I think we're at the point where we can publish the new website updates. Do you agree? Deron On Tue, Oct 25, 2016 at 11:02 AM, Jason Azares wrote: > Hi Luciano, > > Initial page: > > - What's the intention of the section just abov

Re: SystemML Medium Blog

2016-10-25 Thread Deron Eriksson
+1. Great idea! On Tue, Oct 25, 2016 at 3:46 PM, Renee Mascarinas wrote: > +1 This is a great idea! It would be nice to invite the community to write > about their experiences with SystemML as well. Maybe we can start with > Medium and in the future, do a youtube vlog :] > > On Tue, Oct 25, 20

Re: [VOTE] SystemML New Logo Ideas

2016-10-25 Thread Deron Eriksson
+1 sounds great to me too. On Tue, Oct 25, 2016 at 12:44 PM, wrote: > +1 that sounds great to me. > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Oct 25, 2016, at 10:45 AM, Madison Myers > wrote: > > >

Re: Local versions of Linear Algebra Operators in DML

2016-10-24 Thread Deron Eriksson
Would it be acceptable for a user to receive a log warning if the user uses an operation that is currently only implemented for single node? My concern is that there is an expectation for operations to be distributed with SystemML, and if an operation is not currently distributed, the user needs to

Re: use of systemml-0.10.0.incubating.jar

2016-10-21 Thread Deron Eriksson
Hi James, Thank you for the great questions! I think some of the issues that you are experiencing are usage issues from a failure on our part to convey this information clearly. The good news is that a tremendous amount of effort and focus is currently being directed towards fixing our website and

Re: [VOTE] SystemML New Logo Ideas

2016-10-21 Thread Deron Eriksson
x27;t expecting > > this at all. Somehow my eyes always ignored this. > > > > Regards, > > Matthias > > > > > > On 10/21/2016 9:22 PM, Deron Eriksson wrote: > > > >> I think they all look fantastic. My untrained eye likes the features of >

Re: Local versions of Linear Algebra Operators in DML

2016-10-21 Thread Deron Eriksson
Hi Nakul, +1 I think having some clear characteristic to distinguish operations that only operate locally is a great idea. Otherwise, how would a user know that these operations are only local and not distributed? Adding this naming convention for local operations sounds reasonable to me so that w

Re: [VOTE] SystemML New Logo Ideas

2016-10-21 Thread Deron Eriksson
I think they all look fantastic. My untrained eye likes the features of 3 and 4 but I completely defer to the judgements of others here since I have no training in design and the multitude of considerations involved such as scalability. I believe the logo trademark is an official requirement of th

rc3 source-release.zip artifact

2016-10-20 Thread Deron Eriksson
The 0.11.0 rc3 artifacts are located at: https://dist.apache.org/repos/dist/dev/incubator/systemml/0.11.0-incubating-rc3/ I see the following artifact: systemml-0.11.0-incubating-source-release.zip I do not recognize this artifact. Can anyone tell me what this artifact is? Can it be removed? Der

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
be ok, but it's a community decision. > > On Wed, Oct 19, 2016 at 10:50 AM, Deron Eriksson > wrote: > > > I believe that for an Apache release, our test suite is supposed to pass > > (although I'm pretty sure random test fails can be ignored). > > &

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC3)

2016-10-19 Thread Deron Eriksson
I believe that for an Apache release, our test suite is supposed to pass (although I'm pretty sure random test fails can be ignored). See 2.1 of Release Check List here: http://incubator.apache.org/guides/releasemanagement.html#check-list "2.1 Build is successful including automated tests. The ex

Re: Enhancing SystemML JavaDocs

2016-09-30 Thread Deron Eriksson
uld prefer to leave the empty (automatically generated) > javadoc comments - at least in eclipse, this provides a better overview of > parameters and exceptions. > > Regards, > Matthias > > [image: Inactive hide details for Deron Eriksson ---09/30/2016 12:35:30 > PM---Hi Lucian

Re: Enhancing SystemML JavaDocs

2016-09-30 Thread Deron Eriksson
Hi Luciano, I am definitely in favor of fixing these javadocs. I created https://issues.apache.org/jira/browse/SYSTEMML-842 two months ago to address this issue. However, there are so many problems with the javadocs that I think addressing this should probably be broken down into separate java pa

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-29 Thread Deron Eriksson
The SYSTEMML-963 and SYSTEMML-967/-971 issues have been resolved and are no longer blocking the release. Deron On Wed, Sep 28, 2016 at 3:24 PM, Deron Eriksson wrote: > -1, SYSTEMML-963 and SYSTEMML-967 are potential needed license fixes. > Glenn and I should have these issues addres

Re: Continuing development on the website

2016-09-28 Thread Deron Eriksson
s been tagged as v0.1. > > On Wed, Sep 28, 2016 at 2:13 PM, Deron Eriksson > wrote: > > > Hello Luciano, > > > > I would prefer doing fixes on master for the website. However, I do not > > feel strongly about this issue. > > > > Anyone else any thought

Re: [VOTE] Apache SystemML 0.11.0-incubating (RC1)

2016-09-28 Thread Deron Eriksson
-1, SYSTEMML-963 and SYSTEMML-967 are potential needed license fixes. Glenn and I should have these issues addressed by tomorrow. Deron On Wed, Sep 28, 2016 at 3:16 PM, Luciano Resende wrote: > On Wed, Sep 28, 2016 at 3:14 PM, Matthias Boehm wrote: > > > -1, unfortunately, SYSTEMML-964 and SY

Re: Continuing development on the website

2016-09-28 Thread Deron Eriksson
Hello Luciano, I would prefer doing fixes on master for the website. However, I do not feel strongly about this issue. Anyone else any thoughts? Deron On Wed, Sep 28, 2016 at 1:28 PM, Luciano Resende wrote: > I have created a PR [1] porting the Jekyll based website to use the new > design co

Re: [Discuss} SystemML Roadmap page

2016-09-23 Thread Deron Eriksson
+1 Great idea, Berthold. Adding a roadmap to the project will be a very welcome addition to the project, both for users and developers. Deron On Fri, Sep 23, 2016 at 12:10 PM, Berthold Reinwald wrote: > In the spirit of other Apache projects, we should publish a Roadmap page. > The page shoul

Re: [DISCUSS] SystemML releases 0.11 and 1.0

2016-09-21 Thread Deron Eriksson
+1 Deron On Tue, Sep 20, 2016 at 9:51 AM, Niketan Pansare wrote: > +1 for 0.11 release > > Thanks > > Niketan > > > On Sep 19, 2016, at 10:39 PM, Acs S wrote: > > > > I would agree to most of the part except that there would be need to > have SystemML support on Spark 2.0 for "Spark As A Serv

Re: Simplification of MLContext and related APIs

2016-09-12 Thread Deron Eriksson
ixObject/FrameObject and > other internal structures from API level, remove the > BinaryBlockMatrix/BinaryBlockFrame > types, and try to consolidate the various Matrix/Frame objects as well as > replicated compilation chains. > > Regards, > Matthias > > [image: Inactive hid

Re: Simplification of MLContext and related APIs

2016-09-12 Thread Deron Eriksson
Feel free to not expose MatrixObject and FrameObject. I am fine with that. The only reason MatrixObject and FrameObject are exposed is that I felt if the new MLContext API did not expose them, there would be complaints from existing committers that these objects were not available. I can't see anyo

Re: Build failed in Jenkins: SystemML-DailyTest #495

2016-09-09 Thread Deron Eriksson
ception. I've made a change and I'll run the test suite and verify the tests work and then commit a hotfix if that fixes it. Deron On Fri, Sep 9, 2016 at 4:01 PM, wrote: > See <https://sparktc.ibmcloud.com/jenkins/job/SystemML- > DailyTest/495/changes> > > Chan

Re: New SystemML website design

2016-09-04 Thread Deron Eriksson
eremy. The website looks awesome !! > > Deron/Luciano: Do you think we should change the 'Get Started' link to > point to one of the beginner's guide rather than point to the Download > page ? Alternatively we can add a link in Download page instructing what > the u

Re: New SystemML website design

2016-09-04 Thread Deron Eriksson
Wow, these updates really look incredible! Thank you Jeremy Anderson for this amazing contribution! Deron On Sun, Sep 4, 2016 at 11:13 AM, Luciano Resende wrote: > Jeremy Anderson has been so kind to spend few days on a new design for the > Apache SystemML website, and this is now attached to

Re: [DISCUSS] Apache SystemML Release 1.0.0

2016-08-25 Thread Deron Eriksson
+1 Deron On Thu, Aug 25, 2016 at 4:56 PM, Luciano Resende wrote: > On Thu, Aug 25, 2016 at 4:01 PM, Deron Eriksson > wrote: > > > Luciano, > > > > Yes, I like the idea of the next release being SystemML 1.0. Given the > > significance of the version, it wou

Re: [DISCUSS] Apache SystemML Release 1.0.0

2016-08-25 Thread Deron Eriksson
Luciano, Yes, I like the idea of the next release being SystemML 1.0. Given the significance of the version, it would be a good idea to not rush the release so that we can make this a truly great release. Deron On Thu, Aug 25, 2016 at 3:45 PM, Luciano Resende wrote: > On Thu, Aug 25, 2016 at

Re: [DISCUSS] SystemML with Spark 2.0 support and roadmap

2016-08-23 Thread Deron Eriksson
sounds like a good plan to allow us to continue supporting the Spark > 1.x line in the short term, with a plan for moving to Spark 2.x support > soon. > > -Mike > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberr

Re: Fw: [DISCUSS] SystemML with Spark 2.0 support and roadmap

2016-08-17 Thread Deron Eriksson
+1 Continuing to support Spark 1.4/1.6 for now while setting a cutover date for 2.0 sounds like a great idea. This allows for the creation of a really solid release for 1.x, which greatly benefits SystemML users using Spark 1.x. It also gives these users a general date that they can use to plan mig

Re: Calling System ML from sparkR

2016-08-17 Thread Deron Eriksson
Hi Sourav, Great question. Work is currently being performed by Alok Singh (see https://issues.apache.org/jira/browse/SYSTEMML-860) regarding this topic. Deron On Mon, Aug 15, 2016 at 9:31 AM, Sourav Mazumder < sourav.mazumde...@gmail.com> wrote: > Hi, > > Is there any work going on to call Sy

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-16 Thread Deron Eriksson
etailed code comments and suggestions to try out can be made in the > branch commit instead of this mail thread. > > Thanks, > Glenn > > Deron Eriksson ---08/05/2016 02:02:10 PM---I am open to the idea of > supporting Spark 2 and Spark<2 concurrently if someone shows th

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-05 Thread Deron Eriksson
l features since 0.10 (specifically frames, the prototype > Python > > DSL, and the new MLContext) and it would be good to have a Spark 1.6 > branch > > of our version tree where we can backport the debugged versions of these > > features if needed. > > > > I would reco

Re: Draft for August monthly report

2016-08-03 Thread Deron Eriksson
t; > Regards, > Matthias > > > [image: Inactive hide details for Deron Eriksson ---08/02/2016 05:39:53 > PM---Here is a draft I created for the August monthly report. F]Deron > Eriksson ---08/02/2016 05:39:53 PM---Here is a draft I created for the > August monthly report. Feedback we

Draft for August monthly report

2016-08-02 Thread Deron Eriksson
Here is a draft I created for the August monthly report. Feedback welcome. Deron - SystemML SystemML provides declarative large-scale machine learning (ML) that aims at flexible specification of ML algorithms and automatic generation of hybrid runtime plans ranging from single node, in-memor

Re: [DISCUSS] Migration to Spark 2.0.0

2016-08-02 Thread Deron Eriksson
I would definitely be in favor of moving to Spark 2.0 as early as possible. This will allow SystemML to be current with cutting edge Spark. It would be nice to focus our efforts on the latest Spark. Deron On Tue, Aug 2, 2016 at 12:05 PM, wrote: > I'm in favor of moving to Spark 2.0 now, meanin

Re: Build failed in Jenkins: SystemML-DailyTest #413

2016-07-30 Thread Deron Eriksson
3/changes> > > Changes: > > [Deron Eriksson] [SYSTEMML-832] Upgrade Scala version and prune > dependencies > > -- > Started by timer > [EnvInject] - Loading node environment variables. > [EnvInject] - Preparing an environment for

  1   2   3   >