Re: Cleanup SystemML-config.xml

2017-07-12 Thread Deron Eriksson
+1 On Wed, Jul 12, 2017 at 7:56 PM, wrote: > +1 > > -- > > Mike Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > Sent from my iPhone. > > > > On Jul 12, 2017, at 7:51 PM, Niketan Pansare wrote: > > > > > > +1 > > > > Thanks > > > > Niketan > > > >> On

Re: Cleanup SystemML-config.xml

2017-07-12 Thread dusenberrymw
+1 -- Mike Dusenberry GitHub: github.com/dusenberrymw LinkedIn: linkedin.com/in/mikedusenberry Sent from my iPhone. > On Jul 12, 2017, at 7:51 PM, Niketan Pansare wrote: > > > +1 > > Thanks > > Niketan > >> On Jul 12, 2017, at 7:11 PM, Matthias Boehm > wrote: >> >> Hi all, >> >> I'd l

Re: Cleanup SystemML-config.xml

2017-07-12 Thread Niketan Pansare
+1 Thanks Niketan > On Jul 12, 2017, at 7:11 PM, Matthias Boehm wrote: > > Hi all, > > I'd like to use the opportunity of our SystemML 1.0 release to cleanup our > SystemML-config file. Specifically, I'd like to rename the following two > tags in order to correctly reflect their meaning (i.e.,

Cleanup SystemML-config.xml

2017-07-12 Thread Matthias Boehm
Hi all, I'd like to use the opportunity of our SystemML 1.0 release to cleanup our SystemML-config file. Specifically, I'd like to rename the following two tags in order to correctly reflect their meaning (i.e., multi-threaded operations and multi-threaded read/write in CP). cp.parallel.matrixmul

Re: Apache SystemML 1.0 Release build

2017-07-12 Thread Matthias Boehm
here is the list of open tasks (disregarding open bugs), that I think would be good to have in SystemML 1.0: SYSTEMML-1284 Code generation -> all remaining subtasks SYSTEMML-1299 Language features 1.0 -> 1301, 1304/1307, 1306, 1316, 1426, 1444 SYSTEMML-1308 Runtime reatures 1.0 -> 1313, 1637 SY

Re: Spark Core

2017-07-12 Thread Matthias Boehm
Well, we explicitly cleanup all intermediates that are no longer used. You can use -explain to output the runtime plan, which includes rmvar (remove variable), cpvar (copy variable) and mvvar (move variable) instructions that internally cleanup intermediates. This cleanup removes data from memory,

Apache SystemML 1.0 Release build

2017-07-12 Thread Arvind Surve
HI, As communicated earlier, we will plan to start SystemML 1.0 build sometime toward end of this week. Please let me know if you need additional time (approx how much)  if any of your MUST get in features for SystemML 1.0 are in intermediate state. -ArvindArvind Surve | Spark Technology Center  

Spark Core

2017-07-12 Thread arijit chakraborty
Hi, Suppose I've this following code: a = matrix(seq(1,10), 10,1) for(i in 1:100){ b = a + 10 write (b, "path" + ".csv", format="csv") } So what I'm doing is for 100 items, I'm adding a constant to a matrix than outputting it. And this operation occurs in spark using multiple core o