Hi Himanshu! We feel great you are here. SystemML is a very friendly community.
To get started. 1. see the components of the SystemML, here in this link: https://issues.apache.org/jira/projects/SYSTEMML?selectedItem=com.atlassian.jira.jira-projects-plugin:components-page 2. Through this link you can select any component of your interest, and you can browse through the corresponding issues and find which one(s) of them fascinates you. 3. If you any need guidance on how to proceed on that particular issues notify the other committers on the mailing list or in the jira itself. Thanks a lot, Cheers, Janardhan On Tue, Jul 25, 2017 at 8:36 PM, Himanshu Mohan <himanshu.moha...@gmail.com> wrote: > I am also interested in doing some real life hands on work in SystemML > > Thanks and Regards > Himanshu > > > On 25-Jul-2017, at 2:57 PM, arijit chakraborty <ak...@hotmail.com> > wrote: > > > > Hi Matthias, > > > > > > Thanks for your mail. I'm attaching again the server configurations. I'm > also adding your personal email id, just to be double sure you can see the > images. Pardon me for that. I could improve the setup further so that now I > can run the code at the same speed as R (around 40 mins). But this setup > I'm sharing is the older setup. So most probably the performance of my code > was dependent on spark configuration. So if you can help me on that. > > > > > > Also, currently I'm mainly working on CNN works. And I've decent > programming experience in python & R. But I would request you to share with > me project which is among the least priority one. This will help me to get > accustomed with this project setup without getting bothered about time > lines. > > > > > > Thank you! > > > > Arijit<cluster performance.png> > > <cluster specs.png> > > <cores.png> > > From: Matthias Boehm <mboe...@googlemail.com> > > Sent: Tuesday, July 25, 2017 2:10:52 PM > > To: dev@systemml.apache.org > > Subject: Re: Update Spark Configuration to improve SystemML performance > > > > great to hear that - we welcome additional contributions. Just let us > know > > in which area you're most interested in (e.g., algorithms, APIs, > optimizer, > > runtime, etc) and we could identifying a couple of tasks to get you > started. > > > > Regarding the performance numbers, I am not able to see the details. Also > > could you share which operation was causing the large GC overhead - maybe > > we can improve the runtime for the specific scenario. Thanks. > > > > Regards, > > Matthias > > > > On Mon, Jul 24, 2017 at 12:17 PM, arijit chakraborty <ak...@hotmail.com> > > wrote: > > > > > Hi, > > > > > > > > > I tried to work on spark configuration file to improve the systemML > > > performance. Even after much tuning R code is running in 40 mins, but > > > SystemML is taking 2.2 hours. Please find the spark configuration > > > screenshots. Please let me know if I'm making some mistake in tuning > of the > > > spark configuration. One problem we could rectify is garbage time > error. > > > Now, it's completely not there. That was one major bottleneck which was > > > making the code extremely slow. > > > > > > > > > I'm working in local system and created a standalone version of spark, > > > with master and workers. The following are the details: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > I also wants to know is it possible to get involved with systemML > > > development? My project is almost on the verge of completion and I > learned > > > a lot from you all people. And I really liked this project. So I want > to > > > contribute more fruitfully in it. > > > > > > > > > Thank you! > > > > > > Arijit > > > >
