Samee Zahur skrev:
Hello,
Hi Samee.
I have read through nips paper and the march archive for this mailing
list, and I feel I can implement some of the algorithms (as permitted
by time) described in the nips paper. Being an undergrad student
interested in the field of data-intensive machine learning techniques
and applications, I am interested in implementing these algorithms as
a way of getting an exposure into this field.
Even though I have already applied to work in this SoC, I do have one
question though. When coding, how am I expected to test the
effectiveness of my algorithms without running it on a multicore
platform? Or do I simply assume that a sufficiently sensible
application of M/R will allow Hadoop to take care of scalability?
The effectiveness is not as interesting as the scalabillity. M/R is a
good fit if your job job can be divided in more map tasks than you have
processor cores in your computer.
I have heard of reports stating that in some cases up to 30% of the
resources are waisted compared to non M/R operations on a single
computer. But if you can run it on 2000 nodes usig M/R, well..
What is the usual development platform used here? Sorry if such questions
seem a bit silly, but it is in order gain the experience in such
development that I want to work in this project.
Platform as in source code editor?
And about the application for SoC, I selected the ASF as the mentoring
organisation - how do I make sure that someone from mahout reviews it?
Post it here.
Initially for the SoC, I want to implement LWLR, NN and PCA, but later
beyond the GSoC I want to continue contributing to this project in
other ways I figure out once I gain familiarity with the scope of this
project.
This is great to hear! Glad to have you here!
karl
