That is a really old paper that basically pre-dates all of the recent
important work in neural networks.
You should look for works on Rectified Linear Units (ReLU), drop-out
regularization, parameter servers (downpour sgd) and deep learning.
Map-reduce as you have used it will not produce
I am trying to implement Neural Network in MapReduce. Apache mahout is
reffering this paper
http://www.cs.stanford.edu/people/ang/papers/nips06-mapreducemulticore.pdf
Neural Network (NN) We focus on backpropagation By defining a network
structure (we use a three layer network with two output
Hi,
I don't get it - whats is idea of parallelising algorithm, that is quite
fast and in general focuses only on simple arithmetic operations. The
algorithm itself is difficult to parallelise as it requires series of
weight updates, so I believe that MapReduce payload would be bigger than
On Thu, Feb 12, 2015 at 4:13 PM, Alpha Bagus Sunggono bagusa...@gmail.com
wrote:
In my opinion,
- This is just for 1 iteration. Then, batch gradient means find all delta,
then updates all weight. So , I think its improperly if each have weight
updated. Weight updated should be after Reduced.
