Hi,

I want the softmax of the RNN output, to be computed within the step 
function, like below:


def step(x_t, h_tm1):
    h_t = self.activation(T.dot(x_t, self.W_in) + T.dot(h_tm1, self.W) + 
self.bh)
    y_t = T.dot(h_t, self.W_out) + self.by
    y_t = T.nnet.softmax(y_t)
    return h_t, y_t


However I do not get expected results and I am not sure where the problem 
is.
Can anybody give me a hint why this method does not work?

This is the scan function:


[self.h, self.y_pred], _ = theano.scan(step,
            sequences=self.input,
            outputs_info=[T.alloc(self.h0, self.input.shape[1],
                                  n_hidden), None])



and I directly pass self.y_pred to p_y_given_x:


self.p_y_given_x = self.y_pred



Thanks in advance.

-- 

--- 
You received this message because you are subscribed to the Google Groups 
"theano-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/d/optout.

Reply via email to