For the slow down, if you change the stride or padding pattern, then it is normal that this change the speed. The old convolution support only some strides pattern and don't support padding.
The only way to compare the speed between the old and new back-end is with the exact same parameter and by calling the 2 different implementation (theano.tensor.nnet.conv2d vs theano.tensor.nnet.conv.conv2d). I can't run your code. It don't work. It miss other files and it don't call the init_weight correctly. For g++, thanks for telling it. We should keep that discussion in that thread. Probably Theano don't compile with it for now. Fred On Sun, Sep 11, 2016 at 7:38 PM, <[email protected]> wrote: > Hi nouiz, > > I've attached an example. You can run the same file on new and old conv2d > by removing the strides and padding. > > On another note since I've upgrade gcc/g++ from 4.9 to 6.1 I've been > having problems trying to compile the theano tests. The issues are similar > to those here <https://github.com/Theano/Theano/issues/4955>. If you guys > could have a look and let us know how to proceed because everything else > I've tried have failed. Even when using the correct compiler and linker > settings grabbed from intel mkl link line advisor. The errors persist even > if I don't use intel mkl and simply link to openblas. Tried compiling test > without openblas simply g++ and still got errors. > > > > On Saturday, September 10, 2016 at 12:56:54 AM UTC+1, nouiz wrote: >> >> I'm really surprised that the old one is faster in multiple cores then >> the new one. Can you provide a script that shot that? It could be just for >> some shapes >> >> Le 4 sept. 2016 12:41, <[email protected]> a écrit : >> >>> Thank you nouiz! Great to know. Does that imply that the new conv2d >>> doesn't use full parallelism capabilities as the old one? >>> BTW in both the experiments that I've run I've tested the new conv2d >>> against the old with openblas and mkl-intel libraries. >>> The results were the same the old one utilizes better the available >>> cores. The new one fluctuates a lot. But the down side is that >>> the old conv2d doesn't support arguments for strides and padding besides >>> the pre-defined ones. >>> >>> Thanks again. >>> >>> >>> On Thursday, September 1, 2016 at 4:55:05 PM UTC+1, nouiz wrote: >>>> >>>> They use different implementation. Make sure Theano use a parallel blas >>>> library. The new conv2d use it for part of the parallelism. >>>> >>>> Le 25 août 2016 21:53, <[email protected]> a écrit : >>>> >>>>> Hi everyone, >>>>> >>>>> I've recently come across some weird behaviour regarding the new >>>>> theano.tensor.nnet.conv2d >>>>> and the old >>>>> theano.tensor.nnet.conv.conv2d >>>>> convolution functions. >>>>> >>>>> I have 2 different models one uses the old the other the new conv2d >>>>> method. >>>>> The difference between the two is that the the model that uses the new >>>>> conv2d methods has more layers than the other one, plus that I've >>>>> explicitly defined padding and stride. >>>>> >>>>> Other than that everything else is the same. Number of data, training >>>>> algorithm, batchSize .... etc. pretty much the same. >>>>> >>>>> Once I execute them, the smaller model with the old conv2d method >>>>> utilizes all the cores in my system ;) great. >>>>> The bigger model with the new conv2d method doesn't, which is strange >>>>> because in this case the bigger the model the more resources would need. >>>>> >>>>> Are there any differences in the way the two conv2d methods utilize >>>>> openmp? >>>>> >>>>> -- >>>>> >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "theano-users" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- >>> >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "theano-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- > > --- > You received this message because you are subscribed to the Google Groups > "theano-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- --- You received this message because you are subscribed to the Google Groups "theano-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
