Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

I try to balance it out, the dataset is very periodic type (similar behaviour in an year) On Tue, May 31, 2016 at 8:01 PM, Andrew Holmes wrote: > Is the training set unbalanced between high and low values? Ie, many more > of the high ones? > > Best wishes > Andrew > > @andrewholmes82

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

Is the training set unbalanced between high and low values? Ie, many more of the high ones? Best wishes Andrew @andrewholmes82 > On 31 May 2016, at 20:00, muhammad waseem wrote: > > Yes, it has poor performance (higher errors) on lower values. > I h

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

Yes, it has poor performance (higher errors) on lower values. I have tried random forest but as I mentioned it did not give good results either, I can try SVR. Kindest Regards Waseem On Tue, May 31, 2016 at 6:54 PM, Andrew Holmes wrote: > When you say it’s not learning ‘lower values’, does that

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

When you say it’s not learning ‘lower values’, does that mean the model has good predictions on high values in the test set, but poor performance on the low ones? Have you tried simpler models like tree, random forest and svm as a benchmark? Best wishes Andrew @andrewholmes82

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

I have tried Random forest (with gridseacrhCV) but did not get good results. On Tue, May 31, 2016 at 7:18 PM, Jacob Schreiber wrote: > Using the same feature set? How well do other estimators work? (Linear > regression, gradient boosting, etc...) > > On Tue, May 31, 2016 at 11:10 AM, muhammad wa

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

Using the same feature set? How well do other estimators work? (Linear regression, gradient boosting, etc...) On Tue, May 31, 2016 at 11:10 AM, muhammad waseem wrote: > This problem has been solved in the literature before, I can post papers. > > On Tue, May 31, 2016 at 7:07 PM, Jacob Schreiber

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

This problem has been solved in the literature before, I can post papers. On Tue, May 31, 2016 at 7:07 PM, Jacob Schreiber wrote: > Do you have any other baselines which you can compare to? It might be > helpful in seeing if this is a problem which can be learned. > > On Tue, May 31, 2016 at 10:

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

Do you have any other baselines which you can compare to? It might be helpful in seeing if this is a problem which can be learned. On Tue, May 31, 2016 at 10:47 AM, muhammad waseem wrote: > Thanks for your reply. I have day, month, hour, temp, relative humidity, > Wind speed as my input variable

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

Thanks for your reply. I have day, month, hour, temp, relative humidity, Wind speed as my input variables. I can't think of any other dependant variables. It is quite strange to me that I don't get results after using these input variables. On Tue, May 31, 2016 at 4:59 PM, Andrew Holmes wrote: >

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

If the problem is that it’s confusing day and night, are you including time of day as a parameter? Best wishes Andrew @andrewholmes82 > On 31 May 2016, at 16:55, muhammad waseem wrote: > > Hi All, > I am trying to train an ANN but until now it is not

Re: [scikit-learn] Artificial neural network not learning lower values of the training sample

It sounds like you're right about the low values being connected between night and clouds. Since there's no seasonality outside of recurrent NNs, maybe try adding an hour of day variable. On May 31, 2016 11:57 AM, "muhammad waseem" wrote: Hi All, I am trying to train an ANN but until now it is no

[scikit-learn] Artificial neural network not learning lower values of the training sample

Hi All, I am trying to train an ANN but until now it is not learning the lower values of the training sample. I have tried using different python libraries to train ANN. The aim is to predict solar radiation from other weather parameters (regression problem). I think the ANN is confusing lower valu