Re: [scikit-learn] combining arrays of features to train an MLP

2016-12-20 Thread Sebastian Raschka
Hi, Thomas, I haven’t looked what RandomizedLasso does exactly, but like you said, it is probably not ideal for combining it with an MLP. What In terms of regularization, I was more thinking of the L1 and L2 for the hidden layers, or dropout. However, given such a small sample size (and the

Re: [scikit-learn] combining arrays of features to train an MLP

2016-12-19 Thread Thomas Evangelidis
Thank you, these articles discuss about ML application of the types of fingerprints I working with! I will read them thoroughly to get some hints. In the meantime I tried to eliminate some features using RandomizedLasso and the performance escalated from R=0.067 using all 615 features to R=0.524

Re: [scikit-learn] combining arrays of features to train an MLP

2016-12-19 Thread Sebastian Raschka
Oh, sorry, I just noticed that I was in the wrong thread — meant answer a different Thomas :P. Regarding the fingerprints; scikit-learn’s estimators expect feature vectors as samples, so you can’t have a 3D array … e.g., think of image classification: here you also enroll the n_pixels times

Re: [scikit-learn] combining arrays of features to train an MLP

2016-12-19 Thread Thomas Evangelidis
this means that both are feasible? On 19 December 2016 at 18:17, Sebastian Raschka wrote: > Thanks, Thomas, that makes sense! Will submit a PR then to update the > docstring. > > Best, > Sebastian > > > > On Dec 19, 2016, at 11:06 AM, Thomas Evangelidis

Re: [scikit-learn] combining arrays of features to train an MLP

2016-12-19 Thread Sebastian Raschka
Thanks, Thomas, that makes sense! Will submit a PR then to update the docstring. Best, Sebastian > On Dec 19, 2016, at 11:06 AM, Thomas Evangelidis wrote: > > ​​ > Greetings, > > My dataset consists of objects which are characterised by their structural > features which

[scikit-learn] combining arrays of features to train an MLP

2016-12-19 Thread Thomas Evangelidis
​​ Greetings, My dataset consists of objects which are characterised by their structural features which are encoded into a so called "fingerprint" form. There are several different types of fingerprints, each one encapsulating different type of information. I want to combine two specific types of