Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Peter Prettenhofer
2012/9/14 Philipp Singer : > Hey! > > Am 14.09.2012 15:10, schrieb Peter Prettenhofer: >> >> I totally agree - I had such an issue in my research as well >> (combining word presence features with SVD embeddings). >> I followed Blitzer et. al 2006 and normalized** both feature groups >> separately -

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Philipp Singer
forge.net >> Gesendet: Freitag, 14. September 2012 14:00:48 >> Betreff: Re: [Scikit-learn-general] Combining TFIDF and LDA features >> >> Am 14.09.2012 14:53, schrieb Andreas Müller: >>> Hi Philipp. >> >> Hey Andreas! >>> First, you should ensure t

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Philipp Singer
Hey! Am 14.09.2012 15:10, schrieb Peter Prettenhofer: > > I totally agree - I had such an issue in my research as well > (combining word presence features with SVD embeddings). > I followed Blitzer et. al 2006 and normalized** both feature groups > separately - e.g. you could normalize word presen

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Philipp Singer
che Mail - > Von: "Philipp Singer" > An: scikit-learn-general@lists.sourceforge.net > Gesendet: Freitag, 14. September 2012 14:00:48 > Betreff: Re: [Scikit-learn-general] Combining TFIDF and LDA features > > Am 14.09.2012 14:53, schrieb Andreas Müller: >> Hi Philipp.

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Philipp Singer
kit-learn-general@lists.sourceforge.net > <mailto:scikit-learn-general@lists.sourceforge.net> > Gesendet: Freitag, 14. September 2012 14:00:48 > Betreff: Re: [Scikit-learn-general] Combining TFIDF and LDA features > > Am 14.09.2012 14:53, schrieb Andreas Mülle

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread amir rahimi
- Ursprüngliche Mail - > Von: "Philipp Singer" > An: scikit-learn-general@lists.sourceforge.net > Gesendet: Freitag, 14. September 2012 14:00:48 > Betreff: Re: [Scikit-learn-general] Combining TFIDF and LDA features > > Am 14.09.2012 14:53, schrieb Andreas Müller: > > Hi

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Peter Prettenhofer
2012/9/14 Andreas Müller : > Hi Philipp. > First, you should ensure that the features all have approximately the same > scale. > For example they should all be between zero and one - if the LDA features > are much smaller than the other ones, then they will probably not be weighted > much. I tot

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Andreas Müller
I'd be interested in the outcome. Let us know when you get it to work :) - Ursprüngliche Mail - Von: "Philipp Singer" An: scikit-learn-general@lists.sourceforge.net Gesendet: Freitag, 14. September 2012 14:00:48 Betreff: Re: [Scikit-learn-general] Combining TFIDF and L

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Philipp Singer
Am 14.09.2012 14:53, schrieb Andreas Müller: > Hi Philipp. Hey Andreas! > First, you should ensure that the features all have approximately the same > scale. > For example they should all be between zero and one - if the LDA features > are much smaller than the other ones, then they will probably

Re: [Scikit-learn-general] Combining TFIDF and LDA features

2012-09-14 Thread Andreas Müller
Hi Philipp. First, you should ensure that the features all have approximately the same scale. For example they should all be between zero and one - if the LDA features are much smaller than the other ones, then they will probably not be weighted much. Which LDA package did you use? I am not ver