Hi,
in this case, I'm using a bayes (multinomial) estimator for binary
classification
The texts are rather short. In this case, the size of the dataset is
1000, but I have
the same kind of problem with datasets consisting of 20000 (or 80000) texts.

The Pipeline I'm using looks like this:
Pipeline([
    ('vect', CountVectorizer()),
    ('tfidf', TfidfTransformer()),
    ('clf', MultinomialNB()),
])

I'm trying the code in the gist, thanks!

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to