Good question! It's been a while (1-2 years) ago, but I remember that I had similar issues once; I think it's a namespace / scoping issue. In particular, based on my notes, I think that your python module needs to have the class (StemmedCountVectorizer) in its __main__ namespace when you call pickle.load. Not sure if it helps in this case, but you could try executing
"setattr(sys.modules["__main__"], "StemmedCountVectorizer", type(StemmedCountVectorizer())) before you are unpickling via pickle.load. Best, Sebastian > On Mar 29, 2016, at 4:49 AM, Mehdi <mehdielkod...@hotmail.fr> wrote: > > Hi, > > I'm currently facing a problem to add stemming to my vectorizer. > I've posted my problem on StackOverflow > http://stackoverflow.com/questions/36182502/add-stemming-support-to-countvectorizer-sklearn > > My problem is, when using my StemmedCountVectorizer with n_jobs=-1 in my > GridSearchCV it works. Otherwise it gives me this error: > AttributeError: 'module' object has no attribute 'StemmedCountVectorizer' > > Joeln seems to understand problem and proposed me a solution but I didn't > understand it. > Joeln said : > this seems to be an issue with pickling and unpickling scope. if you put > stemming in an imported module, for instance, it'll be unpickled more reliably > > How do I put a function or my class in a module ? > > Appreciate your help and your hard work. > Mehdi. > ------------------------------------------------------------------------------ > Transform Data into Opportunity. > Accelerate data analysis in your applications with > Intel Data Analytics Acceleration Library. > Click to learn more. > http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140_______________________________________________ > Scikit-learn-general mailing list > Scikit-learn-general@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ Transform Data into Opportunity. Accelerate data analysis in your applications with Intel Data Analytics Acceleration Library. Click to learn more. http://pubads.g.doubleclick.net/gampad/clk?id=278785471&iu=/4140 _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
