> I had similar issues when I was running code on our clusters. I think that > software & hardware architecture may also be a factor to be considered. What I > observed was that the memory usage was growing over time. I added a few lines > to manually clear the garbage collection, which solved the issue.
I'd really love to see these lines. Do you want to create an issue on the joblib tracker (joblib would probably be the place) to discuss this? Gaƫl ------------------------------------------------------------------------------ _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general