Hi, I once encountered the same error when pickling very large objects (> 2Go). The error comes indeed from the cStringIO module. I got some elements of explanation at http://bugs.python.org/issue7358
This seems to be solved in Python 3, and thus Python developers don't appear quite in a hurry to solve this bug in Python 2.x. Gilles On 25 January 2013 14:50, Gael Varoquaux <[email protected]> wrote: > On Fri, Jan 25, 2013 at 02:04:33AM +0000, Ark wrote: >> Training SGDClassifier(alpha=1e-05, class_weight=None, epsilon=0.1, eta0=0.0, >> fit_intercept=True, l1_ratio=0.15, learning_rate=optimal, loss=log, >> n_iter=35, n_jobs=4, penalty=l2, power_t=0.5, random_state=None, >> rho=None, shuffle=True, verbose=1, warm_start=False) >> python: ./Modules/cStringIO.c:419: O_cwrite: Assertion `oself->pos + l < >> 2147483647' failed. >> Aborted (core dumped) > > Wow, quite clearly it is failing to save. I am not sure what the problem > is, but it lies in cStringIO. Maybe that module has an upper limit to the > size of the data it can handle. You could try asking about this error on > a more general Python venue where people might know the stringIO > internals better. > > Gaël > > ------------------------------------------------------------------------------ > Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, > MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current > with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft > MVPs and experts. ON SALE this month only -- learn more at: > http://p.sf.net/sfu/learnnow-d2d > _______________________________________________ > Scikit-learn-general mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft MVPs and experts. ON SALE this month only -- learn more at: http://p.sf.net/sfu/learnnow-d2d _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
