A Friday 22 July 2011 11:33:18 Leon Evers escrigué: > Hi Dave, > > That looks like a problem I have been having. I have tried to look > into it but could not really get to the bottom of it, my hunch is > that somewhere in the C interface references to table definitions > are kept alive. My application is reading hdf5 files in parallel > processes fired off with python multiprocessing lib, and this might > also play a factor. > > I tried to find the source of the prblem but didn't succeed, so I'm > interested to know if you get any better results... Anyway, I solved > it by reading files in batches in a separate process, and then > killing that process, while the main program keeps running > alongside. maybe this might help you as well...
My recomendation is that you run your script in sequential mode and see if the leaks still exist (valgrind is your friend here). Also, have in mind that, as I said in my reply before, internals caches grow as they get warmed, but that should not suppose a problem (unless there the cache code is malfunctioning). -- Francesc Alted ------------------------------------------------------------------------------ 10 Tips for Better Web Security Learn 10 ways to better secure your business today. Topics covered include: Web security, SSL, hacker attacks & Denial of Service (DoS), private keys, security Microsoft Exchange, secure Instant Messaging, and much more. http://www.accelacomm.com/jaw/sfnl/114/51426210/ _______________________________________________ Pytables-users mailing list Pytables-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/pytables-users
