On 05/19/2014 12:14 PM, Emilio J. Rodríguez-Posada wrote: > So, I know I can use -mem parameter in jsub, but how can I estimate the > memory requirements? I'm using the bz2 module for Python and the > mediawiki-utilities framework for parsing. I'm not sure which one is > consuming the memory.
Unless you have profiling information, the easiest way to do this is to start with a very generous allocation, and watch the highest it actually raises to in practice then reduce to some margin above that. -- Marc _______________________________________________ Labs-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/labs-l
