> Which job causes the problem? Perhaps, we can find out what keeps > creating a conf object over and over. > > Also, I have tried what you have suggested (better caching for plugin > repository) and it really seems to make a difference. Can you try with > this patch(*) to see if it solves your problem? > > (*) http://www.ceng.metu.edu.tr/~e1345172/plugin_repository_cache.patch
Some comments about you patch. The approach seems nice, you only check the parameters that affect plugin loading. But have in mind that the plugin themselves will configure themselves with many other parameters, so to keep things safe there should be a PluginRepository for each set of parameters (including all of them). Besides, remember that CACHE is a WeakHashMap, you are creating ad-hoc PluginProperty objects as keys, something doesn't loook right... the lifespan of those objects will be much shorter than you require, perhaps you should be using SoftReferences instead, or a simple LRU (LinkedHashMap provides that simply) cache. Anyway, I'll try to build my own Nutch to test your patch. Thanks! ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-developers mailing list Nutch-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nutch-developers
