Which job causes the problem? Perhaps, we can find out what keeps
creating a conf object over and over.
Also, I have tried what you have suggested (better caching for plugin
repository) and it really seems to make a difference. Can you try with
this patch(*) to see if it solves your problem?
(*) http://www.ceng.metu.edu.tr/~e1345172/plugin_repository_cache.patch
Some comments about you patch. The approach seems nice, you only check
the parameters that affect plugin loading. But have in mind that the
plugin themselves will configure themselves with many other parameters,
so to keep things safe there should be a PluginRepository for each set
of parameters (including all of them). Besides, remember that CACHE is a
WeakHashMap, you are creating ad-hoc PluginProperty objects as keys,
something doesn't loook right... the lifespan of those objects will be
much shorter than you require, perhaps you should be using
SoftReferences instead, or a simple LRU (LinkedHashMap provides that
simply) cache.
Anyway, I'll try to build my own Nutch to test your patch.
Thanks!
