Author: toad
Date: 2008-08-19 16:39:39 +0000 (Tue, 19 Aug 2008)
New Revision: 22029
Modified:
trunk/plugins/XMLSpider/XMLSpider.java
Log:
Increase sub-index maximum size to 4MB uncompressed. This is around 700K
compressed, and is reasonable.
This will make the index shallower and hopefully improve data retention, and
postpone (but not fix) the too-many-files-in-dir problem, which I will fix when
I have time.
Modified: trunk/plugins/XMLSpider/XMLSpider.java
===================================================================
--- trunk/plugins/XMLSpider/XMLSpider.java 2008-08-19 16:27:11 UTC (rev
22028)
+++ trunk/plugins/XMLSpider/XMLSpider.java 2008-08-19 16:39:39 UTC (rev
22029)
@@ -145,8 +145,8 @@
*/
public Set allowedMIMETypes;
private static final int MAX_ENTRIES = 2000;
- private static final long MAX_SUBINDEX_UNCOMPRESSED_SIZE = 256*1024;
- private static int version = 31;
+ private static final long MAX_SUBINDEX_UNCOMPRESSED_SIZE = 4*1024*1024;
+ private static int version = 32;
private static final String pluginName = "XML spider "+version;
/**
* Gives the allowed fraction of total time spent on generating indices
with