Re: Java caching of low-level index data?

2009-08-05 Thread Nigel
23, 2009 at 10:03 AM, Nigel wrote: > > > Mike, the question you raise is whether (or to what degree) the OS will > swap > > out app memory in favor of IO cache. I don't know anything about how the > > Linux kernel makes those decisions, but I guess I had hoped th

Re: Java caching of low-level index data?

2009-08-05 Thread Nigel
Thanks, that's good feedback! Chris On Mon, Aug 3, 2009 at 8:50 AM, Earwin Burrfoot wrote: > > I'm curious if anyone has thought about (or even tried) caching the > low-level index data in Java, rather than > > in the OS. For example, at the IndexInput level there could be an LRU > cache of by

Re: Java caching of low-level index data?

2009-07-23 Thread Nigel
quot; configuration on Linux), > which would then kill performance (take a page hit when you finally > did need to use your cache). In C (possibly requiring root) you could > wire the pages, but we can't do that from javaland, so it's already > not a fair fight. > > Mi

Java caching of low-level index data?

2009-07-22 Thread Nigel
In discussions of Lucene search performance, the importance of OS caching of index data is frequently mentioned. The typical recommendation is to keep plenty of unallocated RAM available (e.g. don't gobble it all up with your JVM heap) and try to avoid large I/O operations that would purge the OS

Re: hudson.zones.apache.org is missing svnversion?

2008-08-23 Thread Nigel Daley
File an INFRA ticket in the Hudson component to get svnversion added to the Hudson PATH. Please comment on which host needs this (lucene.zones and/or hudson.zones). Cheers, Nige On Aug 23, 2008, at 10:41 AM, Chris Hostetter wrote: :[exec] Execute failed: java.io.IOException: svnversi

[jira] Commented: (LUCENE-1157) Formatable changes log (CHANGES.txt is easy to edit but not so friendly to read by Lucene users)

2008-02-06 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12566406#action_12566406 ] Nigel Daley commented on LUCENE-1157: - {quote} job/Lucene-trunk/ws/ sounds li

[jira] Commented: (LUCENE-1157) Formatable changes log (CHANGES.txt is easy to edit but not so friendly to read by Lucene users)

2008-02-06 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12566206#action_12566206 ] Nigel Daley commented on LUCENE-1157: - I suggest you save the Changes.html as on

Re: [ANNOUNCE] New Build Server

2008-01-24 Thread Nigel Daley
best handle it while in mid-release. -Grant On Jan 23, 2008, at 6:56 PM, Michael Busch wrote: Hi Nigel, thanks for your work! It looks like we have to update these two files: - /www/lucene.apache.org/java/docs/api/.htaccess - /www/lucene.apache.org/java/docs/nightly/api/.htaccess to redirect

[ANNOUNCE] New Build Server

2008-01-23 Thread Nigel Daley
http://lucene.zones.apache.org:8080/hudson/ has been retired. A new Apache-wide Hudson build server is now up at http://hudson.zones.apache.org/hudson/ Please adjust your bookmarks. All the old builds have been moved over so that history is maintained. Please let me know if you see any probl

Re: Build failed in Hudson: Lucene-Nightly #334

2008-01-11 Thread Nigel Daley
I had to kill the nightly Lucene build. It had hung for over 10 hours trying to run hudson 17572 0.0 0.35851235460 ?S 07:58:15 0:13 /export/ home/hudson/tools/java/jdk1.6.0_03/bin/javadoc -d /export/home/hudson/ hudson/jobs/Lucene-Nightly/workspace/trunk/build/docs/api/contrib-

Re: Hudson Upgrade Dec 19

2007-12-20 Thread Nigel Daley
This is now complete. Please let me know if you see any problems with Hudson. Nige On Dec 18, 2007, at 10:59 PM, Nigel Daley wrote: I'd like to upgrade Hudson (http://lucene.zones.apache.org:8080/ hudson/) from 1.136 to 1.161 tomorrow (Dec 19). I'll also be upgrading som

Hudson Upgrade Dec 19

2007-12-18 Thread Nigel Daley
I'd like to upgrade Hudson (http://lucene.zones.apache.org:8080/ hudson/) from 1.136 to 1.161 tomorrow (Dec 19). I'll also be upgrading some existing plugins and installing a new plugin: http://hudson.gotdns.com/wiki/display/HUDSON/SCP+plugin The changelog for Hudson is at https://hudson.

Re: 2.3

2007-09-14 Thread Nigel Daley
Hi Grant, The Hadoop-Patch process script is now re-written and should be easier to clone. http://svn.apache.org/viewvc/lucene/hadoop/nightly/ hudsonBuildHadoopPatch.sh?view=markup and http://svn.apache.org/viewvc/lucene/hadoop/nightly/ processHadoopPatchEmail.sh?revision=575463&view=mar

[jira] Commented: (LUCENE-873) nightly builds depend on clover

2007-05-04 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12493830 ] Nigel Daley commented on LUCENE-873: On or around April 9th, I changed the build to use the "old"

Re: New Jira Hudson plugin

2007-03-15 Thread Nigel Daley
Jira issue numbers should now be hyper-linked to Jira. Also, in the Hadoop-Nightly build I'm experimenting with a feature of the plugin that will update the Jira with a link back to the Hudson build in which it was integrated. For example https:// issues.apache.org/jira/browse/HADOOP-1115

New Jira Hudson plugin

2007-03-14 Thread Nigel Daley
I've updated Hudson with a new Jira plugin provided by Kohsuke: http://lucene.zones.apache.org:8080/ Jira issue numbers should now be hyper-linked to Jira. Also, in the Hadoop-Nightly build I'm experimenting with a feature of the plugin that will update the Jira with a link back to the Hu