Hi Ben -- Thanks much for the quick and helpful reply! Unfortunately, the solution you're using on omdb looks suspect to me, for the same reason that Alex Neth brought up a few days ago on this list: to my knowledge there's no guarantee that rsync will produce a coherent snapshot of the source directory as it was at any one particular instant in time. In fact, I don't see how rsync could both always terminate in finite time and provide such a guarantee, except on exotic filesystems that provide, say, atomic snapshots with copy-on-write capabilities. (Sigh...sometimes I miss the Google File System.) In which case you'd have to disable your site during the rsync in order to prevent corruption, which basically boils down to the "must take site offline daily for a few minutes to deal with this problem" limitation. I'm guessing the rsync is faster than an index optimization, so I guess this might at least cut down on the amount of time the site has to be down, but still...wah.
Am I a fool for wondering whether it might ultimately be less painful to try an index server that runs Lucene under a JRuby process? On Nov 16, 2007 4:12 AM, Benjamin Krause <[EMAIL PROTECTED]> wrote: > Scott, > > > Do all Ferret users just suck it up and live with one of these > > limitations, or am I missing something and/or just getting "lucky" > > with the errors above? > > This limitations you're talking about are known and will be fixed > in the near future.. the trick is, to have one read-only and one > write-only index.. This is currently being worked on. If you need > a fix right now, you need to do it yourself but you can take a look > on omdb's code and how it's done there: > > http://bugs.omdb.org/browser/branches/2007.1/lib/omdb/ferret/lib/util.rb > (see the switch code) > > If you don't need a fix right now, i'm sure AAF will come up with > a solution for that in the near future (aka probably not this year). > > on a side note.. for the to many open files error, see: > > http://ferret.davebalmain.com/api/classes/Ferret/Index/IndexWriter.html > (use_compound_file, you may have set this to false) or simply increase > the number of open files. On omdb we're running with 32k :-) > > [EMAIL PROTECTED] ~ $ ulimit -n > 32768 > > Cheers > Ben > > _______________________________________________ > Ferret-talk mailing list > [email protected] > http://rubyforge.org/mailman/listinfo/ferret-talk > _______________________________________________ Ferret-talk mailing list [email protected] http://rubyforge.org/mailman/listinfo/ferret-talk
