RE: UdmSearch: Question: way to compile for more performance

2000-10-10 Thread Roy Nasser
:15 Subject: Re: UdmSearch: Question: way to compile for more performance On Sun, Oct 08, 2000 at 06:45:07PM -0300, Roy Nasser wrote: Hi, I can see that it indexes the documents, but it sometimes stalls for over 2 minutes on a single URL... We have about 58,000 pending URLs, and it really takes

Re: UdmSearch: Question: way to compile for more performance

2000-10-10 Thread Alexander Barkov
- From: Shane Wegner To: Roy Nasser Cc: '[EMAIL PROTECTED] ' Sent: 08/10/2000 22:15 Subject: Re: UdmSearch: Question: way to compile for more performance On Sun, Oct 08, 2000 at 06:45:07PM -0300, Roy Nasser wrote: Hi, I can see that it indexes the documents, but it sometimes stalls

RE: UdmSearch: Question: way to compile for more performance

2000-10-10 Thread Roy Nasser
PROTECTED] ' ' Sent: 10/10/2000 03:23 Subject: Re: UdmSearch: Question: way to compile for more performance What front-end and storage mode do you use? Roy Nasser wrote: We have about 60,000 URLs in total... and only about 2,300 are indexed... I think that the problem is not really in the DB

Re: UdmSearch: Question: way to compile for more performance

2000-10-10 Thread Alexander Barkov
C script... the one that goes in the bin/ directory of the compiled source) -Original Message- From: Alexander Barkov To: Roy Nasser Cc: 'Shane Wegner '; ''[EMAIL PROTECTED] ' ' Sent: 10/10/2000 03:23 Subject: Re: UdmSearch: Question: way to compile for more performance What f

Re: UdmSearch: Question: way to compile for more performance

2000-10-10 Thread Thomas Yengst
This discussion has been quite valuable - as more people really push udmsearch, these performance issues will become more important. What is the "best" option for performance, given the database engine being used? Or should one just use the crc-multi mode with flat files? I'm sure the answer for

RE: UdmSearch: Question: way to compile for more performance

2000-10-09 Thread Briggs, Gary
I think that "can take two minutes" thing is what caused my server to fall over... Here's the arrangement of whatI'm trying to do: one server, called host20, is trying to index a few other servers, called playpen, test/test, test/TradingServices, and a couple of others on test [names changed

Re: UdmSearch: Question: way to compile for more performance

2000-10-08 Thread Matthew Sullivan
Hi Roy, Roy Nasser wrote: Is there a way to fetch multiple documents at once? If you are using a mySQL database there is sufficient locking to run multiple indexer processes (I currently run 10 x indexer and it reduces the indexing time to around a 15% of the original time Just make