Tony Melia's bits of Tue, 20 Nov 2001 translated to: >No, I am indexing over 2G of data on a remote server, so to speed things up >I removed the -i parameter from htdig, as I saw that it then recognised what >was changed and unchanged. Are you saying that to get a complete index, you >have to reindex everything every night (or whatever index period you >chose)??
Sorry. That is not what I meant to imply. Originally I read your question as asking how to reindex the entire site from scratch. The -i option allows you to do this. You should be able to update by removing the -i (and using -a if the search engine is to remain available during the update). On rereading your original post, it sounds like you are saying the real problem is that the update results in databases that contain *only* those documents that were modified. If that is in fact what is happening, I can't explain the behavior; in my experience, running an update has always resulted in a complete database. You might want to try running the update with -vv or -vvv in order to see what is happening to the URL's that are being lost. Jim > >-----Original Message----- >From: Jim Cole [mailto:[EMAIL PROTECTED]] >Sent: Friday, 16 November 2001 11:22am >To: Tony Melia >Cc: 'Rekha Das'; '[EMAIL PROTECTED]' >Subject: RE: [htdig] Reindexing Problem > > >Are you 100% certain that you ran the same, unmodified version of >'rundig' both times? 'rundig' invokes 'htdig' with a '-i', which >causes existing databases to be removed before indexing. As such, >I don't see how it could have performed an update dig the second >time (or any time after that). > >Does your rundig script include the following line (with the -i)? > >$BINDIR/htdig -i $opts $stats $alt > > >Jim > >Tony Melia's bits of Thu, 15 Nov 2001 translated to: > >>I have the same problem if somebody can assist. >> >>Regards, >>Tony >> >>-----Original Message----- >>From: Rekha Das [mailto:[EMAIL PROTECTED]] >>Sent: Thursday, 15 November 2001 10:59am >>To: '[EMAIL PROTECTED]' >>Subject: [htdig] Reindexing Problem >> >> >>I have installed htdig on my site. When I ran rundig for the first time it >>indexed whole site. After that I changed few HTML documents and indexed the >>site again. This time it indexed only the changed HTML documents. It shows >>only the changed HTML documents on the result page. How can I index the >>whole site again? > _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
