Depending on the size of your site, and what pages are changing, it may be worth while using a 'Restrict' option or two to just spider the important pages then merge the results into your live database, but this would be a little complex for a beginner to set up. Mike
----- Original Message ----- From: [EMAIL PROTECTED] Date: Monday, December 15, 2003 4:06 am Subject: htdig-general digest, Vol 1 #1243 - 1 msg > Send htdig-general mailing list submissions to > [EMAIL PROTECTED] > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.sourceforge.net/lists/listinfo/htdig-general > or, via email, send a message with subject or body 'help' to > [EMAIL PROTECTED] > > You can reach the person managing the list at > [EMAIL PROTECTED] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of htdig-general digest..." > > > Today's Topics: > > 1. Re: any way to prioritize spidering order? (Malka Cymbalista) > > --__--__-- > > Message: 1 > Date: Sun, 14 Dec 2003 13:48:36 +0200 > From: "Malka Cymbalista" <[EMAIL PROTECTED]> > To: <[EMAIL PROTECTED]>,<[EMAIL PROTECTED]> > Subject: Re: [htdig] any way to prioritize spidering order? > > I'm not sure if this is what you are asking but we do a full indexing > once a week and an incremental indexing every night. The way to > do a > full indexing is with the -i option. > > > Malki Cymbalista > Webmaster, Weizmann Institute of Science > Rehovot, Israel 76100 > Internet: [EMAIL PROTECTED] > 08-934-3036 > > >>> Francis Hwang <[EMAIL PROTECTED]> 12/12/2003 22:34:43 >>> > Another question: Is there any way to change the behavior of the > spider > based on what pages change more quickly? Let's say I wanted to > spider > my site once an hour but only index a few pages that change all > the > time, and then do a weekly spider of the entire site, would htdig > let > me do that? > > Thanks, > Francis > New online services from the Council: Check planning applications from your office or home www.edinburgh.gov.uk/planning Pay for on-street parking in central Edinburgh from your mobile phone www.edinburgh.gov.uk/mpark . more online services at www.edinburgh.gov.uk/onlineservices Celebrate with us: Edinburgh's Winter Festivals : www.capitalchristmas.co.uk and www.edinburghshogmanay.org ********************************************************************** This Email and files transmitted with it are confidential and are intended for the sole use of the individual or organisation to whom they are addressed. If you have received this Email in error please notify the sender immediately and delete it without using, copying, storing, forwarding or disclosing its contents to any other person. The Council has endeavoured to scan this Email message and attachments for computer viruses and will not be liable for any losses incurred by the recipient. ********************************************************************** ------------------------------------------------------- This SF.net email is sponsored by: IBM Linux Tutorials. Become an expert in LINUX or just sharpen your skills. Sign up for IBM's Free Linux Tutorials. Learn everything from the bash shell to sys admin. Click now! http://ads.osdn.com/?ad_id=1278&alloc_id=3371&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
