Re: [htdig] local_user_urls not working
According to [EMAIL PROTECTED]: > I installed the htdig on a Red Hat Linux 6.1 system. Basically the > htdig is working fine with the Apache server, but the local_user_urls > setting never works. As the attrs.html suggests, I have the following > directive specified in my > /etc/htdig/htdig.conf: > local_user_urls:http://host.mydomain/=/home/,/public_html/ > I ran rundig several times but those files under /home/user/public_html > never got indexed. It seems that htdig just skipped that part since > I could not find any thing related from the script of "rundig -vvv". All local_user_urls does is to tell htdig how to get files for URLs like http://www.mydomain/~user/, if htdig encounters some of these URLs. It does not tell htdig to read the /home directory to go looking for web pages that are not linked to URLs in your start_urls attribute. htdig is a spider - it follows HTML links from one page to another, and it never reads directories on its own. If you want to index all the users' home pages, you need to create a list of their URLs and feed it to htdig. -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW:http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax:(204)789-3930 To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
Re: [htdig] local_user_urls not working
On Thu, 25 May 2000 19:04:06 +0800 [EMAIL PROTECTED] wrote: > Dear Sir, > > I installed the htdig on a Red Hat Linux 6.1 system. Basically the htdig is working >fine with the Apache server, but the local_user_urls setting never works. As the >attrs.html suggests, I have the following directive specified in my > /etc/htdig/htdig.conf: > local_user_urls:http://host.mydomain/=/home/,/public_html/ > I ran rundig several times but those files under /home/user/public_html never got >indexed. It seems that htdig just skipped that part since I could not find any thing >related from the script of "rundig -vvv". Any suggestions/comments? Could you help? > > Thanks in advance. > > Kind regards, > > Brian Chiangmailto:[EMAIL PROTECTED] > Philips Research East Asia - Taipei > 24FA, 66, Sec. 1 Chung Hsiao W. RdTel: +886 2 2382 4593 > PO Box 22978, Taipei 100, TaiwanFax: +886 2 2382 4598 I suggest that you run htdig -i again with the local_user_urls: statment commented out. That should reveal whether the problem really is with local file access or is somewhere else. -- David Adams [EMAIL PROTECTED] To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
[htdig] local_user_urls not working
Dear Sir, I installed the htdig on a Red Hat Linux 6.1 system. Basically the htdig is working fine with the Apache server, but the local_user_urls setting never works. As the attrs.html suggests, I have the following directive specified in my /etc/htdig/htdig.conf: local_user_urls:http://host.mydomain/=/home/,/public_html/ I ran rundig several times but those files under /home/user/public_html never got indexed. It seems that htdig just skipped that part since I could not find any thing related from the script of "rundig -vvv". Any suggestions/comments? Could you help? Thanks in advance. Kind regards, Brian Chiangmailto:[EMAIL PROTECTED] Philips Research East Asia - Taipei 24FA, 66, Sec. 1 Chung Hsiao W. RdTel: +886 2 2382 4593 PO Box 22978, Taipei 100, TaiwanFax: +886 2 2382 4598 To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
