RE: [htdig] htdig vs. .htaccess => Options -Indexes

[Marco Houtman]

J�rgen,   I believe you can add rules to a .htaccess file for certain user agents (though I have no experience with .htaccess files, but I googled for like 5 minutes and found loads of info on this topic). HtDig allows us to set a user-agent string in the config file (user_agent: website_digger_example). You can set anything here and then update your htaccess file with that user-agent. Block everything other than the user-agent specified and I think you’re good to go.   The only experience I have with the user-agent directive in the config file, is that we use it to fully index a website that has restricted area’s (member pages).   Hope this helps.   Regards,   Marco From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: maandag 7 maart 2005 13:17 To: htdig-general@lists.sourceforge.net Subject: [htdig] htdig vs. .htaccess => Options -Indexes   I have a problem with .htaccess I want to allow htdig to index all directories in /home/wdkom/... but I don't want to allow users to view this directories via www If I add Options -Indexes in .htaccess, rundig is not able to index the files. What must be done to fix this requirement? kind regards _______________________________________________________________________________________________________________________________________________________ Ing. J�rgen Mario Kargl Entwicklung Internet Solutions MOTIONDATA Software GmbH K�rntner Stra�e 518 A-8054 Graz-Seiersberg Tel.: +43-316/255 599-0 Fax: +43-316/255 599-5 Email: [EMAIL PROTECTED] Internet: www.motiondata-internet.at