I've broken up the original email so much that I'm afraid it doesn't make
much sense to even me anymore. Jan: if I've completely mangled something
could you please repost the correct information? Thanks.
On Tue, Feb 25, 2003 at 12:31:50PM +0000, Jan wrote:
> The 'real' site displays some database records and requires users to log
> in. I have made a modified version of this site,
Then isn't this the one you should crawl? I'm not sure how the rest of the
site is set up...but shouldn't you just be pointing the crawler to the URL
that the public will see? This seems like the easiest solution to me.
> - thus, the only difference is that 'sdrdb' is replaced with 'sdrdig'.
> Of course, I want the users to get links that use 'sdrdb', when s/he
> uses htdig.
Ok, I think I'm confused now too. Dig is "private" and db is public?
> First I tried url_rewrite_rules:
> url_rewrite_rules: (.*)sdrdig(.*) \\1sdrdb\\2
> - and after some deliberation it decides that it is finished, since it
> doesn't get any result (because this URL requires a user login).
What kind of login? You can feed a username and password to htdig if it's
an htaccess username and password.
> Then I tried search_rewrite_rules:
> search_rewrite_rules: (.*)sdrdig(.*)
This that the full rule? You should have the bit that you want it to
output as well, right? And it looks like you've got it backwards. You want
to replace "sdrdb" with "sdrdig." Don't you?
search_rewrite_rules: (.*)sdrdb(.*) \\1sdrdig\\2
> - and htdig -vvv gave me loads of search results, all using the 'sdrdig'
> variant:
> \\1sdrdb\\20:2:0:http://sdrdb/cgi-bin/sdrdig?p=sdr_search&SDR=21&COLSET=ALL:
> Making HTTP request on
> http://sdrdb/cgi-bin/sdrdig?p=sdr_search&SDR=21&COLSET=ALL
I'm not sure how it managed that from the information you gave. The
url_rewrite_rules above suggests that you changed dig TO db. Unless this
is where you tried to do the search_rewrite_rules in which case this is
exactly the output you should expect in htdig.
Also: what's up with the domain name change? How come you haven't got a
real domain name in there? You just have sdrdb...is the rewrite rule not
working properly?
> - Unfortunately, when I do a search, the links I get are pointed through
> 'sdrdig', not 'sdrdb', which is what I had hoped for.
That part, however, does not seem right. You're sure you're pointing to
the right config file in your search form?
emma
--
Emma Jane Hogbin
[[ 416 417 2868 ][ www.xtrinsic.com ]]
-------------------------------------------------------
This SF.net email is sponsored by: Scholarships for Techies!
Can't afford IT training? All 2003 ictp students receive scholarships.
Get hands-on training in Microsoft, Cisco, Sun, Linux/UNIX, and more.
www.ictp.com/training/sourceforge.asp
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
