According to Emma Jane Hogbin: > >It looks like I'm going to have to. It sure would be nice if the > >software could, oh I dunno, crawl a site on it's own. > > I completely agree.
Well, htdig does crawl a site, following HTML links from one document to the next. You have to give it a starting point somewhere, though. For whatever reason, it's not taking the starting point you're giving it. I don't know why, but I can't reproduce the problem with either 3.1.6 or the 3.2.0b4-20020303 snapshot. Both seem to take a URL with an ampersand in it just fine. Are you sure there aren't any funny characters in your config file? E.g. a NUL character just before the ampersand would almost certainly stop the config file parser in its tracks. Try running htdig -vvvv and see if you get any meaningful info about where it seems to be dropping the ampersand and everything after it. There's nothing that I can see in the config file parser, in either 3.1.x or 3.2.x that would cause this to happen. And as I said, I can't reproduce the problem. > But while you figure out the solution, you could at least get your crawl > running if you can find the right hack/work around. I had different > problems last week related to a deadline that nearly made me throw out the > software. I used hacks and work arounds in the mean time and by the end of > the week I'd gotten the real solution. For me -- and my project lead and my > team mates and my department head and (etc), it was nice to feel like I was > getting /somewhere/ while I worked on a real solution. > > Everyone loves ht://dig now. It was featured several times in the demo we > did for about 70 industry people yesterday including our major funding > partner. It also fared very well in our usability testing two weeks ago. > > Stick with it, I think it'll be worth the headaches!! No one ever said setting up a web server is guaranteed to be easy. The same goes for a web search engine. Some people with simple setups can get either up and running fairly quickly, but that's not going to be everyone's experience. -- Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
