The issue happened quite a lot with my last fetchlist (I'm using the official 0.7), the next time it happens I can send you a list of urls if you like?
-----Original Message----- From: Michael Nebel [mailto:[EMAIL PROTECTED] Sent: Tuesday, September 06, 2005 2:42 PM To: [email protected] Subject: Re: httpd/unix-directory Hi, looking at my apache, i get directory-listings as "Content-Type: text-html" not "httpd/unix-directory"... What kind of server are you crawling? Regards Michael EM wrote: > Shouldn't "httpd/unix-directory" be parsed? > > Message from the logs: > fetch okay, but can't parse http://<xxxxxxxxxx>/, reason: failed(2,203): > Content-Type not text/html: httpd/unix-directory -- Michael Nebel http://www.nebel.de/ http://www.netluchs.de/
