I cannot get it to work either, even when I use a browser-like user-agent. I wonder if it checks some other header components to exclude non-browsers. Your server has definitively been modified somehow - it returns only "Apache", not "Apache" with a version number as others do. Please look in *all* logfiles to see what happened.
Tilman On Tue, 21 Jul 2009 22:57:38 -0400, Deno Tufares, Jr. wrote: >Xenu will not search my site - gives me a "Not Found" error... > >http://www.adtenterprises.com > >This does not work either... >http://www.adtenterprises.com/cgi-bin/store/ >It starts then gets to >http://www.adtenterprises.com/cgi-bin/store/commerce.cgi and then fails with >the "Not Found" error... > >I am able to use Xenu with other sites and other commerce.cgi sites with no >problem - but my site does not work. I have even tried it from a different >computer at a different location with the same results. I have notified the >technical people for the web hosting server and they state that there are no >blocks on the server. My audit logs show that "4 visitors use Xenu Link >Sleuth 1.3c as a web browser". > > >I have read through all the notes and searched this user group with no idea as >to what to do. My site has a ".htaccess" file REWRITE for my site to go >directly to the CGI Shopping Cart - something like: > >RewriteEngine on >RewriteCond %{REQUEST_FILENAME} !-f >RewriteRule ^.*(\.html$|\.htm$) /cgi-bin/store/commerce.cgi >RewriteRule ^index\.html$ /cgi-bin/store/commerce.cgi > > >Please help > >Thanks > >Deno >----------------------------------------------------- > FREE Shipping & Handling > http://www.adtenterprises.com >What You Need for the 21st Century >----------------------------------------------------- > >_______________________________________ >No viruses found in this outgoing message >Scanned by iolo AntiVirus 1.5.7.1 >http://www.iolo.com
