- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: adrian
Subject: robots.txt file disallowing index.
I can't seem to get my pages on my local website indexed. It keeps telling me
that robots.txt file has disallowed /. But i deleted the robots.txt file and
it's still telling me the same thing.
Here is the full output:
indexer[1055]: {00} indexer from dpsearch-4.43-mysql started with
'/usr/local/dpsearch/etc/indexer.conf'
indexer[1055]: {01} URL: http://localhost/main.html
indexer[1055]: {01} robots.txt: 'Disallow /'
indexer[1055]: {01} Deleting http://localhost/main.html
indexer[1055]: {01} URL: http://localhost/fiwimarket/
indexer[1055]: {01} robots.txt: 'Disallow /'
indexer[1055]: {01} Deleting http://localhost/fiwimarket/
indexer[1055]: {01} Done (1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
indexer[1055]: {00} Total 15 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec,
0.00 sec/doc, 0 bytes/doc.
I really need some help with this.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;post=
