- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: pey0t
Subject: Не  индексируется сайт

Индексирую сайт котоырй нах-ся на локалхосте, без алиаса, просто server 
http://xxx.ru, т.к. если через file:// то много лишних ссылок с запретами.
./indexer -v 5 -G 1
indexer[9275]: {00} indexer from dpsearch-4.47-13052007-mysql started with 
'/var/www/htdocs/serpuhov.biz/search/dpsearch/etc/indexer.co            nf'
indexer[9275]: {00} Chinese dictionary with 0 entries
indexer[9275]: {00} Korean dictionary with 0 entries
indexer[9275]: {00} Thai dictionary with 0 entries
indexer[9275]: {00} LogsOnly: no
indexer[9275]: {00} mutexes used: 256
indexer[9275]: {01} DpsOpenCache:
indexer[9275]: {01} i:0  cached_sd:0  sin_port:0
indexer[9275]: {01} wrd_buf: b5d4b008
indexer[9275]: {01} Done.
indexer[9275]: {01} Done (0 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[9275]: {00} Total 1 seconds, 0 documents, 0 bytes,  0.00 Kbytes/sec,  
0.00 sec/doc, 0 bytes/doc.
indexer[9275]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 
sec/doc,  0.00 pas/doc.
indexer[9275]: {00} Flushing cached buffers for mysql://search:[EMAIL 
PROTECTED]/search/?dbmode=cache...
indexer[9275]: {00} Wed 23 01:14:06 [9275] Flushing all buffers...
indexer[9275]: {00} Done
[EMAIL PROTECTED]:/var/www/htdocs/serpuhov.biz/search/dpsearch/sbin# ./indexer 
-v 5 -a
indexer[9290]: {00} indexer from dpsearch-4.47-13052007-mysql started with 
'/var/www/htdocs/serpuhov.biz/search/dpsearch/etc/indexer.co            nf'
indexer[9290]: {00} Chinese dictionary with 0 entries
indexer[9290]: {00} Korean dictionary with 0 entries
indexer[9290]: {00} Thai dictionary with 0 entries
indexer[9290]: {00} LogsOnly: no
indexer[9290]: {00} mutexes used: 256
indexer[9290]: {01} DpsOpenCache:
indexer[9290]: {01} i:0  cached_sd:0  sin_port:0
indexer[9290]: {01} wrd_buf: b5cef008
indexer[9290]: {01} Done.
indexer[9290]: {01} Target.body: <NULL>
indexer[9290]: {01} Target.Charset: <NULL>
indexer[9290]: {01} Target.Content-Language: <NULL>
indexer[9290]: {01} Target.Content-Length: 0
indexer[9290]: {01} Target.Content-Type: <NULL>
indexer[9290]: {01} Target.crc32: 0
indexer[9290]: {01} Target.crosswords: <NULL>
indexer[9290]: {01} Target.DP_ID: 1
indexer[9290]: {01} Target.E_URL: http://rrr.ru/
indexer[9290]: {01} Target.Hops: 0
indexer[9290]: {01} Target.meta.description: <NULL>
indexer[9290]: {01} Target.meta.keywords: <NULL>
indexer[9290]: {01} Target.Pop_Rank: 0.25
indexer[9290]: {01} Target.PrevStatus: 503
indexer[9290]: {01} Target.Since: 1179868298
indexer[9290]: {01} Target.Status: 503
indexer[9290]: {01} Target.title: <NULL>
indexer[9290]: {01} Target.url: http://rrr.ru/
indexer[9290]: {01} Target.URL_ID: 1329162000
indexer[9290]: {01} URL: http://rrr.ru/
indexer[9290]: {01} Server Allow 'http://rrr.ru/'
indexer[9290]: {01} Allow by default
indexer[9290]: {01} Resolver 0th checking for 192.168.254.241
indexer[9290]: {01} Resolver: rrr.ru - > 192.168.254.241
indexer[9290]: {01} Request.Accept: 
text/html,application/xhtml+xml,application/xml,text/plain,text/xml,text/tab-separated-values,text/
            css,image/gif,audio/mpeg
indexer[9290]: {01} Request.Accept-Charset: windows-1251;q=1.0, UTF-8;q=0.9, 
*;q=0.8
indexer[9290]: {01} Request.Accept-Encoding: 
gzip,x-gzip,deflate,compress,x-compress
indexer[9290]: {01} Request.Host: rrr.ru
indexer[9290]: {01} Request.User-Agent: DataparkSearch/4.47-13052007 
(+http://dataparksearch.org/bot)
indexer[9290]: {01} Can't connect to host rrr.ru:80
indexer[9290]: {01} Response.body: <NULL>
indexer[9290]: {01} Response.case_sense: 1
indexer[9290]: {01} Response.Charset: <NULL>
indexer[9290]: {01} Response.Content-Language: <NULL>
indexer[9290]: {01} Response.Content-Type: text/html
indexer[9290]: {01} Response.crc32: 0
indexer[9290]: {01} Response.crc32old: 0
indexer[9290]: {01} Response.crosswords: <NULL>
indexer[9290]: {01} Response.DP_ID: 1
indexer[9290]: {01} Response.E_URL: http://rrr.ru/
indexer[9290]: {01} Response.Follow: 1
indexer[9290]: {01} Response.Hops: 0
indexer[9290]: {01} Response.match_type: 1
indexer[9290]: {01} Response.MaxHops: 256
indexer[9290]: {01} Response.meta.description: <NULL>
indexer[9290]: {01} Response.meta.keywords: <NULL>
indexer[9290]: {01} Response.Method: Allow
indexer[9290]: {01} Response.nomatch: 0
indexer[9290]: {01} Response.Period: 864000
indexer[9290]: {01} Response.Pop_Rank: 0.25
indexer[9290]: {01} Response.PrevStatus: 503
indexer[9290]: {01} Response.RemoteCharset: windows-1251
indexer[9290]: {01} Response.ResponseSize: 0
indexer[9290]: {01} Response.Server_id: 1329162000
indexer[9290]: {01} Response.Since: 1179868298
indexer[9290]: {01} Response.Site_id: -1020085225
indexer[9290]: {01} Response.SiteWeight: 1.000000
indexer[9290]: {01} Response.Status: 503
indexer[9290]: {01} Response.title: <NULL>
indexer[9290]: {01} Response.url: http://rrr.ru/
indexer[9290]: {01} Response.URL_ID: 1329162000
indexer[9290]: {01} Status: 503 Service Unavailable
indexer[9290]: {01} Target.body: <NULL>
indexer[9290]: {01} Target.Charset: <NULL>
indexer[9290]: {01} Target.Content-Language: <NULL>
indexer[9290]: {01} Target.Content-Length: 0
indexer[9290]: {01} Target.Content-Type: <NULL>
indexer[9290]: {01} Target.crc32: 0
indexer[9290]: {01} Target.crosswords: <NULL>
indexer[9290]: {01} Target.DP_ID: 2
indexer[9290]: {01} Target.E_URL: http://rrr.ru/
indexer[9290]: {01} Target.Hops: 0
indexer[9290]: {01} Target.meta.description: <NULL>
indexer[9290]: {01} Target.meta.keywords: <NULL>
indexer[9290]: {01} Target.Pop_Rank: 0.25
indexer[9290]: {01} Target.PrevStatus: 503
indexer[9290]: {01} Target.Since: 1179868298
indexer[9290]: {01} Target.Status: 503
indexer[9290]: {01} Target.title: <NULL>
indexer[9290]: {01} Target.url: http://rrr.ru/
indexer[9290]: {01} Target.URL_ID: -557417338
indexer[9290]: {01} URL: http://xxx.ru/
indexer[9290]: {01} Server Allow 'http://xxx.ru/'
indexer[9290]: {01} Allow by default
indexer[9290]: {01} Resolver 0th checking for 192.168.254.241
indexer[9290]: {01} Resolver: xxx.ru - > 192.168.254.241
indexer[9290]: {01} Request.Accept: 
text/html,application/xhtml+xml,application/xml,text/plain,text/xml,text/tab-separated-values,text/css,image/gif,audio/mpeg
indexer[9290]: {01} Request.Accept-Charset: windows-1251;q=1.0, UTF-8;q=0.9, 
*;q=0.8
indexer[9290]: {01} Request.Accept-Encoding: 
gzip,x-gzip,deflate,compress,x-compress
indexer[9290]: {01} Request.Host: xxx.ru
indexer[9290]: {01} Request.User-Agent: DataparkSearch/4.47-13052007 
(+http://dataparksearch.org/bot)
indexer[9290]: {01} Can't connect to host xxx.ru:80
indexer[9290]: {01} Response.body: <NULL>
indexer[9290]: {01} Response.case_sense: 1
indexer[9290]: {01} Response.Charset: <NULL>
indexer[9290]: {01} Response.Content-Language: <NULL>
indexer[9290]: {01} Response.Content-Type: text/html
indexer[9290]: {01} Response.crc32: 0
indexer[9290]: {01} Response.crc32old: 0
indexer[9290]: {01} Response.crosswords: <NULL>
indexer[9290]: {01} Response.DP_ID: 2
indexer[9290]: {01} Response.E_URL: http://xxx.ru/
indexer[9290]: {01} Response.Follow: 1
indexer[9290]: {01} Response.Hops: 0
indexer[9290]: {01} Response.match_type: 1
indexer[9290]: {01} Response.MaxHops: 256
indexer[9290]: {01} Response.meta.description: <NULL>
indexer[9290]: {01} Response.meta.keywords: <NULL>
indexer[9290]: {01} Response.Method: Allow
indexer[9290]: {01} Response.nomatch: 0
indexer[9290]: {01} Response.Period: 864000
indexer[9290]: {01} Response.Pop_Rank: 0.25
indexer[9290]: {01} Response.PrevStatus: 503
indexer[9290]: {01} Response.RemoteCharset: windows-1251
indexer[9290]: {01} Response.ResponseSize: 0
indexer[9290]: {01} Response.Server_id: -557417338
indexer[9290]: {01} Response.Since: 1179868298
indexer[9290]: {01} Response.Site_id: -1020085225
indexer[9290]: {01} Response.SiteWeight: 1.000000
indexer[9290]: {01} Response.Status: 503
indexer[9290]: {01} Response.title: <NULL>
indexer[9290]: {01} Response.url: http://xxx.ru/
indexer[9290]: {01} Response.URL_ID: -557417338
indexer[9290]: {01} Status: 503 Service Unavailable
indexer[9290]: {01} Done (61 seconds, 2 documents, 0 bytes,  0.00 Kbytes/sec.)
indexer[9290]: {00} Total 61 seconds, 2 documents, 0 bytes,  0.00 Kbytes/sec, 
30.50 sec/doc, 0 bytes/doc.
indexer[9290]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 
sec/doc,  0.00 pas/doc.
indexer[9290]: {00} Flushing cached buffers for mysql://search:vAA:[EMAIL 
PROTECTED]/search/?dbmode=cache...
indexer[9290]: {00} Wed 23 01:15:22 [9290] Flushing all buffers...
indexer[9290]: {00} Done

Сайты с других компов в локальной сети индексирует нормально. За исключением 
тоже одного :

./indexer -v 5
indexer[11430]: {00} indexer from dpsearch-4.47-13052007-mysql started with 
'/var/www/htdocs/serpuhov.biz/search/dpsearch/etc/indexer.conf'
indexer[11430]: {00} Chinese dictionary with 0 entries
indexer[11430]: {00} Korean dictionary with 0 entries
indexer[11430]: {00} Thai dictionary with 0 entries
indexer[11430]: {00} LogsOnly: no
indexer[11430]: {00} mutexes used: 256
indexer[11430]: {01} DpsOpenCache:
indexer[11430]: {01} i:0  cached_sd:0  sin_port:0
indexer[11430]: {01} wrd_buf: b5d70008
indexer[11430]: {01} Done.
indexer[11430]: {01} Target.body: <NULL>
indexer[11430]: {01} Target.Charset: <NULL>
indexer[11430]: {01} Target.Content-Language: <NULL>
indexer[11430]: {01} Target.Content-Length: 0
indexer[11430]: {01} Target.Content-Type: <NULL>
indexer[11430]: {01} Target.crc32: 0
indexer[11430]: {01} Target.crosswords: <NULL>
indexer[11430]: {01} Target.DP_ID: 4
indexer[11430]: {01} Target.E_URL: http://yyy.ru/
indexer[11430]: {01} Target.Hops: 0
indexer[11430]: {01} Target.meta.description: <NULL>
indexer[11430]: {01} Target.meta.keywords: <NULL>
indexer[11430]: {01} Target.Pop_Rank: 0.25
indexer[11430]: {01} Target.PrevStatus: 0
indexer[11430]: {01} Target.Since: 1179869167
indexer[11430]: {01} Target.Status: 0
indexer[11430]: {01} Target.title: <NULL>
indexer[11430]: {01} Target.url: http://yyy.ru/
indexer[11430]: {01} Target.URL_ID: -1366777136
indexer[11430]: {01} URL: http://yyy.ru/
indexer[11430]: {01} Server Allow 'http://yyy.ru/'
indexer[11430]: {01} Allow by default
indexer[11430]: {01} Resolver 0th checking for 192.168.30.222
indexer[11430]: {01} Resolver: yyy.ru - > 192.168.30.222
indexer[11430]: {01} Request.Accept: 
text/html,application/xhtml+xml,application/xml,text/plain,text/xml,text/tab-separated-values,text/css,image/gif,audio/mpeg
indexer[11430]: {01} Request.Accept-Charset: windows-1251;q=1.0, UTF-8;q=0.9, 
*;q=0.8
indexer[11430]: {01} Request.Accept-Encoding: 
gzip,x-gzip,deflate,compress,x-compress
indexer[11430]: {01} Request.Host: langames.serpuhov.biz
indexer[11430]: {01} Request.User-Agent: DataparkSearch/4.47-13052007 
(+http://dataparksearch.org/bot)
indexer[11430]: {01} Response.body: <NULL>
indexer[11430]: {01} Response.case_sense: 1
indexer[11430]: {01} Response.Charset: <NULL>
indexer[11430]: {01} Response.Connection: close
indexer[11430]: {01} Response.Content-Language: <NULL>
indexer[11430]: {01} Response.Content-Length: 0
indexer[11430]: {01} Response.Content-Type: text/html
indexer[11430]: {01} Response.crc32: 0
indexer[11430]: {01} Response.crc32old: 0
indexer[11430]: {01} Response.crosswords: <NULL>
indexer[11430]: {01} Response.Date: Tue, 22 May 2007 20:26:28 GMT
indexer[11430]: {01} Response.DP_ID: 4
indexer[11430]: {01} Response.E_URL: http://yyy.ru/
indexer[11430]: {01} Response.Follow: 1
indexer[11430]: {01} Response.Hops: 0
indexer[11430]: {01} Response.match_type: 1
indexer[11430]: {01} Response.MaxHops: 256
indexer[11430]: {01} Response.meta.description: <NULL>
indexer[11430]: {01} Response.meta.keywords: <NULL>
indexer[11430]: {01} Response.Method: Allow
indexer[11430]: {01} Response.nomatch: 0
indexer[11430]: {01} Response.Period: 864000
indexer[11430]: {01} Response.Pop_Rank: 0.25
indexer[11430]: {01} Response.PrevStatus: 0
indexer[11430]: {01} Response.RemoteCharset: windows-1251
indexer[11430]: {01} Response.ResponseLine: HTTP/1.1 403 Forbidden
indexer[11430]: {01} Response.ResponseSize: 190
indexer[11430]: {01} Response.Server: Apache
indexer[11430]: {01} Response.Server-Charset: windows-1251
indexer[11430]: {01} Response.Server_id: -1366777136
indexer[11430]: {01} Response.Since: 1179869167
indexer[11430]: {01} Response.Site_id: -1020085225
indexer[11430]: {01} Response.SiteWeight: 1.000000
indexer[11430]: {01} Response.Status: 403
indexer[11430]: {01} Response.title: <NULL>
indexer[11430]: {01} Response.url: http://yyy.ru/
indexer[11430]: {01} Response.URL_ID: -1366777136
indexer[11430]: {01} Response.X-Powered-By: PHP/4.3.10
indexer[11430]: {01} Status: 403 Forbidden
indexer[11430]: {01} Done (1 seconds, 1 documents, 190 bytes,  0.19 Kbytes/sec.)
indexer[11430]: {00} Total 2 seconds, 1 documents, 190 bytes,  0.09 Kbytes/sec, 
 2.00 sec/doc, 190 bytes/doc.
indexer[11430]: {00} Neo PopRank: 0 documents, 0 pas,  0.00 Kpas/sec,  0.00 
sec/doc,  0.00 pas/doc.
indexer[11430]: {00} Flushing cached buffers for mysql://search:vAA:[EMAIL 
PROTECTED]/search/?dbmode=cache...
indexer[11430]: {00} Wed 23 01:26:09 [11430] Flushing all buffers...
indexer[11430]: {00} Done

Спасибо.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=05;post=

Reply via email to