- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: brunoco
Subject: Re: create system of the news
gracias maxime por tu ayuda.
probe lo que me dijiste pero sigue sin funcionar. simplemente no sigue ningun
link y no indexa nada.
[EMAIL PROTECTED] [/home/xxx/xxx/sbin]# ./indexer -t tiempo -n 50
indexer[7573]: {00} indexer from dpsearch-4.44-mysql started with
'/home/xxx/xxx/etc/indexer.conf'
indexer[7573]: {01} Done (1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec.)
indexer[7573]: {00} Total 1 seconds, 0 documents, 0 bytes, 0.00 Kbytes/sec,
0.00 sec/doc, 0 bytes/doc.
ejecutando indexer -v5 -u http://www.eltiempo.com/rss.xml este es el resultado:
indexer[7531]: {01} ROBOTS.Request.Accept:
text/html,application/xhtml+xml,application/xml,text/plain,text/xml,text/tab-separated-values,text/css,image/gif,audio/mpeg
indexer[7531]: {01} ROBOTS.Request.Accept-Encoding:
gzip,x-gzip,deflate,compress,x-compress
indexer[7531]: {01} ROBOTS.Request.Host: www.abcdelbebe.com
indexer[7531]: {01} ROBOTS.Request.User-Agent: DataparkSearch/4.44
(+http://dataparksearch.org/bot)
indexer[7531]: {01} Resolver 0th checking for 200.41.9.23
indexer[7531]: {01} Resolver: www.abcdelbebe.com - > 200.41.9.23
indexer[7531]: {01} ROBOTS.Response.case_sense: 1
indexer[7531]: {01} ROBOTS.Response.Connection: close
indexer[7531]: {01} ROBOTS.Response.Content-Length: 266
indexer[7531]: {01} ROBOTS.Response.Content-Type: text/html
indexer[7531]: {01} ROBOTS.Response.Date: Tue, 20 Mar 2007 03:07:03 GMT
indexer[7531]: {01} ROBOTS.Response.DeleteOlder: 5184000
indexer[7531]: {01} ROBOTS.Response.Follow: 0
indexer[7531]: {01} ROBOTS.Response.match_type: 5
indexer[7531]: {01} ROBOTS.Response.Method: Allow
indexer[7531]: {01} ROBOTS.Response.nomatch: 0
indexer[7531]: {01} ROBOTS.Response.Period: 1800
indexer[7531]: {01} ROBOTS.Response.ResponseLine: HTTP/1.1 404 Not Found
indexer[7531]: {01} ROBOTS.Response.ResponseSize: 433
indexer[7531]: {01} ROBOTS.Response.Server: Apache/1.3.33 (Unix) PHP/4.3.3
indexer[7531]: {01} ROBOTS.Response.Server-Charset: ISO-8859-1
indexer[7531]: {01} ROBOTS.Response.Status: 404
indexer[7531]: {01} ROBOTS.Response.Tag: news
indexer[7531]: {01} ROBOTS.Response.URL: http://www.abcdelbebe.com/robots.txt
indexer[7531]: {01} ROBOTS.Response.URL_ID: 1981744214
indexer[7531]: {01} Link 'http://www.abcdelbebe.com/?q=node/60242'
http://www.abcdelbebe.com/&;
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Link
'http://www.eltiempo.com/vidadehoy/2007-03-17/ARTICULO-WEB-NOTA_INTERIOR-3479603.html'
http://www.eltiempo.com/vidadehoy/2007-03-17/ARTICULO-WEB-NOTA_INTERIOR-3479603.html
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Link
'http://encuestas.eltiempo.com/formulariosEncuestas/2067SF.html'
http://encuestas.eltiempo.com/formulariosEncuestas/2067SF.html
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} ROBOTS: http://encuestas.eltiempo.com/robots.txt
indexer[7531]: {01} ROBOTS.Request.Accept:
text/html,application/xhtml+xml,application/xml,text/plain,text/xml,text/tab-separated-values,text/css,image/gif,audio/mpeg
indexer[7531]: {01} ROBOTS.Request.Accept-Encoding:
gzip,x-gzip,deflate,compress,x-compress
indexer[7531]: {01} ROBOTS.Request.Host: encuestas.eltiempo.com
indexer[7531]: {01} ROBOTS.Request.User-Agent: DataparkSearch/4.44
(+http://dataparksearch.org/bot)
indexer[7531]: {01} Resolver 0th checking for 200.41.9.63
indexer[7531]: {01} Resolver: encuestas.eltiempo.com - > 200.41.9.63
indexer[7531]: {01} ROBOTS.Response.case_sense: 1
indexer[7531]: {01} ROBOTS.Response.Connection: close
indexer[7531]: {01} ROBOTS.Response.Content-Length: 283
indexer[7531]: {01} ROBOTS.Response.Content-Type: text/html
indexer[7531]: {01} ROBOTS.Response.Date: Tue, 20 Mar 2007 03:07:04 GMT
indexer[7531]: {01} ROBOTS.Response.DeleteOlder: 5184000
indexer[7531]: {01} ROBOTS.Response.Follow: 0
indexer[7531]: {01} ROBOTS.Response.match_type: 5
indexer[7531]: {01} ROBOTS.Response.Method: Allow
indexer[7531]: {01} ROBOTS.Response.nomatch: 0
indexer[7531]: {01} ROBOTS.Response.Period: 1800
indexer[7531]: {01} ROBOTS.Response.ResponseLine: HTTP/1.1 404 Not Found
indexer[7531]: {01} ROBOTS.Response.ResponseSize: 450
indexer[7531]: {01} ROBOTS.Response.Server: Apache/1.3.37 (Unix) PHP/4.4.3
indexer[7531]: {01} ROBOTS.Response.Server-Charset: ISO-8859-1
indexer[7531]: {01} ROBOTS.Response.Status: 404
indexer[7531]: {01} ROBOTS.Response.Tag: news
indexer[7531]: {01} ROBOTS.Response.URL:
http://encuestas.eltiempo.com/robots.txt
indexer[7531]: {01} ROBOTS.Response.URL_ID: -1930674696
indexer[7531]: {01} Link
'http://www.eltiempo.com/vidadehoy/2007-03-19/ARTICULO-WEB-NOTA_INTERIOR-3482297.html'
http://www.eltiempo.com/vidadehoy/2007-03-19/ARTICULO-WEB-NOTA_INTERIOR-3482297.html
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Link
'http://www.eltiempo.com/vidadehoy/2007-03-17/ARTICULO-WEB-NOTA_INTERIOR-3479607.html'
http://www.eltiempo.com/vidadehoy/2007-03-17/ARTICULO-WEB-NOTA_INTERIOR-3479607.html
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Link
'http://www.eltiempo.com/nacion/2007-03-18/ARTICULO-WEB-NOTA_INTERIOR-3480844.html'
http://www.eltiempo.com/nacion/2007-03-18/ARTICULO-WEB-NOTA_INTERIOR-3480844.html
indexer[7531]: {01} Allow by default
indexer[7531]: {01} Server applied: site_id: -881204719 URL: *
indexer[7531]: {01} Allow by default
indexer[7531]: {01} [url/info] rec_id: 130f not found for delete
indexer[7531]: {01} [url/info] Stored rec_id: 130f Size: 178
indexer[7531]: {01} Done (9 seconds, 1 documents, 44012 bytes, 4.78
Kbytes/sec.)
indexer[7531]: {00} Total 10 seconds, 1 documents, 44012 bytes, 4.30
Kbytes/sec, 10.00 sec/doc, 44012 bytes/doc.
- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1173282286
