Hello,
<segment>/index - is used during searching
<segment>/parse_text - summary generation
<segment>/parse_data - returns metadata for given page (used eg. during
cached content display to determine content-type).
<segment>/content - cached content
<segment>/fetcher - returns e.g. anchors for given page
Regards,
Piotr
EM wrote:
I'm trying to grasp something here, I need a quick confirmation about the
following, a yes/no would suffice:
When searching and generating summaries, tomcat uses only:
1. <segment>/index
2. <segment>/parse_text
When retrieving the "cached" copy of the document, tomcat uses:
1. <segment>/parse_data
Are <segment>/fetcher and <segment>/context used at during the searching
stage?
Regards,
E.
-----Original Message-----
From: Ken Krugler [mailto:[EMAIL PROTECTED]
Sent: Monday, July 25, 2005 3:18 PM
To: [email protected]
Subject: Re: html parsers and windows-1251 (ukrainian)
I see incorrect characters pseudo graphics instead characters (which not
present in Russian) in summaries for Ukrainian 1251.
With Russian languages in summary all fine.
For example cached version http://search.kvitka.info/cached.jsp?idx=0
<http://search.kvitka.info/cached.jsp?idx=0&id=48679> &id=48679
On top you can find original document url and see difference :)
How can I fix that or can anybody help me with next issue?
Both pages look OK to me, though I don't read Ukrainian - sorry :)
I'm running Mac OS X 10.3 w/the Safari browser. I can send you the
screenshot of the summary if you'd like.
When I looked at the source of the original page
(http://www.prosvita.kiev.ua/posyl_m.htm) I didn't see any charset
specified. I'm guessing it should have an explicit CP 1251 in there,
versus forcing browsers to guess.
In the summary page generated by Nutch
(http://search.kvitka.info/cached.jsp?idx=0&id=48679) it explicitly
specifies UTF-8.
So my guess is that your browser either can't handle UTF-8, or you've
got it configured to assume CP 1251.
-- Ken
-------------------------------------------------------
SF.Net email is sponsored by: Discover Easy Linux Migration Strategies
from IBM. Find simple to follow Roadmaps, straightforward articles,
informative Webcasts and more! Get everything you need to get up to
speed, fast. http://ads.osdn.com/?ad_id=7477&alloc_id=16492&op=click
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
