I'm trying to grasp something here, I need a quick confirmation about the following, a yes/no would suffice:
When searching and generating summaries, tomcat uses only: 1. <segment>/index 2. <segment>/parse_text When retrieving the "cached" copy of the document, tomcat uses: 1. <segment>/parse_data Are <segment>/fetcher and <segment>/context used at during the searching stage? Regards, E. -----Original Message----- From: Ken Krugler [mailto:[EMAIL PROTECTED] Sent: Monday, July 25, 2005 3:18 PM To: [email protected] Subject: Re: html parsers and windows-1251 (ukrainian) >I see incorrect characters pseudo graphics instead characters (which not >present in Russian) in summaries for Ukrainian 1251. > >With Russian languages in summary all fine. > >For example cached version http://search.kvitka.info/cached.jsp?idx=0 ><http://search.kvitka.info/cached.jsp?idx=0&id=48679> &id=48679 > >On top you can find original document url and see difference :) > >How can I fix that or can anybody help me with next issue? Both pages look OK to me, though I don't read Ukrainian - sorry :) I'm running Mac OS X 10.3 w/the Safari browser. I can send you the screenshot of the summary if you'd like. When I looked at the source of the original page (http://www.prosvita.kiev.ua/posyl_m.htm) I didn't see any charset specified. I'm guessing it should have an explicit CP 1251 in there, versus forcing browsers to guess. In the summary page generated by Nutch (http://search.kvitka.info/cached.jsp?idx=0&id=48679) it explicitly specifies UTF-8. So my guess is that your browser either can't handle UTF-8, or you've got it configured to assume CP 1251. -- Ken -- Ken Krugler TransPac Software, Inc. <http://www.transpac.com> +1 530-470-9200 ------------------------------------------------------- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477&alloc_id=16492&op=click _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
