Hello, Was looking into nutch-18 bug that revolves around illegal, non-ascii, characters in a url. An example of a high bit character is 'ç' that maps to a high bit set.
Before applying any fix, did a brief test with 0.8 trunk. After fetching and indexing on http://en.wiktionary.org/wiki/ç, I was able to search on ç and got the following result off the browser results: ç - Wiktionary ... Letter [ edit ] Translingual [ edit ] Letter Ç , ç C with a cedilla ... visit IRC or Wiktionary:AOL . ç ... http://en.wiktionary.org/wiki/%C3%A7 (cached) (explain) (anchors) (more from en.wiktionary.org) So it looks like it will fetch and parse off of urls with high bit set characters. Additionally, the display url has the ç encoded correctly as %C3%A7. Is this really a bug? Doing a similar test off of Google on keywords: "ç" wiktionary. yields: ç - Wiktionary AOL users can access Wiktionary through this link after accepting the CACERT certificate. ... Ç, ç. "tʃə", the fourth letter of the Albanian alphabet. ... en.wiktionary.org/wiki/ç - 15k - Cached - Similar pages [ More results from en.wiktionary.org ] Nearly identical, but the see that the ç is in its decoded form, not %C3%A7. If there's any interest in this issue, let me know. Chris ------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
