hi all:
   i get a big problem when crawl the ftp.
  it seems that Nutch couldn't parse or index the files named in Chinese!!!!
so after the command looks like:

bin/nutch crawl urls.txt -dir test.dir

(i've modified the crawl-urlfilter.txt)


# skip file:, ftp:, & mailto: urls
#-^(file|ftp|mailto):

# skip image and other suffixes we can't yet parse
-\.(gif|GIF|jpg|JPG|ico|ICO|css|sit|eps|wmf|zip|ppt|mpg|xls|gz|rpm|tgz|mov|MOV|exe|png|PNG)$

# skip URLs containing certain characters as probable queries, etc.
[EMAIL PROTECTED]

# accept hosts in MY.DOMAIN.NAME
+^ftp://*


when i seach something in tomcat 5.0.28 ,the results are messy character.
so anyone can tell me anything helpful to solve this big problem to me.
any reply will be appreciated.

--
www.babatu.com

Reply via email to