hi Matt:
You nutch-87 has a good idea and I believe it provides
a solution for good size of controled domain, say
hundreds of thousands sites.
I am currently trying to implement it to Nutch 07.
Got several questions want to be clearified:
1)
Should I create two plug-in classes in nutch?
etc
one for "WhitelistURLFilter"
one for "WhitelistWriter
2)
I found Whitelist.java refer to
"import epile.util.LogLevel;"
And
WhitelistURLFilter.java refer to
"import epile.crawl.util.StringURL;
import epile.util.LogLevel;"
Are these new package existing in Nutch lib? If not,
should we import a new epile*.jar?
3)
If we want to use Nutch-87, should we change the code
in Nutch core code.
I plan to "replace" all the places where
RegexURLFilter appearing by WhitelistURLFilter.
Is it a right approach?
thanks,
Michael Ji,
______________________________________________________
Click here to donate to the Hurricane Katrina relief effort.
http://store.yahoo.com/redcross-donate3/
