When I do:
nutch generate crawl/db crawl/segments -numFetchers 30 -topN 5000
I was trying to get 30 partitions of segments (30 subdirs in segments dir
generated)
but instead, it give me:
Generator: jobtracker is 'local', generating exactly one partition
so only one partition generated (one subdir in segments dir generated)
that one partition seems too big for me to fetch it later on,
Why 'nutch generate' is ignoring my argument of -numFetchers?
Thank you.
Jenny
---------------------------------
Got a little couch potato?
Check out fun summer activities for kids.
