My understanding that nutch "Generate"  job filters all available URLs in a 
Nutch database by two criteria:
1.  fetchTime + fetchInterval should be less than current time.
2. Number selected URLs for "Fetch" job should be less than -topN parameter 
value. Value for "score" field from the database is used for this selection.
During crawling I can see only two values for the  "score" field. Value 1 is 
always set during "Inject" job, value 0 is always set during "Parse" job. 
Looking on the code I see that OPICscoring plugin is used to define these 

Is my understanding correct?   How can be defined "score" value different then 
0 or 1?


Reply via email to