[ https://issues.apache.org/jira/browse/NUTCH-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13655807#comment-13655807 ]
Tejas Patil commented on NUTCH-1545: ------------------------------------ I dont fully understand the significance of batchID.. but from the latest patch, it seems that the responsibility of generating a random batchId is pushed from code to the end user. What if users pass the same "batchId" value again and again ? A better deal would be to make that param optional and let the code continue generate a random batchID when users dont provide any batchID. So crawl script would generate a random id and pass to the generate command. Users dont have to bother about the random ID and would not end up re-using stale batchIDs. What say ? > capture batchId and remove references to segments in 2.x crawl script. > ---------------------------------------------------------------------- > > Key: NUTCH-1545 > URL: https://issues.apache.org/jira/browse/NUTCH-1545 > Project: Nutch > Issue Type: Task > Affects Versions: 2.1 > Reporter: Lewis John McGibbney > Assignee: lufeng > Priority: Minor > Fix For: 2.2 > > Attachments: NUTCH-1545.patch, NUTCH-1545-v2.patch > > > The concept of segment is replaced by batchId in 2.x > I'm currently getting rid of segments references in 2.x > This issue was flagged up and separate from NUTCH-1532 which I am working on. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira