Hi, While testing my custom handler written for protocol-interactive selenium plugin of nutch i am facing the below issue :
The handler which i have written clicks through 300 pages present in pagination and collect the links present in each page. The fetcher thread is getting hung after clicking through only 25 pages, I am not understanding how to increase this wait time of fetcher so that it waits until all the 300 pages are clicked. Right now after clicking through 25 pages, the thread is getting hung and another thread is trying to fetch the same url which the previous fetcher thread failed in fetching. So this process is becoming a loop and it goes on. I looked at almost every fetcher thread configuration attributes and played around with different values. But unable to extend the wait time. Any guidelines on how to solve this would be of great help. Thanks, Charan
