Seems the job file is not deployed to all task trackers and i'm not sure why.
Can you try using the nutch script to run your fetcher?
-----Original message-----
> From:Sourajit Basak <[email protected]>
> Sent: Thu 27-Dec-2012 13:29
> To: [email protected]
> Subject: code changes not reflecting when deployed on hadoop
>
> We have made some changes to Fetcher (v1.5). However, when we build a .job
> (jar) and deploy it on hadoop it doesn't seem to pick up any changes. This
> is how we are running it.
>
> >> ./hadoop jar ../nutch/apache-nutch-1.5.1.job
> org.apache.nutch.fetcher.Fetcher <segment on hdfs> -threads 4
>
> However, if we modify any of the plugins, it picks up the changes properly.
>
> Initially, I doubted that our logic wasn't getting hit. To cross check, we
> removed Fetcher.class from the .job file and re-executed. Still it seems to
> run an old version of the code.
>
> I strongly suspect, I am missing out something which needs to be done after
> a code change.
>
