Re: Gracefull stop in the middle of a fetch phase ?

2009-07-25 Thread Alex McLintock
I am not sure if it solves your problem but you might do something like disconnect your machines from the internet - preferably by making your dns server return dont know that domain This will relatively quickly cause the remaining part of the fetch to fail. Just a suggestion... Alex 2009/7/23

Re: Gracefull stop in the middle of a fetch phase ?

2009-07-25 Thread Andrzej Bialecki
Alex McLintock wrote: I am not sure if it solves your problem but you might do something like disconnect your machines from the internet - preferably by making your dns server return dont know that domain This will relatively quickly cause the remaining part of the fetch to fail. Just a

Re: Gracefull stop in the middle of a fetch phase ?

2009-07-25 Thread Alex McLintock
2009/7/25 Andrzej Bialecki a...@getopt.org: I solved this once by implementing a check in Fetcher.run() for a marker file on HDFS. If the presence of this file was detected, the FetcherThreads would be stopped one by one (again, by setting a flag in their run() methods to terminate the loop).