Dedup - works on single file

[K.A.Hussain Ali]

HI all,

Do delete dupliates (dedup) works on single segment ?

Or do Nutch provides  any ways to delete dupliates  (dedup) on group of 
segments ?

I tried give the entire segments folder but it works on single segment only..

Any Help is greatly appreciated

Thanks in advance

regards
-Hussain.