On 08/26/2010 05:47 PM, Mithila Nagendra wrote:
Thank you so much for a response. I had one last question.
What if I don't want a particular<K, V> pair to be put into a partition?
For example, if K=5, then I want the partitioner to skip this Key. How would
I do this? I tried to return -1 when I don't want a key to go to any
partition, but that causes an "illegal partition" error. How would I do
this?
Thanks!
Mithila
You wouldn't do that in the partitioner. Filtering out specific
records/keys should occur in the mapper or reducer. (And in general
conceptually, the mapper would probably be the more appropriate place,
though it depends on your specific application.)
DR
