I was just wondering the other day: What if the the values for a key that get passed into the reducer do not fit into memory? After all a reducer should get all values per key from the whole job. Is the iterator disk backed?
cheers -- Torsten
I was just wondering the other day: What if the the values for a key that get passed into the reducer do not fit into memory? After all a reducer should get all values per key from the whole job. Is the iterator disk backed?
cheers -- Torsten