Hi,

I am implementing my own serde and storage handler. Is there any
method in one of these interfaces (or any other) which give me a
handle to do some operation after all the records have been written by
all reducer.  Something very similar to job level output committer. I
want to update some state in an external system once I know job has
completed successfully. Ideally, I would do this kind of a thing in a
job level output committer, but since Hive is on old MR api, I dont
have access to that.  There is a Hive's RecordWriter#close() I tried
that but it looks like its a task level handle. So, every reducer will
try to update the state of my external system, which is not I want.
Any pointers on how to achieve this will be much appreciated. If its
unclear what I am asking for, let me know and I will provide more
details.

Thanks,
Ashutosh

Reply via email to