Hello, does anyone know how I can check if a streaming job (in Perl) has
failed or succeeded? The only way I can see at the moment is to check
the web interface for that jobID and parse out the '*Status:*' value.
Is it not possible to do this using 'hadoop job -status' ? I see there
is a count
for failed map/reduce tasks, but map/reduce tasks failing is normal (or so
I thought). I am under the impression that if a task fails it will
simply be
reassigned to a different node. Is this not the case? If this is
normal then I
can't reliably use this count to check if the job as a whole failed or
succeeded.
Any feedback is greatly appreciated.
thanks,
M
