Re: FW: Removing files after processing

[Doug Cutting]

Matt Kent wrote:

I would find it useful to have some sort of listener mechanism, where
you could register an object to be notified of a job completion event
and then respond to it accordingly.

There is a job completion notification feature.

<property>
 <name>job.end.notification.url</name>
 <value>http://localhost/foo.php?id=$jobId&amp;status=$jobStatus</value>
 <description>Indicates url which will be called on completion of job to
              inform end status of job.
              User can give at most 2 variables with URI :
               $jobId and $jobStatus.
              If they are present in URI, then they will be replaced by
              their respective values.
 </description>
</property>

<property>
  <name>job.end.retry.attempts</name>
  <value>0</value>
  <description>Indicates how many times hadoop should attempt to contact
               the notification URL.</description>
</property>

<property>
  <name>job.end.retry.interval</name>
  <value>30000</value>
  <description>Indicates time in milliseconds between notification URL
               retry calls.</description>
</property>

Doug