Hi All,

Currently we can shutdown an Apex app in the following ways:
1. Throw ShutdownException() from *all* the input operators
2. Use Apex CLI to shutdown an app using the YARN App Id

I think we should have some way of shutting down an application from within
an operator. It is not always true that the trigger for shutdown is sent by
the input operator only. Sometimes, an end condition may be detected by
some operator in the DAG which wants the processing to end. Such a
shutdown, although triggered from some intermediate operator in the DAG,
should guarantee graceful shut down of the application.

Thoughts?

~ Bhupesh

Reply via email to