Hi All,
Created Sample application for THREAD_LOCAL issue. Application is here
<https://github.com/chaithu14/AppThreadLocal>.
Application has the following DAG:
RandomEventGenerator -> OuputOperator.
Both the operators are THREAD_LOCAL.
In OutputOperator, throwing exceptions at every committed window. So,
AppMaster supposed to kill container at every committed window. This is
expected behavior.
But, this is not happening with the current Apex.
One more observation is, If the upstream operator throws exception at
every committed window, then AppMaster is killing the container
continuously. But, this is not happening with the downstream operator.
Created JIRA for this issue: APEXCORE-357
Regards,
Chaitanya
On Thu, Feb 25, 2016 at 12:36 PM, Chaitanya Chebolu <
[email protected]> wrote:
> Hi ,
>
> I am facing issues in Thread_Local. Two operators which are thread local
> and out of which, the downstream operator throws exceptions. But, AppMaster
> is not catching those exceptions. I was unable to figure out why
> application is not working.
> If both the operators are deployed on different containers, then the
> container is killed continuously by AppMaster. This is expected behavior.
>
> For Example, Let's say the dag be op1 -> op2 where op1, op2 are two
> operators which are of them thread local. Throws an exception from the
> downstream operator op2, AppMaster is not catching exceptions. I will
> create a JIRA for this issue. Please some one help on this.
>
> Regards,
> Chaitanya
>
