Strongly suspect you're mutating an object at the point in time it is
Serialized.
I suggest you remove all mutation from your code.
HTH.
Phillip
On Fri, Dec 13, 2019 at 7:19 PM Ravi Aggarwal
wrote:
> Hi,
>
>
>
> We are encountering java OptionalDataException in one of our spark jobs.
>
> All
Hi,
We are encountering java OptionalDataException in one of our spark jobs.
All the tasks of a stage passes (or atleast we do not see any error), but stage
fails with above exception while getting task result.
And and this exception gets printed on driver.
Any pointers in this regard would be h
