Created PR and verified the example given by Justin works with the change:
https://github.com/apache/spark/pull/6793
Cheers
On Wed, Jun 10, 2015 at 7:15 PM, Ted Yu wrote:
> Looks like the NPE came from this line:
> @transient protected lazy val rng = new XORShiftRandom(seed +
> TaskContext.ge
Looks like the NPE came from this line:
@transient protected lazy val rng = new XORShiftRandom(seed +
TaskContext.get().partitionId())
Could TaskContext.get() be null ?
On Wed, Jun 10, 2015 at 6:15 PM, Justin Yip wrote:
> Hello,
>
> I am using 1.4.0 and found the following weird behavior.
>
>
