GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/22785
[SPARK-25791][SQL] Datatype of serializers in RowEncoder should be
accessible
## What changes were proposed in this pull request?
The serializers of `RowEncoder` use few `If` Catalyst expression which
inherits `ComplexTypeMergingExpression` that will check input data types.
It is possible to generate serializers which fail the check and can't to
access the data type of serializers. When producing If expression, we should
use the same data type at its input expressions.
## How was this patch tested?
Added test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/viirya/spark-1 SPARK-25791
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22785.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22785
----
commit d6ed4b7cec98b34ff609df3fdfcd009c1f01c50a
Author: Liang-Chi Hsieh <viirya@...>
Date: 2018-10-21T00:57:18Z
Datatype of serializers should be accessible.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
