GitHub user viirya reopened a pull request:
https://github.com/apache/spark/pull/10399
[SPARK-12443][SQL] encoderFor should support Decimal
JIRA: https://issues.apache.org/jira/browse/SPARK-12443
`constructorFor` will call `dataTypeFor` to determine if a type is
`ObjectType` or not. If there is not case for `Decimal`, it will be recognized
as `ObjectType` and causes the bug.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/viirya/spark-1 fix-encoder-decimal
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10399.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10399
----
commit c8cdca50e725d4a5ed4926754e9ef04126cb2f34
Author: Liang-Chi Hsieh <[email protected]>
Date: 2015-12-20T07:30:38Z
Add Decimal support for encoder.
commit 6afb1a40f8bd2528a38e471c8f6d32fdb1aa91d3
Author: Liang-Chi Hsieh <[email protected]>
Date: 2015-12-20T07:44:05Z
Move test case.
commit 2875a5f0c06358d5af338791382523258d1acb10
Author: Liang-Chi Hsieh <[email protected]>
Date: 2015-12-21T07:56:23Z
Move test case to ExpressionEncoderSuite.
commit ed905853b9cf2828881d0e4ecfcabfb6b39ef42d
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-01-11T08:16:10Z
Merge remote-tracking branch 'upstream/master' into fix-encoder-decimal
commit c29c04dcb7a7081b547dcadf079274857ef2592a
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-22T01:15:22Z
Merge remote-tracking branch 'upstream/master' into fix-encoder-decimal
Conflicts:
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/encoders/ExpressionEncoderSuite.scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]