GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/10443
[SPARK-12495][SQL] use true as default value for propagateNull in
NewInstance
Most of cases we should propagate null when call `NewInstance`, and so far
there is only one case we should stop null propagation: create product/java
bean. So I think it makes more sense to propagate null by dafault.
This also fixes a bug when encode null array/map, which is firstly
discovered in https://github.com/apache/spark/pull/10401
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cloud-fan/spark encoder
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10443.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10443
----
commit de214af3a4a7cc7736745b8635dff40a456af720
Author: Wenchen Fan <[email protected]>
Date: 2015-12-23T07:46:44Z
use true as default value for propagateNull in NewInstance
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
