GitHub user traviscrawford opened a pull request:
https://github.com/apache/spark/pull/11967
[SPARK-14081][SQL] - Update DataFrameNaFunctions.fill to preserve column
datâ¦
## What changes were proposed in this pull request?
This change resolves an issue where `DataFrameNaFunctions.fill` changes a
`FloatType` column to a `DoubleType`. We also clarify the contract that
replacement values will be cast to the column data type, which may change the
replacement value when casting to a lower precision type.
## How was this patch tested?
This patch has associated unit tests.
This is my first Spark contribution, and I believe the process described at
https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-ContributingCodeChanges
has been followed. Apologies if I've missed anything.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/traviscrawford/spark SPARK-14081-dataframena
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11967.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11967
----
commit 834ee699b209cd417d0d87b2ee7ed62910573979
Author: Travis Crawford <[email protected]>
Date: 2016-03-25T17:12:55Z
SPARK-14081 - Update DataFrameNaFunctions.fill to preserve column data types
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
