GitHub user bravo-zhang opened a pull request:
https://github.com/apache/spark/pull/18820
[SPARK-14932][SQL] Allow DataFrame.replace() to replace values with None
## What changes were proposed in this pull request?
Allow DataFrame.replace() to replace with None/null values.
## How was this patch tested?
Python doctest and unit test. Scala unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bravo-zhang/spark spark-14932
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18820.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18820
----
commit 2653750762c12cf5d17b8a2ac2a7ee9f8d55bfec
Author: bravo-zhang <[email protected]>
Date: 2016-12-09T05:22:31Z
[SPARK-14932][SQL] Allow DataFrame.replace() to replace values with None
commit 2eac8b9070f12fd7dade103857682669d3017587
Author: bravo-zhang <[email protected]>
Date: 2016-12-09T17:35:35Z
Scala test for df.replace with null
commit 79492924bfad40f36aa132e58376da98b0727eac
Author: bravo-zhang <[email protected]>
Date: 2016-12-09T17:44:39Z
Use pattern matching for null case
commit 0b15c8f1d64754432c6585bb88e20d17738d4bbd
Author: bravo-zhang <[email protected]>
Date: 2016-12-09T17:45:51Z
Fix indentation
commit 2c532c3781087ec8f0c36d5176837c9de568d7ec
Author: bravo-zhang <[email protected]>
Date: 2016-12-10T17:42:44Z
Fix Python style check
commit 5ab39cc61738b0abe87f7ebb635e45c28f1c97bf
Author: bravo-zhang <[email protected]>
Date: 2017-05-24T00:09:21Z
Merge branch 'master' into spark-14932
commit 43fb6bd56802f2c20cdd28f7ea384e472183cdc4
Author: bravo-zhang <[email protected]>
Date: 2017-05-24T00:46:19Z
Improve scala doc and pyspark test
commit b5424d9fea56d2e0fb57ebc27d3d35054da6d22b
Author: bravo-zhang <[email protected]>
Date: 2017-05-24T02:56:07Z
Fix python3 dict.values() syntax
commit a3939ba6e80d26f9d4283da8bea2c36244d876e1
Author: bravo-zhang <[email protected]>
Date: 2017-08-02T15:51:47Z
Unify allowed null in Python and Scala
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
