Github user JoshRosen commented on a diff in the pull request:
https://github.com/apache/spark/pull/3715#discussion_r23663046
--- Diff: core/src/main/scala/org/apache/spark/api/python/PythonRDD.scala
---
@@ -313,6 +313,7 @@ private object SpecialLengths {
val PYTHON_EXCEPTION_THROWN = -2
val TIMING_DATA = -3
val END_OF_STREAM = -4
+ val NULL = -5
--- End diff --
@tdas I think that this same null-handling change has been proposed before
but until now I don't think we had a great reason to pull it in, since none of
our internal APIs relied on it and we were worried that it might mask the
presence of bugs. Now that we have a need for it, though, it might be okay to
pull in here.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
