[
https://issues.apache.org/jira/browse/SPARK-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187570#comment-14187570
]
Michael Armbrust commented on SPARK-3683:
-----------------------------------------
Good find! [~jamborta] if you can give code that shows Hive does interpret
this as null I'd consider adding it back for compatibility otherwise it seems
like this is expected behavior. /cc [~liancheng]
> PySpark Hive query generates "NULL" instead of None
> ---------------------------------------------------
>
> Key: SPARK-3683
> URL: https://issues.apache.org/jira/browse/SPARK-3683
> Project: Spark
> Issue Type: Bug
> Components: PySpark, SQL
> Affects Versions: 1.1.0
> Reporter: Tamas Jambor
> Assignee: Davies Liu
>
> When I run a Hive query in Spark SQL, I get the new Row object, where it does
> not convert Hive NULL into Python None instead it keeps it string 'NULL'.
> It's only an issue with String type, works with other types.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
