[
https://issues.apache.org/jira/browse/SPARK-19754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891069#comment-15891069
]
Juan Pumarino commented on SPARK-19754:
---------------------------------------
Thank you both for your replies and for looking into the issue.
After git bisecting I found the
[commit|https://github.com/apache/spark/commit/6b34e745bb8bdcf5a8bb78359fa39bbe8c6563cc]
and the original JIRA: SPARK-19178.
It'd be nice if it could be backported to 1.6
> Casting to int from a JSON-parsed float rounds instead of truncating
> --------------------------------------------------------------------
>
> Key: SPARK-19754
> URL: https://issues.apache.org/jira/browse/SPARK-19754
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.6.3, 2.1.0
> Reporter: Juan Pumarino
> Priority: Minor
>
> When retrieving a float value from a JSON document, and then casting it to an
> integer, Hive simply truncates it, while Spark is rounding up when the
> decimal value is >= 5.
> In Hive, the following query returns {{1}}, whereas in a Spark shell the
> result is {{2}}.
> {code}
> SELECT CAST(get_json_object('{"a": 1.6}', '$.a') AS INT)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
