[
https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105537#comment-14105537
]
William Benton commented on SPARK-2863:
---------------------------------------
I wrote up how Hive handles type coercions in a blog post:
http://chapeau.freevariable.com/2014/08/existing-system-coercion.html
The short version is that strings can be coerced to doubles or decimals and (in
Hive 0.13) decimals can be coerced to doubles for numeric functions. As a
first pass, I propose extending the numeric function helpers to handle strings.
> Emulate Hive type coercion in native reimplementations of Hive functions
> ------------------------------------------------------------------------
>
> Key: SPARK-2863
> URL: https://issues.apache.org/jira/browse/SPARK-2863
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.0.0
> Reporter: William Benton
> Assignee: William Benton
>
> Native reimplementations of Hive functions no longer have the same
> type-coercion behavior as they would if executed via Hive. As [Michael
> Armbrust points
> out|https://github.com/apache/spark/pull/1750#discussion_r15790970], queries
> like {{SELECT SQRT("2") FROM src LIMIT 1}} succeed in Hive but fail if
> {{SQRT}} is implemented natively.
> Spark SQL should have Hive-compatible type coercions for arguments to
> natively-implemented functions.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
