[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725614#comment-16725614 ] ASF GitHub Bot commented on SPARK-26308: asfgit closed pull request #23308: [SPARK-26308][SQL]

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720070#comment-16720070 ] ASF GitHub Bot commented on SPARK-26308: mgaido91 opened a new pull request #23308:

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719753#comment-16719753 ] Hyukjin Kwon commented on SPARK-26308: -- ^ I think that sounds okay. > Large BigDecimal value is

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714879#comment-16714879 ] Marco Gaido commented on SPARK-26308: - I checked but it doesn't work because the cast is added

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714782#comment-16714782 ] Marco Gaido commented on SPARK-26308: - I think that works. Maybe it is not a "perfect" solution but

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714769#comment-16714769 ] Wenchen Fan commented on SPARK-26308: - How about we override `ScalaUDF.checkInputTypes` and

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714702#comment-16714702 ] Marco Gaido commented on SPARK-26308: - Yes, but it is an {{AbstractDataType}}, not a {{DataType}}.

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714608#comment-16714608 ] Wenchen Fan commented on SPARK-26308: - there is a `object DecimalType extends AbstractDataType`. >

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714597#comment-16714597 ] Marco Gaido commented on SPARK-26308: - [~cloud_fan] what do you mean by a general {{DecimalType}}? A

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714589#comment-16714589 ] Wenchen Fan commented on SPARK-26308: - `ScalaUDF.inputTypes` is only used to check input types, I

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714557#comment-16714557 ] Marco Gaido commented on SPARK-26308: - So the problem here is that the type inferred for decimal

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714483#comment-16714483 ] Marco Gaido commented on SPARK-26308: - Thanks for pinging me [~dongjoon], I'll take a look at this

[jira] [Commented] (SPARK-26308) Large BigDecimal value is converted to null when passed into a UDF

[ https://issues.apache.org/jira/browse/SPARK-26308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713761#comment-16713761 ] Dongjoon Hyun commented on SPARK-26308: --- cc [~mgaido] > Large BigDecimal value is converted to