Serge Rielau created SPARK-42399:
------------------------------------
Summary: CONV() silently overflows returning wrong results
Key: SPARK-42399
URL: https://issues.apache.org/jira/browse/SPARK-42399
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.4.0
Reporter: Serge Rielau
spark-sql> SELECT
CONV(SUBSTRING('0xffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff',
3), 16, 10);
18446744073709551615
Time taken: 2.114 seconds, Fetched 1 row(s)
spark-sql> set spark.sql.ansi.enabled = true;
spark.sql.ansi.enabled true
Time taken: 0.068 seconds, Fetched 1 row(s)
spark-sql> SELECT
CONV(SUBSTRING('0xffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffffff',
3), 16, 10);
18446744073709551615
Time taken: 0.05 seconds, Fetched 1 row(s)
In ANSI mode we should raise an error for sure.
In non ANSI either an error or a NULL maybe be acceptable.
Alternatively, of course, we could consider if we can support arbitrary domains
since the result is a STRING again.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
