dongjoon-hyun commented on PR #60083: URL: https://github.com/apache/spark/pull/60083#issuecomment-6637062584
Thank you for the review and the version check, @sarutak. You are right that SPARK-37392 also landed in 3.2.1 and 3.1.3, so I updated the description to say 3.1.3 and 3.2.1 with both release links. For 3.1.3, a failing LEGACY cast exists without the ANSI interval types: `CAST(d AS TIMESTAMP)` fails with `ArithmeticException: long overflow` for a `DATE` value past the `TIMESTAMP` range, such as `date_add(DATE'2020-01-01', 2000000000)`, while `size(array(CAST(d AS TIMESTAMP)))` over such a column returns `1`. I checked this on master with and without this PR. 3.1.3 has the same `ConstantFolding` guard and the same `Math.multiplyExact` in `DateTimeUtils.daysToMicros`, but I did not run 3.1.3 itself. I also added `cardinality` to the user-facing change section. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
