bersprockets opened a new pull request, #38986:
URL: https://github.com/apache/spark/pull/38986

   ### What changes were proposed in this pull request?
   
   When a user specifies a null format in `to_char`, return null instead of 
throwing a `NullPointerException`.
   
   ### Why are the changes needed?
   
   `to_char` currently throws a `NullPointerException` when the format is null:
   ```
   spark-sql> select to_char(454, null);
   [INTERNAL_ERROR] The Spark SQL phase analysis failed with an internal error. 
You hit a bug in Spark or the Spark plugins you use. Please, report this bug to 
the corresponding communities or vendors, and provide the full stack trace.
   org.apache.spark.SparkException: [INTERNAL_ERROR] The Spark SQL phase 
analysis failed with an internal error. You hit a bug in Spark or the Spark 
plugins you use. Please, report this bug to the corresponding communities or 
vendors, and provide the full stack trace.
   ...
   Caused by: java.lang.NullPointerException
        at 
org.apache.spark.sql.catalyst.expressions.ToCharacter.numberFormat$lzycompute(numberFormatExpressions.scala:227)
        at 
org.apache.spark.sql.catalyst.expressions.ToCharacter.numberFormat(numberFormatExpressions.scala:227)
        at 
org.apache.spark.sql.catalyst.expressions.ToCharacter.numberFormatter$lzycompute(numberFormatExpressions.scala:228)
        at 
org.apache.spark.sql.catalyst.expressions.ToCharacter.numberFormatter(numberFormatExpressions.scala:228)
        at 
org.apache.spark.sql.catalyst.expressions.ToCharacter.checkInputDataTypes(numberFormatExpressions.scala:236)
   ```
   Compare to `to_binary`:
   ```
   spark-sql> SELECT to_binary('abc', null);
   NULL
   Time taken: 3.097 seconds, Fetched 1 row(s)
   spark-sql>
   ```
   Also compare to `to_char` in PostgreSQL 14.6:
   ```
   select to_char(454, null) is null as to_char_is_null;
   
    to_char_is_null 
   -----------------
    t
   (1 row)
   ```
   
   ### Does this PR introduce _any_ user-facing change?
   
   No.
   
   ### How was this patch tested?
   
   New unit test.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to