chitralverma edited a comment on issue #25122: [SPARK-28286][SQL][PYTHON][TESTS][WIP] Convert and port 'pivot.sql' into UDF test base URL: https://github.com/apache/spark/pull/25122#issuecomment-510751215 @HyukjinKwon Thanks for your review comments, I've replied to them. I feel the suggested workaround([this](https://github.com/apache/spark/pull/25098#issuecomment-510283330) and [this](https://github.com/apache/spark/pull/25098#issuecomment-510283866)) will not work in this case as certain udf's like `sum` return `null` if aggregated on empty datasets ([SPARK-20346](https://issues.apache.org/jira/browse/SPARK-20346)). As per the guide in [SPARK-27921](https://issues.apache.org/jira/browse/SPARK-27921) , do you suggest I create a separate Jira for this and comment the problematic test cases for now ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
