mgaido91 commented on issue #23726: [SPARK-26812][SQL] Report correct nullability for complex datatypes in Union URL: https://github.com/apache/spark/pull/23726#issuecomment-462256756 @cloud-fan what we might want to do as an improvement is the exact opposite of what we are doing here IMHO, ie. marking as not nullable datatypes which are nullable in the first plan and not nullable in the second. But this would mean create a new method for doing this and I am not sure that the little gain we have for the optimization is worth the burden of maintaining it (it would be only for complex datatypes with different nullabilities...).
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
