viirya commented on issue #23719: [SPARK-26808][SQL] Pruned schema should not change nullability URL: https://github.com/apache/spark/pull/23719#issuecomment-459622374 > We need an end-to-end test case to show how we can get a not-nullable column when reading from a parquet file. The method to prune schema can be reused in other places. Even we can't get a not-nullable column when reading from a parquet file, we should still fix it.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
