AngersZhuuuu commented on pull request #32018: URL: https://github.com/apache/spark/pull/32018#issuecomment-811731723
> > which case the path will be null and which case it can be **HIVE_DEFAULT_PARTITION**? > > The `null` partition value should be replaced to `__HIVE_DEFAULT_PARTITION__` if it goes via DSv1 and external catalog (Hive MetaStore doesn't accept null part values, and `null` part value in filesystem like `col0=null` is not compatible with other systems). v1 In-Memory catalog follows Hive external catalog as far as I know. > > DSv2 impl should handle `null` itself. So, we shouldn't replace it by `__HIVE_DEFAULT_PARTITION__`. Thanks you a lot for clarify this problem. This make me confused for a long time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
