yuanoOo commented on PR #853: URL: https://github.com/apache/incubator-paimon/pull/853#issuecomment-1502849704
> I've thought about this fix, maybe we can make it more thorough. Like `org.apache.paimon.utils.TypeUtils.castFromString`, we can have a `castToString`. Then, the string will be SQL standard string. > > But this will bring more serious issues, incompatibility, and we may need an option or an old class to fall back to the old path when we cannot find it. This is complicated. > > Is this problem serious now? Can we keep it this way for now? I think it's a very user experience affecting issue. In a stream writing paimon scenario, it is very common to cast a field of timestamp type to DATE type in order to write to the corresponding partition. However, in paimon, when the user uses a partition of type DATE, the partition path becomes a strange unreadable string of numbers, which may be unacceptable. If you want to get the correct partition string, but need to convert timestamp type to date string, which is counterintuitive and sql is tedious. I think the current addition of support for DATE type partitioning is sufficient. For the compatibility issue, it will be easy to solve if we can get the version information of paimon. For example, we can determine how to format DATE type partitions based on the version number. I think there are probably few users who use it for the strange performance of the current version of the DATE type partition. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
