cloud-fan commented on pull request #30554: URL: https://github.com/apache/spark/pull/30554#issuecomment-736717184
> How is changing the file format by default a corner case? I was saying accessing data files of Spark tables differently are corner cases. Users create a table because they want to access the data by table name, not directory. > Hive tables support partitions that use different formats and serde, but Spark tables do not. This is a good point. It's not possible to do it via Spark DDL commands, but people can create table with Spark, then add partitions with different serdes with Hive. I'll put it in the `Does this PR introduce any user-facing change?` section. > Can you point to where this is allowed by the versioning policy? Quoted below: > The Spark project strives to avoid breaking APIs or silently changing behavior, even at major versions. While this is not always possible, the balance of the following factors should be considered before choosing to break an API. We try to avoid breaking changes, but we don't completely forbid it. Breaking changes are allowed when it's justified. We definitely don't allow arbitrary breaking changes. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
