[GitHub] [incubator-iceberg] rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution

rdblue commented on issue #540: URL: https://github.com/apache/incubator-iceberg/issues/540#issuecomment-631586214 @geota, in Spark, "automatic schema evolution" usually means not validating the schema on write and merging schemas together on read to find what the table schema actually

[GitHub] [incubator-iceberg] rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution

rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution URL: https://github.com/apache/incubator-iceberg/issues/540#issuecomment-541446146 Yes, it will. But we would want to fail earlier than that. The case I'm thinking about is when you're

[GitHub] [incubator-iceberg] rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution

rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution URL: https://github.com/apache/incubator-iceberg/issues/540#issuecomment-541442093 Yeah, I think that could be a good idea. We'd want to document some of the risks, though. It's easy to

[GitHub] [incubator-iceberg] rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution

rdblue commented on issue #540: Iceberg tables should optionally allow for automatic schema evolution URL: https://github.com/apache/incubator-iceberg/issues/540#issuecomment-541440371 What do you mean by automatic schema evolution? When you write to a table, any new columns are