sapienza88 opened a new issue, #804: URL: https://github.com/apache/incubator-xtable/issues/804
### Feature Request / Improvement A Variant is a binary encoding designed to store nested, schema-less data (JSON-like) while allowing for shredding—the ability to pull common fields out into their own columns for lightning-fast access. Parquet users had to choose between two extremes: 1. Map/Struct types: High performance, but requires a fixed schema. 2. JSON Strings: Flexible, but requires scanning the whole string to find one value (very slow). The Variant type is the modern "middle ground" solution, recently standardized by the Apache Parquet and Apache Iceberg communities. This type is not yet supported for Syncing Parquet files into either Iceberg, Delta or Hudi. Original PR supporting the current type into Parquet Format is: [Added Variant to Parquet Format](https://github.com/apache/parquet-format/issues/459) ### Are you willing to submit PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
